2023-05-15T16:17:42.700 INFO:root:teuthology version: 0.0.1.dev98+g69caab8 2023-05-15T16:17:42.701 DEBUG:teuthology.run:Teuthology command: teuthology --name yuriw-2023-05-15_15:47:06-fs-wip-yuri3-testing-2023-05-10-0851-reef-distro-default-smithi --verbose --owner scheduled_yuriw@teuthology --archive /home/teuthworker/archive/yuriw-2023-05-15_15:47:06-fs-wip-yuri3-testing-2023-05-10-0851-reef-distro-default-smithi/7274453 --description fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} -- /home/teuthworker/archive/yuriw-2023-05-15_15:47:06-fs-wip-yuri3-testing-2023-05-10-0851-reef-distro-default-smithi/7274453/orig.config.yaml 2023-05-15T16:17:42.746 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-05-15T16:17:42.852 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-05-15_15:47:06-fs-wip-yuri3-testing-2023-05-10-0851-reef-distro-default-smithi/7274453 branch: wip-yuri3-testing-2023-05-10-0851-reef description: fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common} email: null first_in_suite: false job_id: '7274453' kernel: client: branch: testing kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-05-15_15:47:06-fs-wip-yuri3-testing-2023-05-10-0851-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-yuri3-testing-2023-05-10-0851-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: ef2746e02c24971e8f0b792fa43f63ba4ae04ec2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: ef2746e02c24971e8f0b792fa43f63ba4ae04ec2 kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri3-testing-2023-05-10-0851-reef sha1: ef2746e02c24971e8f0b792fa43f63ba4ae04ec2 owner: scheduled_yuriw@teuthology priority: 73 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 - - client.0 seed: 8519 sha1: ef2746e02c24971e8f0b792fa43f63ba4ae04ec2 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri3-testing-2023-05-10-0851-reef suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: ef2746e02c24971e8f0b792fa43f63ba4ae04ec2 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi062.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBHXRpeZMN8p3yI2XrS46rkwxnMPF0O7pbTzDubjX0sDfqTswOfNe9Cy+29EDysF2dy5KQl1LNZlBFWxdSKuTGM= smithi161.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCmHBCpsyyp78dEI35jIobg8lTuM1zHQFEN9NbCk5dJLPnJvqK6+rzSeVnqJqzj3rn6MEEz8cQkuDvGTfu3Qe+8= smithi171.front.sepia.ceph.com: ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMP/2RsqyWhdbDFdhSNw+U48Y65s9x2EExzkCG9TAJdC tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: null - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_fscrypt teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 69caab8ec6f44c61c991ae693e8e7b8cd859a896 timestamp: 2023-05-15_15:47:06 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.23459 2023-05-15T16:17:42.853 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/qa; will attempt to use it 2023-05-15T16:17:42.853 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/qa/tasks 2023-05-15T16:17:42.854 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-05-15T16:17:42.856 INFO:teuthology.task.internal:Checking packages... 2023-05-15T16:17:42.887 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'ef2746e02c24971e8f0b792fa43f63ba4ae04ec2' 2023-05-15T16:17:42.887 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-05-15T16:17:42.888 INFO:teuthology.packaging:ref: None 2023-05-15T16:17:42.888 INFO:teuthology.packaging:tag: None 2023-05-15T16:17:42.889 INFO:teuthology.packaging:branch: wip-yuri3-testing-2023-05-10-0851-reef 2023-05-15T16:17:42.889 INFO:teuthology.packaging:sha1: ef2746e02c24971e8f0b792fa43f63ba4ae04ec2 2023-05-15T16:17:42.889 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-yuri3-testing-2023-05-10-0851-reef 2023-05-15T16:17:43.036 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-3097-gef2746e0-1jammy 2023-05-15T16:17:43.036 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-05-15T16:17:43.043 INFO:teuthology.task.internal:no buildpackages task found 2023-05-15T16:17:43.043 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-05-15T16:17:43.075 INFO:teuthology.task.internal:Saving configuration 2023-05-15T16:17:43.092 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-05-15T16:17:43.131 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-05-15T16:17:43.160 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi062.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-05-15_15:47:06-fs-wip-yuri3-testing-2023-05-10-0851-reef-distro-default-smithi/7274453', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-15 16:11:40.312740', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAILJXpRrmYcRZzqk2Sp7kFdpVTocxJ2425dtDm1zTZ9BB'} 2023-05-15T16:17:43.187 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi161.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-05-15_15:47:06-fs-wip-yuri3-testing-2023-05-10-0851-reef-distro-default-smithi/7274453', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-15 16:11:40.314887', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHvDkrodMi5iv8dB906bgxBZbhNHiPtff0XkuHn/vDax'} 2023-05-15T16:17:43.210 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-05-15_15:47:06-fs-wip-yuri3-testing-2023-05-10-0851-reef-distro-default-smithi/7274453', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-05-15 16:11:40.316675', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMP/2RsqyWhdbDFdhSNw+U48Y65s9x2EExzkCG9TAJdC'} 2023-05-15T16:17:43.211 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-05-15T16:17:43.217 INFO:teuthology.task.internal:roles: ubuntu@smithi062.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2023-05-15T16:17:43.218 INFO:teuthology.task.internal:roles: ubuntu@smithi161.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2023-05-15T16:17:43.218 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['client.0'] 2023-05-15T16:17:43.218 INFO:teuthology.run_tasks:Running task console_log... 2023-05-15T16:17:43.359 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb98694ae50>, signals=[15]) 2023-05-15T16:17:43.361 INFO:teuthology.run_tasks:Running task internal.connect... 2023-05-15T16:17:43.367 INFO:teuthology.task.internal:Opening connections... 2023-05-15T16:17:43.368 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi062.front.sepia.ceph.com 2023-05-15T16:17:43.370 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-15T16:17:43.448 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi161.front.sepia.ceph.com 2023-05-15T16:17:43.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-15T16:17:43.527 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com 2023-05-15T16:17:43.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-15T16:17:43.604 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-05-15T16:17:43.612 DEBUG:teuthology.orchestra.run.smithi062:> uname -m 2023-05-15T16:17:43.618 INFO:teuthology.orchestra.run.smithi062.stdout:x86_64 2023-05-15T16:17:43.619 DEBUG:teuthology.orchestra.run.smithi062:> cat /etc/os-release 2023-05-15T16:17:43.667 INFO:teuthology.orchestra.run.smithi062.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-05-15T16:17:43.667 INFO:teuthology.orchestra.run.smithi062.stdout:NAME="Ubuntu" 2023-05-15T16:17:43.667 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_ID="22.04" 2023-05-15T16:17:43.668 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-05-15T16:17:43.668 INFO:teuthology.orchestra.run.smithi062.stdout:VERSION_CODENAME=jammy 2023-05-15T16:17:43.668 INFO:teuthology.orchestra.run.smithi062.stdout:ID=ubuntu 2023-05-15T16:17:43.668 INFO:teuthology.orchestra.run.smithi062.stdout:ID_LIKE=debian 2023-05-15T16:17:43.668 INFO:teuthology.orchestra.run.smithi062.stdout:HOME_URL="https://www.ubuntu.com/" 2023-05-15T16:17:43.668 INFO:teuthology.orchestra.run.smithi062.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-05-15T16:17:43.673 INFO:teuthology.orchestra.run.smithi062.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-05-15T16:17:43.673 INFO:teuthology.orchestra.run.smithi062.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-05-15T16:17:43.673 INFO:teuthology.orchestra.run.smithi062.stdout:UBUNTU_CODENAME=jammy 2023-05-15T16:17:43.674 INFO:teuthology.lock.ops:Updating smithi062.front.sepia.ceph.com on lock server 2023-05-15T16:17:43.697 DEBUG:teuthology.orchestra.run.smithi161:> uname -m 2023-05-15T16:17:43.703 INFO:teuthology.orchestra.run.smithi161.stdout:x86_64 2023-05-15T16:17:43.703 DEBUG:teuthology.orchestra.run.smithi161:> cat /etc/os-release 2023-05-15T16:17:43.750 INFO:teuthology.orchestra.run.smithi161.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-05-15T16:17:43.751 INFO:teuthology.orchestra.run.smithi161.stdout:NAME="Ubuntu" 2023-05-15T16:17:43.751 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_ID="22.04" 2023-05-15T16:17:43.751 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-05-15T16:17:43.751 INFO:teuthology.orchestra.run.smithi161.stdout:VERSION_CODENAME=jammy 2023-05-15T16:17:43.751 INFO:teuthology.orchestra.run.smithi161.stdout:ID=ubuntu 2023-05-15T16:17:43.751 INFO:teuthology.orchestra.run.smithi161.stdout:ID_LIKE=debian 2023-05-15T16:17:43.752 INFO:teuthology.orchestra.run.smithi161.stdout:HOME_URL="https://www.ubuntu.com/" 2023-05-15T16:17:43.752 INFO:teuthology.orchestra.run.smithi161.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-05-15T16:17:43.752 INFO:teuthology.orchestra.run.smithi161.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-05-15T16:17:43.752 INFO:teuthology.orchestra.run.smithi161.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-05-15T16:17:43.752 INFO:teuthology.orchestra.run.smithi161.stdout:UBUNTU_CODENAME=jammy 2023-05-15T16:17:43.752 INFO:teuthology.lock.ops:Updating smithi161.front.sepia.ceph.com on lock server 2023-05-15T16:17:43.788 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2023-05-15T16:17:43.794 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2023-05-15T16:17:43.794 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2023-05-15T16:17:43.841 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2023-05-15T16:17:43.841 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="Ubuntu" 2023-05-15T16:17:43.841 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="22.04" 2023-05-15T16:17:43.841 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2023-05-15T16:17:43.841 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_CODENAME=jammy 2023-05-15T16:17:43.842 INFO:teuthology.orchestra.run.smithi171.stdout:ID=ubuntu 2023-05-15T16:17:43.842 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE=debian 2023-05-15T16:17:43.842 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://www.ubuntu.com/" 2023-05-15T16:17:43.842 INFO:teuthology.orchestra.run.smithi171.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-05-15T16:17:43.842 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-05-15T16:17:43.842 INFO:teuthology.orchestra.run.smithi171.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-05-15T16:17:43.842 INFO:teuthology.orchestra.run.smithi171.stdout:UBUNTU_CODENAME=jammy 2023-05-15T16:17:43.843 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2023-05-15T16:17:43.871 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-05-15T16:17:43.881 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-05-15T16:17:43.922 INFO:teuthology.task.internal:Checking for old test directory... 2023-05-15T16:17:43.923 DEBUG:teuthology.orchestra.run.smithi062:> test '!' -e /home/ubuntu/cephtest 2023-05-15T16:17:43.925 DEBUG:teuthology.orchestra.run.smithi161:> test '!' -e /home/ubuntu/cephtest 2023-05-15T16:17:43.928 DEBUG:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest 2023-05-15T16:17:43.933 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-05-15T16:17:43.947 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-05-15T16:17:43.948 DEBUG:teuthology.orchestra.run.smithi062:> test -z $(ls -A /var/lib/ceph) 2023-05-15T16:17:43.972 DEBUG:teuthology.orchestra.run.smithi161:> test -z $(ls -A /var/lib/ceph) 2023-05-15T16:17:43.975 DEBUG:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph) 2023-05-15T16:17:44.079 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-05-15T16:17:44.166 INFO:teuthology.run_tasks:Running task kernel... 2023-05-15T16:17:44.266 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'} 2023-05-15T16:17:44.267 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}} 2023-05-15T16:17:44.267 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}}, timeout 300 2023-05-15T16:17:44.268 DEBUG:teuthology.orchestra.run.smithi171:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-15T16:17:44.273 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-15T16:17:44.273 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=testing 2023-05-15T16:17:44.478 DEBUG:teuthology.task.kernel:sha1 for client.0 is 7312ab6f53ec3dd1c2d90b6652327feae750728b 2023-05-15T16:17:44.478 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "7312ab6f53ec3dd1c2d90b6652327feae750728b"... 2023-05-15T16:17:44.478 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2023-05-15T16:17:44.484 INFO:teuthology.orchestra.run.smithi171.stdout:5.15.0-56-generic 2023-05-15T16:17:44.484 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-56-generic vs 7312ab6f53ec3dd1c2d90b6652327feae750728b 2023-05-15T16:17:44.485 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-05-15T16:17:44.485 INFO:teuthology.task.kernel:Installing linux-firmware on client.0... 2023-05-15T16:17:44.485 DEBUG:teuthology.orchestra.run.smithi171:> cd /lib/firmware/updates && test -d .git && test '!' -s .git/HEAD && sudo rm -rf .git ; sudo install -d -m0755 /lib/firmware/updates && cd /lib/firmware/updates && sudo git init 2023-05-15T16:17:44.544 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: cd: /lib/firmware/updates: No such file or directory 2023-05-15T16:17:44.678 INFO:teuthology.orchestra.run.smithi171.stderr:hint: Using 'master' as the name for the initial branch. This default branch name 2023-05-15T16:17:44.678 INFO:teuthology.orchestra.run.smithi171.stderr:hint: is subject to change. To configure the initial branch name to use in all 2023-05-15T16:17:44.678 INFO:teuthology.orchestra.run.smithi171.stderr:hint: of your new repositories, which will suppress this warning, call: 2023-05-15T16:17:44.678 INFO:teuthology.orchestra.run.smithi171.stderr:hint: 2023-05-15T16:17:44.679 INFO:teuthology.orchestra.run.smithi171.stderr:hint: git config --global init.defaultBranch 2023-05-15T16:17:44.679 INFO:teuthology.orchestra.run.smithi171.stderr:hint: 2023-05-15T16:17:44.679 INFO:teuthology.orchestra.run.smithi171.stderr:hint: Names commonly chosen instead of 'master' are 'main', 'trunk' and 2023-05-15T16:17:44.679 INFO:teuthology.orchestra.run.smithi171.stderr:hint: 'development'. The just-created branch can be renamed via this command: 2023-05-15T16:17:44.679 INFO:teuthology.orchestra.run.smithi171.stderr:hint: 2023-05-15T16:17:44.679 INFO:teuthology.orchestra.run.smithi171.stderr:hint: git branch -m 2023-05-15T16:17:44.680 INFO:teuthology.orchestra.run.smithi171.stdout:Initialized empty Git repository in /usr/lib/firmware/updates/.git/ 2023-05-15T16:17:44.681 DEBUG:teuthology.orchestra.run.smithi171:> sudo git --git-dir=/lib/firmware/updates/.git config --get remote.origin.url >/dev/null || sudo git --git-dir=/lib/firmware/updates/.git remote add origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git 2023-05-15T16:17:44.756 DEBUG:teuthology.orchestra.run.smithi171:> sudo git --git-dir=/lib/firmware/updates/.git remote set-url origin git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git >/dev/null 2023-05-15T16:17:44.813 DEBUG:teuthology.orchestra.run.smithi171:> cd /lib/firmware/updates && sudo git fetch origin && sudo git reset --hard origin/main 2023-05-15T16:18:40.088 INFO:teuthology.orchestra.run.smithi171.stderr:From git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware 2023-05-15T16:18:40.088 INFO:teuthology.orchestra.run.smithi171.stderr: * [new branch] main -> origin/main 2023-05-15T16:18:40.117 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20190312 -> 20190312 2023-05-15T16:18:40.117 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20190416 -> 20190416 2023-05-15T16:18:40.117 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20190514 -> 20190514 2023-05-15T16:18:40.117 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20190618 -> 20190618 2023-05-15T16:18:40.118 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20190717 -> 20190717 2023-05-15T16:18:40.118 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20190815 -> 20190815 2023-05-15T16:18:40.118 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20190923 -> 20190923 2023-05-15T16:18:40.118 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20191022 -> 20191022 2023-05-15T16:18:40.118 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20191215 -> 20191215 2023-05-15T16:18:40.121 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20200122 -> 20200122 2023-05-15T16:18:40.121 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20200316 -> 20200316 2023-05-15T16:18:40.121 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20200421 -> 20200421 2023-05-15T16:18:40.122 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20200519 -> 20200519 2023-05-15T16:18:40.122 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20200619 -> 20200619 2023-05-15T16:18:40.122 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20200721 -> 20200721 2023-05-15T16:18:40.122 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20200817 -> 20200817 2023-05-15T16:18:40.122 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20200918 -> 20200918 2023-05-15T16:18:40.122 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20201022 -> 20201022 2023-05-15T16:18:40.122 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20201118 -> 20201118 2023-05-15T16:18:40.123 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20201218 -> 20201218 2023-05-15T16:18:40.123 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20210208 -> 20210208 2023-05-15T16:18:40.123 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20210315 -> 20210315 2023-05-15T16:18:40.123 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20210511 -> 20210511 2023-05-15T16:18:40.123 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20210716 -> 20210716 2023-05-15T16:18:40.123 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20210818 -> 20210818 2023-05-15T16:18:40.123 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20210919 -> 20210919 2023-05-15T16:18:40.124 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20211027 -> 20211027 2023-05-15T16:18:40.124 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20211216 -> 20211216 2023-05-15T16:18:40.124 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20220209 -> 20220209 2023-05-15T16:18:40.124 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20220310 -> 20220310 2023-05-15T16:18:40.124 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20220411 -> 20220411 2023-05-15T16:18:40.124 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20220509 -> 20220509 2023-05-15T16:18:40.124 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20220610 -> 20220610 2023-05-15T16:18:40.125 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20220708 -> 20220708 2023-05-15T16:18:40.125 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20220815 -> 20220815 2023-05-15T16:18:40.125 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20220913 -> 20220913 2023-05-15T16:18:40.125 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20221012 -> 20221012 2023-05-15T16:18:40.125 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20221109 -> 20221109 2023-05-15T16:18:40.125 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20221214 -> 20221214 2023-05-15T16:18:40.125 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20230117 -> 20230117 2023-05-15T16:18:40.126 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20230210 -> 20230210 2023-05-15T16:18:40.126 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20230310 -> 20230310 2023-05-15T16:18:40.126 INFO:teuthology.orchestra.run.smithi171.stderr: * [new tag] 20230404 -> 20230404 2023-05-15T16:18:43.353 INFO:teuthology.orchestra.run.smithi171.stderr:Updating files: 48% (1411/2897) Updating files: 49% (1420/2897) Updating files: 50% (1449/2897) Updating files: 51% (1478/2897) Updating files: 52% (1507/2897) Updating files: 53% (1536/2897) Updating files: 54% (1565/2897) Updating files: 55% (1594/2897) Updating files: 56% (1623/2897) Updating files: 57% (1652/2897) Updating files: 58% (1681/2897) Updating files: 59% (1710/2897) Updating files: 60% (1739/2897) Updating files: 61% (1768/2897) Updating files: 62% (1797/2897) Updating files: 63% (1826/2897) Updating files: 64% (1855/2897) Updating files: 64% (1880/2897) Updating files: 65% (1884/2897) Updating files: 66% (1913/2897) Updating files: 67% (1941/2897) Updating files: 68% (1970/2897) Updating files: 69% (1999/2897) Updating files: 70% (2028/2897) Updating files: 71% (2057/2897) Updating files: 72% (2086/2897) Updating files: 73% (2115/2897) Updating files: 74% (2144/2897) Updating files: 75% (2173/2897) Updating files: 76% (2202/2897) Updating files: 77% (2231/2897) Updating files: 78% (2260/2897) Updating files: 79% (2289/2897) Updating files: 80% (2318/2897) Updating files: 81% (2347/2897) Updating files: 82% (2376/2897) Updating files: 82% (2377/2897) Updating files: 83% (2405/2897) Updating files: 84% (2434/2897) Updating files: 85% (2463/2897) Updating files: 86% (2492/2897) Updating files: 87% (2521/2897) Updating files: 88% (2550/2897) Updating files: 89% (2579/2897) Updating files: 90% (2608/2897) Updating files: 91% (2637/2897) Updating files: 92% (2666/2897) Updating files: 93% (2695/2897) Updating files: 94% (2724/2897) Updating files: 95% (2753/2897) Updating files: 96% (2782/2897) Updating files: 97% (2811/2897) Updating files: 98% (2840/2897) Updating files: 99% (2869/2897) Updating files: 100% (2897/2897) Updating files: 100% (2897/2897), done. 2023-05-15T16:18:43.358 INFO:teuthology.orchestra.run.smithi171.stdout:HEAD is now at 905d3265 linux-firmware: update firmware for mediatek bluetooth chip (MT7922) 2023-05-15T16:18:43.376 INFO:teuthology.task.kernel:Downloading kernel 7312ab6f53ec3dd1c2d90b6652327feae750728b on client.0... 2023-05-15T16:18:43.376 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7312ab6f53ec3dd1c2d90b6652327feae750728b 2023-05-15T16:18:43.532 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/7312ab6f53ec3dd1c2d90b6652327feae750728b/ubuntu/jammy/flavors/default/pool/main/l/linux-6.3.0-g7312ab6f53ec/ 2023-05-15T16:18:43.533 DEBUG:teuthology.orchestra.run.smithi171:> rm -f /tmp/linux-image.deb && echo linux-image-6.3.0-g7312ab6f53ec_6.3.0-g7312ab6f53ec-1_amd64.deb | wget -nv -O /tmp/linux-image.deb --base=https://3.chacra.ceph.com/r/kernel/testing/7312ab6f53ec3dd1c2d90b6652327feae750728b/ubuntu/jammy/flavors/default/pool/main/l/linux-6.3.0-g7312ab6f53ec/ --input-file=- 2023-05-15T16:18:43.535 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi171.front.sepia.ceph.com to complete... 2023-05-15T16:18:45.031 INFO:teuthology.orchestra.run.smithi171.stderr:2023-05-15 16:18:44 URL:https://3.chacra.ceph.com/r/kernel/testing/7312ab6f53ec3dd1c2d90b6652327feae750728b/ubuntu/jammy/flavors/default/pool/main/l/linux-6.3.0-g7312ab6f53ec/linux-image-6.3.0-g7312ab6f53ec_6.3.0-g7312ab6f53ec-1_amd64.deb [38545358/38545358] -> "/tmp/linux-image.deb" [1] 2023-05-15T16:18:45.031 INFO:teuthology.orchestra.run.smithi171.stderr:FINISHED --2023-05-15 16:18:44-- 2023-05-15T16:18:45.032 INFO:teuthology.orchestra.run.smithi171.stderr:Total wall clock time: 1.5s 2023-05-15T16:18:45.032 INFO:teuthology.orchestra.run.smithi171.stderr:Downloaded: 1 files, 37M in 1.3s (27.4 MB/s) 2023-05-15T16:18:45.034 INFO:teuthology.task.kernel:Installing kernel 7312ab6f53ec3dd1c2d90b6652327feae750728b on client.0... 2023-05-15T16:18:45.035 DEBUG:teuthology.orchestra.run.smithi171:> sudo dpkg -i /tmp/linux-image.deb 2023-05-15T16:18:45.303 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package linux-image-6.3.0-g7312ab6f53ec. 2023-05-15T16:18:47.380 INFO:teuthology.orchestra.run.smithi171.stdout:(Reading database ... 129542 files and directories currently installed.) 2023-05-15T16:18:47.385 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack /tmp/linux-image.deb ... 2023-05-15T16:18:47.558 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-image-6.3.0-g7312ab6f53ec (6.3.0-g7312ab6f53ec-1) ... 2023-05-15T16:18:51.166 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-image-6.3.0-g7312ab6f53ec (6.3.0-g7312ab6f53ec-1) ... 2023-05-15T16:18:51.270 INFO:teuthology.orchestra.run.smithi171.stderr:update-initramfs: Generating /boot/initrd.img-6.3.0-g7312ab6f53ec 2023-05-15T16:19:09.964 INFO:teuthology.orchestra.run.smithi171.stderr:Sourcing file `/etc/default/grub' 2023-05-15T16:19:09.979 INFO:teuthology.orchestra.run.smithi171.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-15T16:19:10.008 INFO:teuthology.orchestra.run.smithi171.stderr:Generating grub configuration file ... 2023-05-15T16:19:10.295 INFO:teuthology.orchestra.run.smithi171.stderr:Found linux image: /boot/vmlinuz-6.3.0-g7312ab6f53ec 2023-05-15T16:19:10.314 INFO:teuthology.orchestra.run.smithi171.stderr:Found initrd image: /boot/initrd.img-6.3.0-g7312ab6f53ec 2023-05-15T16:19:10.641 INFO:teuthology.orchestra.run.smithi171.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-05-15T16:19:10.654 INFO:teuthology.orchestra.run.smithi171.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-05-15T16:19:10.724 INFO:teuthology.orchestra.run.smithi171.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-05-15T16:19:10.729 INFO:teuthology.orchestra.run.smithi171.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-05-15T16:19:10.889 INFO:teuthology.orchestra.run.smithi171.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-05-15T16:19:10.889 INFO:teuthology.orchestra.run.smithi171.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-05-15T16:19:10.889 INFO:teuthology.orchestra.run.smithi171.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-05-15T16:19:10.923 INFO:teuthology.orchestra.run.smithi171.stderr:done 2023-05-15T16:19:11.096 DEBUG:teuthology.orchestra.run.smithi171:> dpkg-deb -c /tmp/linux-image.deb 2023-05-15T16:19:11.104 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./ 2023-05-15T16:19:11.104 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./boot/ 2023-05-15T16:19:11.105 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 4289818 2023-05-15 02:23 ./boot/System.map-6.3.0-g7312ab6f53ec 2023-05-15T16:19:11.113 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 166933 2023-05-15 02:23 ./boot/config-6.3.0-g7312ab6f53ec 2023-05-15T16:19:11.114 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11175904 2023-05-15 02:23 ./boot/vmlinuz-6.3.0-g7312ab6f53ec 2023-05-15T16:19:11.131 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./etc/ 2023-05-15T16:19:11.131 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./etc/kernel/ 2023-05-15T16:19:11.132 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./etc/kernel/postinst.d/ 2023-05-15T16:19:11.132 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./etc/kernel/postrm.d/ 2023-05-15T16:19:11.132 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./etc/kernel/preinst.d/ 2023-05-15T16:19:11.132 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./etc/kernel/prerm.d/ 2023-05-15T16:19:11.132 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/ 2023-05-15T16:19:11.132 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/ 2023-05-15T16:19:11.132 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/ 2023-05-15T16:19:11.133 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/ 2023-05-15T16:19:11.133 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/ 2023-05-15T16:19:11.133 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/ 2023-05-15T16:19:11.133 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/ 2023-05-15T16:19:11.133 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 527241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/aesni-intel.ko 2023-05-15T16:19:11.135 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-05-15T16:19:11.135 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-05-15T16:19:11.136 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-05-15T16:19:11.136 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 88441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-05-15T16:19:11.136 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 100081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-05-15T16:19:11.136 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 142185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-05-15T16:19:11.136 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-05-15T16:19:11.136 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-05-15T16:19:11.136 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 78905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-05-15T16:19:11.137 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-05-15T16:19:11.137 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-05-15T16:19:11.137 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/serpent-avx2.ko 2023-05-15T16:19:11.137 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-05-15T16:19:11.137 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-05-15T16:19:11.137 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-05-15T16:19:11.137 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 58273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-05-15T16:19:11.137 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-05-15T16:19:11.138 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-05-15T16:19:11.138 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-05-15T16:19:11.138 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kernel/ 2023-05-15T16:19:11.138 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kernel/cpu/ 2023-05-15T16:19:11.138 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kernel/cpu/mce/ 2023-05-15T16:19:11.138 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-05-15T16:19:11.138 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kernel/cpuid.ko 2023-05-15T16:19:11.139 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kernel/msr.ko 2023-05-15T16:19:11.139 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kvm/ 2023-05-15T16:19:11.139 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 342897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kvm/kvm-amd.ko 2023-05-15T16:19:11.139 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 971009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kvm/kvm-intel.ko 2023-05-15T16:19:11.139 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 2208345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/arch/x86/kvm/kvm.ko 2023-05-15T16:19:11.147 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/ 2023-05-15T16:19:11.148 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 55889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/af_alg.ko 2023-05-15T16:19:11.148 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/algif_hash.ko 2023-05-15T16:19:11.148 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/algif_skcipher.ko 2023-05-15T16:19:11.148 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/ansi_cprng.ko 2023-05-15T16:19:11.148 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/anubis.ko 2023-05-15T16:19:11.148 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/arc4.ko 2023-05-15T16:19:11.148 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/asymmetric_keys/ 2023-05-15T16:19:11.149 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/asymmetric_keys/pkcs7_test_key.ko 2023-05-15T16:19:11.149 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/async_tx/ 2023-05-15T16:19:11.149 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/async_tx/async_memcpy.ko 2023-05-15T16:19:11.149 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/async_tx/async_pq.ko 2023-05-15T16:19:11.149 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/async_tx/async_raid6_recov.ko 2023-05-15T16:19:11.149 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/async_tx/async_tx.ko 2023-05-15T16:19:11.149 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/async_tx/async_xor.ko 2023-05-15T16:19:11.150 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/async_tx/raid6test.ko 2023-05-15T16:19:11.150 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/authenc.ko 2023-05-15T16:19:11.150 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/authencesn.ko 2023-05-15T16:19:11.150 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/blake2b_generic.ko 2023-05-15T16:19:11.150 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/blowfish_common.ko 2023-05-15T16:19:11.150 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/blowfish_generic.ko 2023-05-15T16:19:11.150 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/camellia_generic.ko 2023-05-15T16:19:11.150 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/cast5_generic.ko 2023-05-15T16:19:11.151 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/cast6_generic.ko 2023-05-15T16:19:11.151 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/cast_common.ko 2023-05-15T16:19:11.151 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/ccm.ko 2023-05-15T16:19:11.151 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/cmac.ko 2023-05-15T16:19:11.151 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/crc32_generic.ko 2023-05-15T16:19:11.151 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 44633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/cryptd.ko 2023-05-15T16:19:11.151 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/crypto_engine.ko 2023-05-15T16:19:11.151 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/crypto_simd.ko 2023-05-15T16:19:11.152 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/crypto_user.ko 2023-05-15T16:19:11.152 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/cts.ko 2023-05-15T16:19:11.152 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/des_generic.ko 2023-05-15T16:19:11.152 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/dh_generic.ko 2023-05-15T16:19:11.152 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/echainiv.ko 2023-05-15T16:19:11.152 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/essiv.ko 2023-05-15T16:19:11.152 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/fcrypt.ko 2023-05-15T16:19:11.153 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/khazad.ko 2023-05-15T16:19:11.153 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/lrw.ko 2023-05-15T16:19:11.153 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/lz4.ko 2023-05-15T16:19:11.153 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/lz4hc.ko 2023-05-15T16:19:11.153 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/md4.ko 2023-05-15T16:19:11.153 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/michael_mic.ko 2023-05-15T16:19:11.153 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/pcbc.ko 2023-05-15T16:19:11.153 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/pcrypt.ko 2023-05-15T16:19:11.154 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/rmd160.ko 2023-05-15T16:19:11.154 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/seed.ko 2023-05-15T16:19:11.154 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/serpent_generic.ko 2023-05-15T16:19:11.154 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 148761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/tcrypt.ko 2023-05-15T16:19:11.154 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/tea.ko 2023-05-15T16:19:11.154 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/twofish_common.ko 2023-05-15T16:19:11.154 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/twofish_generic.ko 2023-05-15T16:19:11.155 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/vmac.ko 2023-05-15T16:19:11.155 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/wp512.ko 2023-05-15T16:19:11.155 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/xcbc.ko 2023-05-15T16:19:11.155 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/xor.ko 2023-05-15T16:19:11.155 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/xts.ko 2023-05-15T16:19:11.155 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/crypto/xxhash_generic.ko 2023-05-15T16:19:11.155 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ 2023-05-15T16:19:11.155 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/ 2023-05-15T16:19:11.156 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/acpi_extlog.ko 2023-05-15T16:19:11.156 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/acpi_ipmi.ko 2023-05-15T16:19:11.156 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/acpi_pad.ko 2023-05-15T16:19:11.156 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/apei/ 2023-05-15T16:19:11.156 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/apei/einj.ko 2023-05-15T16:19:11.156 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/ec_sys.ko 2023-05-15T16:19:11.156 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/platform_profile.ko 2023-05-15T16:19:11.157 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/sbs.ko 2023-05-15T16:19:11.157 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/sbshc.ko 2023-05-15T16:19:11.157 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 101617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/acpi/video.ko 2023-05-15T16:19:11.157 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/ 2023-05-15T16:19:11.157 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/acard-ahci.ko 2023-05-15T16:19:11.157 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 88185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/ahci.ko 2023-05-15T16:19:11.157 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/ahci_platform.ko 2023-05-15T16:19:11.157 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 84753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/libahci.ko 2023-05-15T16:19:11.158 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/libahci_platform.ko 2023-05-15T16:19:11.158 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_acpi.ko 2023-05-15T16:19:11.158 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_ali.ko 2023-05-15T16:19:11.158 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_amd.ko 2023-05-15T16:19:11.158 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_artop.ko 2023-05-15T16:19:11.158 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_atiixp.ko 2023-05-15T16:19:11.158 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_atp867x.ko 2023-05-15T16:19:11.158 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_cmd640.ko 2023-05-15T16:19:11.159 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_cmd64x.ko 2023-05-15T16:19:11.159 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_cypress.ko 2023-05-15T16:19:11.159 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_efar.ko 2023-05-15T16:19:11.159 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_hpt366.ko 2023-05-15T16:19:11.159 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_hpt37x.ko 2023-05-15T16:19:11.159 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_hpt3x2n.ko 2023-05-15T16:19:11.159 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_hpt3x3.ko 2023-05-15T16:19:11.160 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_it8213.ko 2023-05-15T16:19:11.160 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_it821x.ko 2023-05-15T16:19:11.160 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_jmicron.ko 2023-05-15T16:19:11.160 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_legacy.ko 2023-05-15T16:19:11.160 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_marvell.ko 2023-05-15T16:19:11.160 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_mpiix.ko 2023-05-15T16:19:11.160 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_netcell.ko 2023-05-15T16:19:11.160 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_ninja32.ko 2023-05-15T16:19:11.161 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_ns87410.ko 2023-05-15T16:19:11.161 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_ns87415.ko 2023-05-15T16:19:11.161 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_oldpiix.ko 2023-05-15T16:19:11.161 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_opti.ko 2023-05-15T16:19:11.161 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_optidma.ko 2023-05-15T16:19:11.161 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_pcmcia.ko 2023-05-15T16:19:11.161 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_pdc2027x.ko 2023-05-15T16:19:11.162 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-05-15T16:19:11.162 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_piccolo.ko 2023-05-15T16:19:11.162 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_radisys.ko 2023-05-15T16:19:11.162 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_rdc.ko 2023-05-15T16:19:11.162 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_rz1000.ko 2023-05-15T16:19:11.162 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_sch.ko 2023-05-15T16:19:11.163 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_serverworks.ko 2023-05-15T16:19:11.163 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_sil680.ko 2023-05-15T16:19:11.163 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19129 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_sl82c105.ko 2023-05-15T16:19:11.163 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_triflex.ko 2023-05-15T16:19:11.163 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pata_via.ko 2023-05-15T16:19:11.163 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/pdc_adma.ko 2023-05-15T16:19:11.163 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_inic162x.ko 2023-05-15T16:19:11.164 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 82793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_mv.ko 2023-05-15T16:19:11.164 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 70033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_nv.ko 2023-05-15T16:19:11.164 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_promise.ko 2023-05-15T16:19:11.164 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_qstor.ko 2023-05-15T16:19:11.164 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_sil.ko 2023-05-15T16:19:11.164 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_sil24.ko 2023-05-15T16:19:11.164 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_sis.ko 2023-05-15T16:19:11.164 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_svw.ko 2023-05-15T16:19:11.165 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 44225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_sx4.ko 2023-05-15T16:19:11.165 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_uli.ko 2023-05-15T16:19:11.165 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_via.ko 2023-05-15T16:19:11.165 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ata/sata_vsc.ko 2023-05-15T16:19:11.165 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/auxdisplay/ 2023-05-15T16:19:11.165 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/auxdisplay/ks0108.ko 2023-05-15T16:19:11.165 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/bcma/ 2023-05-15T16:19:11.166 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 121249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/bcma/bcma.ko 2023-05-15T16:19:11.166 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/ 2023-05-15T16:19:11.166 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/aoe/ 2023-05-15T16:19:11.166 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 113145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/aoe/aoe.ko 2023-05-15T16:19:11.166 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/drbd/ 2023-05-15T16:19:11.166 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 963089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/drbd/drbd.ko 2023-05-15T16:19:11.166 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 172809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/floppy.ko 2023-05-15T16:19:11.166 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/mtip32xx/ 2023-05-15T16:19:11.167 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 93865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-05-15T16:19:11.167 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 113657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/nbd.ko 2023-05-15T16:19:11.167 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/null_blk/ 2023-05-15T16:19:11.167 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 110513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/null_blk/null_blk.ko 2023-05-15T16:19:11.167 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 81753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/pktcdvd.ko 2023-05-15T16:19:11.167 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 253977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/rbd.ko 2023-05-15T16:19:11.167 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/xen-blkback/ 2023-05-15T16:19:11.168 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 97705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-05-15T16:19:11.204 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/zram/ 2023-05-15T16:19:11.205 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 59209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/block/zram/zram.ko 2023-05-15T16:19:11.205 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ 2023-05-15T16:19:11.205 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/applicom.ko 2023-05-15T16:19:11.205 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/hangcheck-timer.ko 2023-05-15T16:19:11.205 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/hw_random/ 2023-05-15T16:19:11.206 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/hw_random/amd-rng.ko 2023-05-15T16:19:11.206 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/hw_random/intel-rng.ko 2023-05-15T16:19:11.206 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-05-15T16:19:11.206 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/hw_random/via-rng.ko 2023-05-15T16:19:11.206 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/hw_random/virtio-rng.ko 2023-05-15T16:19:11.206 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ipmi/ 2023-05-15T16:19:11.206 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-05-15T16:19:11.207 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 147745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-05-15T16:19:11.207 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-05-15T16:19:11.207 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 138561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ipmi/ipmi_si.ko 2023-05-15T16:19:11.207 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 70353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-05-15T16:19:11.207 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 53105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-05-15T16:19:11.207 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/lp.ko 2023-05-15T16:19:11.207 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/mwave/ 2023-05-15T16:19:11.207 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 83625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/mwave/mwave.ko 2023-05-15T16:19:11.208 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/nvram.ko 2023-05-15T16:19:11.208 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/pcmcia/ 2023-05-15T16:19:11.208 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 102457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/pcmcia/cm4000_cs.ko 2023-05-15T16:19:11.208 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/pcmcia/cm4040_cs.ko 2023-05-15T16:19:11.208 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 83625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/pcmcia/synclink_cs.ko 2023-05-15T16:19:11.208 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/ppdev.ko 2023-05-15T16:19:11.208 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tlclk.ko 2023-05-15T16:19:11.209 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/ 2023-05-15T16:19:11.209 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/tpm_atmel.ko 2023-05-15T16:19:11.209 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/tpm_i2c_atmel.ko 2023-05-15T16:19:11.209 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/tpm_i2c_infineon.ko 2023-05-15T16:19:11.209 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/tpm_i2c_nuvoton.ko 2023-05-15T16:19:11.210 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/tpm_infineon.ko 2023-05-15T16:19:11.210 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/tpm_nsc.ko 2023-05-15T16:19:11.210 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/tpm/xen-tpmfront.ko 2023-05-15T16:19:11.210 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/xillybus/ 2023-05-15T16:19:11.210 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/xillybus/xillybus_class.ko 2023-05-15T16:19:11.210 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/xillybus/xillybus_core.ko 2023-05-15T16:19:11.210 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/char/xillybus/xillybus_pcie.ko 2023-05-15T16:19:11.210 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/clk/ 2023-05-15T16:19:11.211 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/clk/clk-palmas.ko 2023-05-15T16:19:11.211 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/clk/clk-si5351.ko 2023-05-15T16:19:11.211 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/clk/clk-twl6040.ko 2023-05-15T16:19:11.211 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/clk/clk-wm831x.ko 2023-05-15T16:19:11.211 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/cpufreq/ 2023-05-15T16:19:11.211 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-05-15T16:19:11.211 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/cpufreq/p4-clockmod.ko 2023-05-15T16:19:11.212 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/cpufreq/speedstep-lib.ko 2023-05-15T16:19:11.212 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/ 2023-05-15T16:19:11.212 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/ccp/ 2023-05-15T16:19:11.212 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 70289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-05-15T16:19:11.212 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 223113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/ccp/ccp.ko 2023-05-15T16:19:11.212 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/padlock-aes.ko 2023-05-15T16:19:11.212 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/padlock-sha.ko 2023-05-15T16:19:11.212 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/qat/ 2023-05-15T16:19:11.213 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/qat/qat_common/ 2023-05-15T16:19:11.213 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 397793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/qat/qat_common/intel_qat.ko 2023-05-15T16:19:11.213 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/qat/qat_dh895xcc/ 2023-05-15T16:19:11.213 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-05-15T16:19:11.213 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/virtio/ 2023-05-15T16:19:11.213 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 68121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-05-15T16:19:11.213 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/dca/ 2023-05-15T16:19:11.213 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/dca/dca.ko 2023-05-15T16:19:11.214 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/dma/ 2023-05-15T16:19:11.214 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/dma/dw/ 2023-05-15T16:19:11.214 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/dma/dw/dw_dmac.ko 2023-05-15T16:19:11.214 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/dma/ioat/ 2023-05-15T16:19:11.214 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 122841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/dma/ioat/ioatdma.ko 2023-05-15T16:19:11.214 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/ 2023-05-15T16:19:11.214 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 73761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/amd64_edac.ko 2023-05-15T16:19:11.215 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/e752x_edac.ko 2023-05-15T16:19:11.215 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 62633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/edac_mce_amd.ko 2023-05-15T16:19:11.215 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/i3000_edac.ko 2023-05-15T16:19:11.215 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/i3200_edac.ko 2023-05-15T16:19:11.215 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/i5100_edac.ko 2023-05-15T16:19:11.215 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/i5400_edac.ko 2023-05-15T16:19:11.215 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/i7300_edac.ko 2023-05-15T16:19:11.216 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/i7core_edac.ko 2023-05-15T16:19:11.216 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/i82975x_edac.ko 2023-05-15T16:19:11.216 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/ie31200_edac.ko 2023-05-15T16:19:11.216 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 56369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/sb_edac.ko 2023-05-15T16:19:11.216 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/edac/x38_edac.ko 2023-05-15T16:19:11.216 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/ 2023-05-15T16:19:11.216 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/extcon-gpio.ko 2023-05-15T16:19:11.216 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/extcon-max14577.ko 2023-05-15T16:19:11.217 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/extcon-max77693.ko 2023-05-15T16:19:11.217 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/extcon-max8997.ko 2023-05-15T16:19:11.217 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/extcon-palmas.ko 2023-05-15T16:19:11.217 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/extcon-rt8973a.ko 2023-05-15T16:19:11.217 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/extcon/extcon-sm5502.ko 2023-05-15T16:19:11.217 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/firmware/ 2023-05-15T16:19:11.217 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/firmware/dmi-sysfs.ko 2023-05-15T16:19:11.217 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/firmware/efi/ 2023-05-15T16:19:11.218 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/firmware/efi/efi-pstore.ko 2023-05-15T16:19:11.218 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/firmware/iscsi_ibft.ko 2023-05-15T16:19:11.218 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/ 2023-05-15T16:19:11.218 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-adp5520.ko 2023-05-15T16:19:11.218 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-amd8111.ko 2023-05-15T16:19:11.218 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-arizona.ko 2023-05-15T16:19:11.218 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-da9052.ko 2023-05-15T16:19:11.219 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-da9055.ko 2023-05-15T16:19:11.219 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-dln2.ko 2023-05-15T16:19:11.219 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 77929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-f7188x.ko 2023-05-15T16:19:11.219 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-generic.ko 2023-05-15T16:19:11.219 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-ich.ko 2023-05-15T16:19:11.219 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-janz-ttl.ko 2023-05-15T16:19:11.219 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-kempld.ko 2023-05-15T16:19:11.219 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-lp3943.ko 2023-05-15T16:19:11.220 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-max7300.ko 2023-05-15T16:19:11.220 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-max730x.ko 2023-05-15T16:19:11.220 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-max732x.ko 2023-05-15T16:19:11.220 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-ml-ioh.ko 2023-05-15T16:19:11.220 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-pca953x.ko 2023-05-15T16:19:11.220 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-pcf857x.ko 2023-05-15T16:19:11.220 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-rdc321x.ko 2023-05-15T16:19:11.221 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-sch.ko 2023-05-15T16:19:11.221 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-sch311x.ko 2023-05-15T16:19:11.221 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-tps65912.ko 2023-05-15T16:19:11.221 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-twl4030.ko 2023-05-15T16:19:11.221 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-twl6040.ko 2023-05-15T16:19:11.221 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-viperboard.ko 2023-05-15T16:19:11.221 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-vx855.ko 2023-05-15T16:19:11.221 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-wm831x.ko 2023-05-15T16:19:11.222 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-wm8350.ko 2023-05-15T16:19:11.222 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/gpio/gpio-wm8994.ko 2023-05-15T16:19:11.222 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/ 2023-05-15T16:19:11.222 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-a4tech.ko 2023-05-15T16:19:11.222 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-apple.ko 2023-05-15T16:19:11.222 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-appleir.ko 2023-05-15T16:19:11.222 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-aureal.ko 2023-05-15T16:19:11.222 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-axff.ko 2023-05-15T16:19:11.223 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-belkin.ko 2023-05-15T16:19:11.223 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-cherry.ko 2023-05-15T16:19:11.223 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-chicony.ko 2023-05-15T16:19:11.223 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 58641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-cp2112.ko 2023-05-15T16:19:11.223 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-cypress.ko 2023-05-15T16:19:11.223 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-dr.ko 2023-05-15T16:19:11.223 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-elecom.ko 2023-05-15T16:19:11.223 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-elo.ko 2023-05-15T16:19:11.224 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-emsff.ko 2023-05-15T16:19:11.224 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-ezkey.ko 2023-05-15T16:19:11.224 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-gaff.ko 2023-05-15T16:19:11.224 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-generic.ko 2023-05-15T16:19:11.224 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-gt683r.ko 2023-05-15T16:19:11.224 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-gyration.ko 2023-05-15T16:19:11.224 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-holtek-kbd.ko 2023-05-15T16:19:11.225 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-holtek-mouse.ko 2023-05-15T16:19:11.225 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-holtekff.ko 2023-05-15T16:19:11.225 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-hyperv.ko 2023-05-15T16:19:11.225 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-icade.ko 2023-05-15T16:19:11.225 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-kensington.ko 2023-05-15T16:19:11.225 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-keytouch.ko 2023-05-15T16:19:11.225 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-kye.ko 2023-05-15T16:19:11.225 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-lcpower.ko 2023-05-15T16:19:11.226 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-led.ko 2023-05-15T16:19:11.226 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-lenovo.ko 2023-05-15T16:19:11.226 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-lg-g15.ko 2023-05-15T16:19:11.226 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 57369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-logitech-dj.ko 2023-05-15T16:19:11.226 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 94481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-05-15T16:19:11.226 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 80569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-logitech.ko 2023-05-15T16:19:11.226 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-magicmouse.ko 2023-05-15T16:19:11.227 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-microsoft.ko 2023-05-15T16:19:11.227 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-monterey.ko 2023-05-15T16:19:11.227 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-multitouch.ko 2023-05-15T16:19:11.227 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-ntrig.ko 2023-05-15T16:19:11.227 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-ortek.ko 2023-05-15T16:19:11.227 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-penmount.ko 2023-05-15T16:19:11.227 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-petalynx.ko 2023-05-15T16:19:11.227 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 72497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-picolcd.ko 2023-05-15T16:19:11.228 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-pl.ko 2023-05-15T16:19:11.228 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-plantronics.ko 2023-05-15T16:19:11.228 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-primax.ko 2023-05-15T16:19:11.228 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-rmi.ko 2023-05-15T16:19:11.228 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-arvo.ko 2023-05-15T16:19:11.228 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-common.ko 2023-05-15T16:19:11.228 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-isku.ko 2023-05-15T16:19:11.228 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-kone.ko 2023-05-15T16:19:11.229 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-05-15T16:19:11.229 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-konepure.ko 2023-05-15T16:19:11.229 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-05-15T16:19:11.229 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-lua.ko 2023-05-15T16:19:11.229 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-pyra.ko 2023-05-15T16:19:11.229 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-ryos.ko 2023-05-15T16:19:11.229 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat-savu.ko 2023-05-15T16:19:11.230 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-roccat.ko 2023-05-15T16:19:11.230 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-saitek.ko 2023-05-15T16:19:11.230 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-samsung.ko 2023-05-15T16:19:11.230 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-sensor-hub.ko 2023-05-15T16:19:11.230 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-sjoy.ko 2023-05-15T16:19:11.230 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-sony.ko 2023-05-15T16:19:11.230 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-speedlink.ko 2023-05-15T16:19:11.230 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-steelseries.ko 2023-05-15T16:19:11.231 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-sunplus.ko 2023-05-15T16:19:11.231 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-thrustmaster.ko 2023-05-15T16:19:11.231 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-tivo.ko 2023-05-15T16:19:11.231 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-tmff.ko 2023-05-15T16:19:11.231 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-topseed.ko 2023-05-15T16:19:11.231 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-twinhan.ko 2023-05-15T16:19:11.231 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 71017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-uclogic.ko 2023-05-15T16:19:11.231 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-waltop.ko 2023-05-15T16:19:11.232 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 143097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-wiimote.ko 2023-05-15T16:19:11.232 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-xinmo.ko 2023-05-15T16:19:11.232 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-zpff.ko 2023-05-15T16:19:11.232 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid-zydacron.ko 2023-05-15T16:19:11.232 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 260737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/hid.ko 2023-05-15T16:19:11.232 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/uhid.ko 2023-05-15T16:19:11.232 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/usbhid/ 2023-05-15T16:19:11.232 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 124897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/usbhid/usbhid.ko 2023-05-15T16:19:11.233 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/usbhid/usbkbd.ko 2023-05-15T16:19:11.233 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/usbhid/usbmouse.ko 2023-05-15T16:19:11.233 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 215033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hid/wacom.ko 2023-05-15T16:19:11.233 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hv/ 2023-05-15T16:19:11.233 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 62833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hv/hv_balloon.ko 2023-05-15T16:19:11.233 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 89177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hv/hv_utils.ko 2023-05-15T16:19:11.233 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 296369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hv/hv_vmbus.ko 2023-05-15T16:19:11.234 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ 2023-05-15T16:19:11.234 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 66169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/abituguru.ko 2023-05-15T16:19:11.234 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 60969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/abituguru3.ko 2023-05-15T16:19:11.234 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/acpi_power_meter.ko 2023-05-15T16:19:11.234 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ad7414.ko 2023-05-15T16:19:11.234 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ad7418.ko 2023-05-15T16:19:11.234 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adc128d818.ko 2023-05-15T16:19:11.234 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adm1025.ko 2023-05-15T16:19:11.235 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 97537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adm1026.ko 2023-05-15T16:19:11.235 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adm1029.ko 2023-05-15T16:19:11.235 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 45057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adm1031.ko 2023-05-15T16:19:11.235 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adm9240.ko 2023-05-15T16:19:11.235 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ads7828.ko 2023-05-15T16:19:11.235 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adt7410.ko 2023-05-15T16:19:11.235 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adt7411.ko 2023-05-15T16:19:11.235 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 74009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adt7462.ko 2023-05-15T16:19:11.236 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adt7470.ko 2023-05-15T16:19:11.236 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 64393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adt7475.ko 2023-05-15T16:19:11.236 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/adt7x10.ko 2023-05-15T16:19:11.236 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/amc6821.ko 2023-05-15T16:19:11.236 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/applesmc.ko 2023-05-15T16:19:11.236 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/asb100.ko 2023-05-15T16:19:11.236 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 58113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/asc7621.ko 2023-05-15T16:19:11.237 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/asus_atk0110.ko 2023-05-15T16:19:11.237 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/atxp1.ko 2023-05-15T16:19:11.237 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/coretemp.ko 2023-05-15T16:19:11.237 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/da9052-hwmon.ko 2023-05-15T16:19:11.237 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/da9055-hwmon.ko 2023-05-15T16:19:11.237 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 43977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-05-15T16:19:11.237 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 99161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/dme1737.ko 2023-05-15T16:19:11.237 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ds1621.ko 2023-05-15T16:19:11.238 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ds620.ko 2023-05-15T16:19:11.238 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/emc1403.ko 2023-05-15T16:19:11.238 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/emc2103.ko 2023-05-15T16:19:11.238 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/emc6w201.ko 2023-05-15T16:19:11.238 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 66481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/f71805f.ko 2023-05-15T16:19:11.238 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 94153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/f71882fg.ko 2023-05-15T16:19:11.238 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/f75375s.ko 2023-05-15T16:19:11.238 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/fam15h_power.ko 2023-05-15T16:19:11.239 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/fschmd.ko 2023-05-15T16:19:11.239 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/g760a.ko 2023-05-15T16:19:11.239 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/g762.ko 2023-05-15T16:19:11.239 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/gl518sm.ko 2023-05-15T16:19:11.239 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 45025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/gl520sm.ko 2023-05-15T16:19:11.239 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/hih6130.ko 2023-05-15T16:19:11.239 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/hwmon-vid.ko 2023-05-15T16:19:11.239 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/i5500_temp.ko 2023-05-15T16:19:11.240 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/i5k_amb.ko 2023-05-15T16:19:11.240 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ibmaem.ko 2023-05-15T16:19:11.240 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ibmpex.ko 2023-05-15T16:19:11.240 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ina209.ko 2023-05-15T16:19:11.240 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ina2xx.ko 2023-05-15T16:19:11.240 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 125729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/it87.ko 2023-05-15T16:19:11.240 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/jc42.ko 2023-05-15T16:19:11.241 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/k10temp.ko 2023-05-15T16:19:11.241 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/k8temp.ko 2023-05-15T16:19:11.241 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lineage-pem.ko 2023-05-15T16:19:11.241 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 48097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm63.ko 2023-05-15T16:19:11.241 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm73.ko 2023-05-15T16:19:11.241 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm75.ko 2023-05-15T16:19:11.241 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm77.ko 2023-05-15T16:19:11.241 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm78.ko 2023-05-15T16:19:11.242 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm80.ko 2023-05-15T16:19:11.242 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm83.ko 2023-05-15T16:19:11.242 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 72337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm85.ko 2023-05-15T16:19:11.242 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 45633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm87.ko 2023-05-15T16:19:11.242 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm90.ko 2023-05-15T16:19:11.242 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm92.ko 2023-05-15T16:19:11.242 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 108401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm93.ko 2023-05-15T16:19:11.242 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm95234.ko 2023-05-15T16:19:11.243 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm95241.ko 2023-05-15T16:19:11.243 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/lm95245.ko 2023-05-15T16:19:11.243 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ltc2945.ko 2023-05-15T16:19:11.243 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ltc4151.ko 2023-05-15T16:19:11.243 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ltc4215.ko 2023-05-15T16:19:11.243 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ltc4222.ko 2023-05-15T16:19:11.243 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ltc4245.ko 2023-05-15T16:19:11.244 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ltc4260.ko 2023-05-15T16:19:11.244 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/ltc4261.ko 2023-05-15T16:19:11.244 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/max16065.ko 2023-05-15T16:19:11.244 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/max1619.ko 2023-05-15T16:19:11.244 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/max1668.ko 2023-05-15T16:19:11.244 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/max197.ko 2023-05-15T16:19:11.244 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/max6639.ko 2023-05-15T16:19:11.244 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/max6650.ko 2023-05-15T16:19:11.245 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/max6697.ko 2023-05-15T16:19:11.245 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/mc13783-adc.ko 2023-05-15T16:19:11.245 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/mcp3021.ko 2023-05-15T16:19:11.245 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/menf21bmc_hwmon.ko 2023-05-15T16:19:11.245 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 43657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/nct6683.ko 2023-05-15T16:19:11.245 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 114257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/nct6775-core.ko 2023-05-15T16:19:11.245 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 45817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/nct6775.ko 2023-05-15T16:19:11.245 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 59233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/nct7802.ko 2023-05-15T16:19:11.246 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 81849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pc87360.ko 2023-05-15T16:19:11.246 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pc87427.ko 2023-05-15T16:19:11.246 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pcf8591.ko 2023-05-15T16:19:11.246 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/ 2023-05-15T16:19:11.246 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-05-15T16:19:11.246 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-05-15T16:19:11.246 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-05-15T16:19:11.246 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/max16064.ko 2023-05-15T16:19:11.247 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/max34440.ko 2023-05-15T16:19:11.247 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/max8688.ko 2023-05-15T16:19:11.247 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-05-15T16:19:11.247 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 71425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-05-15T16:19:11.247 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-05-15T16:19:11.247 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-05-15T16:19:11.247 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-05-15T16:19:11.248 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-05-15T16:19:11.248 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/powr1220.ko 2023-05-15T16:19:11.248 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/sch5627.ko 2023-05-15T16:19:11.248 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/sch5636.ko 2023-05-15T16:19:11.248 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/sch56xx-common.ko 2023-05-15T16:19:11.248 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/sht15.ko 2023-05-15T16:19:11.248 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/sht21.ko 2023-05-15T16:19:11.248 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/shtc1.ko 2023-05-15T16:19:11.249 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/sis5595.ko 2023-05-15T16:19:11.249 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/smm665.ko 2023-05-15T16:19:11.249 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/smsc47b397.ko 2023-05-15T16:19:11.249 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/smsc47m1.ko 2023-05-15T16:19:11.249 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/smsc47m192.ko 2023-05-15T16:19:11.249 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/thmc50.ko 2023-05-15T16:19:11.249 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/tmp102.ko 2023-05-15T16:19:11.249 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/tmp103.ko 2023-05-15T16:19:11.250 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/tmp401.ko 2023-05-15T16:19:11.250 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/tmp421.ko 2023-05-15T16:19:11.250 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/via-cputemp.ko 2023-05-15T16:19:11.250 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/via686a.ko 2023-05-15T16:19:11.250 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/vt1211.ko 2023-05-15T16:19:11.250 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/vt8231.ko 2023-05-15T16:19:11.250 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 57025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83627ehf.ko 2023-05-15T16:19:11.250 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 78441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83627hf.ko 2023-05-15T16:19:11.251 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 70849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83781d.ko 2023-05-15T16:19:11.251 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 62793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83791d.ko 2023-05-15T16:19:11.251 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 70825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83792d.ko 2023-05-15T16:19:11.251 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 100953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83793.ko 2023-05-15T16:19:11.251 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 119009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83795.ko 2023-05-15T16:19:11.251 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83l785ts.ko 2023-05-15T16:19:11.251 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/w83l786ng.ko 2023-05-15T16:19:11.252 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/wm831x-hwmon.ko 2023-05-15T16:19:11.252 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/hwmon/wm8350-hwmon.ko 2023-05-15T16:19:11.252 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/ 2023-05-15T16:19:11.252 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/algos/ 2023-05-15T16:19:11.252 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-05-15T16:19:11.252 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-05-15T16:19:11.252 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/ 2023-05-15T16:19:11.252 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-ali1535.ko 2023-05-15T16:19:11.253 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-ali1563.ko 2023-05-15T16:19:11.253 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-ali15x3.ko 2023-05-15T16:19:11.253 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-05-15T16:19:11.253 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-05-15T16:19:11.253 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-05-15T16:19:11.253 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-cbus-gpio.ko 2023-05-15T16:19:11.253 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-05-15T16:19:11.253 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-cros-ec-tunnel.ko 2023-05-15T16:19:11.254 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-05-15T16:19:11.254 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-05-15T16:19:11.254 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-05-15T16:19:11.254 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-05-15T16:19:11.254 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-dln2.ko 2023-05-15T16:19:11.254 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-gpio.ko 2023-05-15T16:19:11.254 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 62017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-i801.ko 2023-05-15T16:19:11.255 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-isch.ko 2023-05-15T16:19:11.255 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-05-15T16:19:11.255 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-kempld.ko 2023-05-15T16:19:11.255 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-05-15T16:19:11.255 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-05-15T16:19:11.255 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-ocores.ko 2023-05-15T16:19:11.255 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-parport.ko 2023-05-15T16:19:11.255 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-05-15T16:19:11.256 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-05-15T16:19:11.256 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-robotfuzz-osif.ko 2023-05-15T16:19:11.256 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-05-15T16:19:11.256 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-05-15T16:19:11.256 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-sis5595.ko 2023-05-15T16:19:11.256 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-sis630.ko 2023-05-15T16:19:11.256 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-05-15T16:19:11.256 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-taos-evm.ko 2023-05-15T16:19:11.257 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-05-15T16:19:11.257 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-via.ko 2023-05-15T16:19:11.257 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-05-15T16:19:11.257 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-05-15T16:19:11.257 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 48361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/busses/i2c-xiic.ko 2023-05-15T16:19:11.257 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/i2c-mux.ko 2023-05-15T16:19:11.257 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/i2c-smbus.ko 2023-05-15T16:19:11.258 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/i2c-stub.ko 2023-05-15T16:19:11.258 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/muxes/ 2023-05-15T16:19:11.258 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/muxes/i2c-mux-gpio.ko 2023-05-15T16:19:11.258 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/muxes/i2c-mux-pca9541.ko 2023-05-15T16:19:11.258 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/i2c/muxes/i2c-mux-pca954x.ko 2023-05-15T16:19:11.258 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ 2023-05-15T16:19:11.258 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/ 2023-05-15T16:19:11.258 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 264089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/ib_cm.ko 2023-05-15T16:19:11.259 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 848969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/ib_core.ko 2023-05-15T16:19:11.259 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 68233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/ib_umad.ko 2023-05-15T16:19:11.259 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 321625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-05-15T16:19:11.259 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 96473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/iw_cm.ko 2023-05-15T16:19:11.259 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 271713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/rdma_cm.ko 2023-05-15T16:19:11.259 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 65753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-05-15T16:19:11.259 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/ 2023-05-15T16:19:11.259 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/cxgb4/ 2023-05-15T16:19:11.260 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 492057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-05-15T16:19:11.260 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/mlx4/ 2023-05-15T16:19:11.260 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 418801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-05-15T16:19:11.260 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/mlx5/ 2023-05-15T16:19:11.260 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 732713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-05-15T16:19:11.260 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/mthca/ 2023-05-15T16:19:11.260 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 296153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-05-15T16:19:11.261 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/ocrdma/ 2023-05-15T16:19:11.261 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 153177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/ocrdma/ocrdma.ko 2023-05-15T16:19:11.261 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/usnic/ 2023-05-15T16:19:11.261 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 168513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/hw/usnic/usnic_verbs.ko 2023-05-15T16:19:11.261 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/ 2023-05-15T16:19:11.261 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/ipoib/ 2023-05-15T16:19:11.261 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 262729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-05-15T16:19:11.261 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/iser/ 2023-05-15T16:19:11.262 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 99721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-05-15T16:19:11.262 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/isert/ 2023-05-15T16:19:11.262 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 110705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-05-15T16:19:11.262 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/srp/ 2023-05-15T16:19:11.262 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 128705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-05-15T16:19:11.262 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/srpt/ 2023-05-15T16:19:11.262 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 130009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-05-15T16:19:11.262 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/ 2023-05-15T16:19:11.263 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/evbug.ko 2023-05-15T16:19:11.263 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/ff-memless.ko 2023-05-15T16:19:11.263 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/gameport/ 2023-05-15T16:19:11.263 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-05-15T16:19:11.263 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/gameport/fm801-gp.ko 2023-05-15T16:19:11.263 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/gameport/gameport.ko 2023-05-15T16:19:11.263 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/gameport/lightning.ko 2023-05-15T16:19:11.264 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/gameport/ns558.ko 2023-05-15T16:19:11.264 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/joydev.ko 2023-05-15T16:19:11.264 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/ 2023-05-15T16:19:11.264 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/adp5520-keys.ko 2023-05-15T16:19:11.264 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/adp5588-keys.ko 2023-05-15T16:19:11.264 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/adp5589-keys.ko 2023-05-15T16:19:11.264 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/cros_ec_keyb.ko 2023-05-15T16:19:11.264 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/gpio_keys.ko 2023-05-15T16:19:11.265 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/gpio_keys_polled.ko 2023-05-15T16:19:11.265 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/lkkbd.ko 2023-05-15T16:19:11.265 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/lm8323.ko 2023-05-15T16:19:11.265 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/lm8333.ko 2023-05-15T16:19:11.265 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/matrix_keypad.ko 2023-05-15T16:19:11.265 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/max7359_keypad.ko 2023-05-15T16:19:11.265 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/mcs_touchkey.ko 2023-05-15T16:19:11.265 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/mpr121_touchkey.ko 2023-05-15T16:19:11.266 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/newtonkbd.ko 2023-05-15T16:19:11.266 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/opencores-kbd.ko 2023-05-15T16:19:11.266 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/qt1070.ko 2023-05-15T16:19:11.266 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/qt2160.ko 2023-05-15T16:19:11.266 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/samsung-keypad.ko 2023-05-15T16:19:11.266 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/stowaway.ko 2023-05-15T16:19:11.266 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/sunkbd.ko 2023-05-15T16:19:11.266 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/tca6416-keypad.ko 2023-05-15T16:19:11.267 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/tca8418_keypad.ko 2023-05-15T16:19:11.267 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/twl4030_keypad.ko 2023-05-15T16:19:11.267 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/keyboard/xtkbd.ko 2023-05-15T16:19:11.267 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/matrix-keymap.ko 2023-05-15T16:19:11.267 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/ 2023-05-15T16:19:11.267 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/appletouch.ko 2023-05-15T16:19:11.267 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/bcm5974.ko 2023-05-15T16:19:11.268 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 122977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/cyapatp.ko 2023-05-15T16:19:11.268 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 88929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/elan_i2c.ko 2023-05-15T16:19:11.268 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/gpio_mouse.ko 2023-05-15T16:19:11.268 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 334073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/psmouse.ko 2023-05-15T16:19:11.268 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/sermouse.ko 2023-05-15T16:19:11.268 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-05-15T16:19:11.268 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/synaptics_usb.ko 2023-05-15T16:19:11.268 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/mouse/vsxxxaa.ko 2023-05-15T16:19:11.269 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/rmi4/ 2023-05-15T16:19:11.269 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 107777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/rmi4/rmi_core.ko 2023-05-15T16:19:11.269 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/ 2023-05-15T16:19:11.269 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/altera_ps2.ko 2023-05-15T16:19:11.269 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/arc_ps2.ko 2023-05-15T16:19:11.269 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/ct82c710.ko 2023-05-15T16:19:11.269 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-05-15T16:19:11.269 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/parkbd.ko 2023-05-15T16:19:11.270 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/pcips2.ko 2023-05-15T16:19:11.270 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/ps2mult.ko 2023-05-15T16:19:11.270 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/serio_raw.ko 2023-05-15T16:19:11.270 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/serio/serport.ko 2023-05-15T16:19:11.270 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/input/sparse-keymap.ko 2023-05-15T16:19:11.270 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/iommu/ 2023-05-15T16:19:11.270 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/iommu/amd/ 2023-05-15T16:19:11.271 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/iommu/amd/iommu_v2.ko 2023-05-15T16:19:11.271 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/ 2023-05-15T16:19:11.271 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-88pm860x.ko 2023-05-15T16:19:11.271 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-adp5520.ko 2023-05-15T16:19:11.271 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 59249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-bd2802.ko 2023-05-15T16:19:11.271 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-blinkm.ko 2023-05-15T16:19:11.271 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-da903x.ko 2023-05-15T16:19:11.271 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-da9052.ko 2023-05-15T16:19:11.272 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-gpio.ko 2023-05-15T16:19:11.272 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-lm3530.ko 2023-05-15T16:19:11.272 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-lm3533.ko 2023-05-15T16:19:11.272 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-lm355x.ko 2023-05-15T16:19:11.272 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-lm3642.ko 2023-05-15T16:19:11.272 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-lp3944.ko 2023-05-15T16:19:11.272 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-lp8788.ko 2023-05-15T16:19:11.273 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-max8997.ko 2023-05-15T16:19:11.273 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-mc13783.ko 2023-05-15T16:19:11.273 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-menf21bmc.ko 2023-05-15T16:19:11.273 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-pca9532.ko 2023-05-15T16:19:11.273 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-pca955x.ko 2023-05-15T16:19:11.273 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-pca963x.ko 2023-05-15T16:19:11.273 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-ss4200.ko 2023-05-15T16:19:11.273 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-tca6507.ko 2023-05-15T16:19:11.274 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-wm831x-status.ko 2023-05-15T16:19:11.274 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/leds-wm8350.ko 2023-05-15T16:19:11.274 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ 2023-05-15T16:19:11.274 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-05-15T16:19:11.274 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-05-15T16:19:11.274 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-05-15T16:19:11.274 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-05-15T16:19:11.275 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2023-05-15T16:19:11.275 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-05-15T16:19:11.275 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-05-15T16:19:11.275 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-05-15T16:19:11.275 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-05-15T16:19:11.275 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/ 2023-05-15T16:19:11.275 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/bcache/ 2023-05-15T16:19:11.275 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 631593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/bcache/bcache.ko 2023-05-15T16:19:11.276 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-bio-prison.ko 2023-05-15T16:19:11.276 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 79553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-bufio.ko 2023-05-15T16:19:11.276 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-cache-smq.ko 2023-05-15T16:19:11.276 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 153889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-cache.ko 2023-05-15T16:19:11.276 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 105505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-crypt.ko 2023-05-15T16:19:11.276 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-delay.ko 2023-05-15T16:19:11.276 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 53649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-era.ko 2023-05-15T16:19:11.276 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-flakey.ko 2023-05-15T16:19:11.277 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-log-userspace.ko 2023-05-15T16:19:11.277 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-log.ko 2023-05-15T16:19:11.277 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-mirror.ko 2023-05-15T16:19:11.277 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 77297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-multipath.ko 2023-05-15T16:19:11.277 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-queue-length.ko 2023-05-15T16:19:11.277 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 70585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-raid.ko 2023-05-15T16:19:11.277 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-region-hash.ko 2023-05-15T16:19:11.277 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-round-robin.ko 2023-05-15T16:19:11.278 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-service-time.ko 2023-05-15T16:19:11.278 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 108817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-snapshot.ko 2023-05-15T16:19:11.278 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-switch.ko 2023-05-15T16:19:11.278 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 181193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-thin-pool.ko 2023-05-15T16:19:11.278 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-verity.ko 2023-05-15T16:19:11.278 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/dm-zero.ko 2023-05-15T16:19:11.278 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/faulty.ko 2023-05-15T16:19:11.279 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/linear.ko 2023-05-15T16:19:11.279 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/multipath.ko 2023-05-15T16:19:11.279 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/persistent-data/ 2023-05-15T16:19:11.279 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 192417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-05-15T16:19:11.279 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/raid0.ko 2023-05-15T16:19:11.279 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 111041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/raid1.ko 2023-05-15T16:19:11.279 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 158385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/raid10.ko 2023-05-15T16:19:11.279 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 391777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/md/raid456.ko 2023-05-15T16:19:11.280 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/ 2023-05-15T16:19:11.280 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/ 2023-05-15T16:19:11.280 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 174009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/mptbase.ko 2023-05-15T16:19:11.280 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 62953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/mptctl.ko 2023-05-15T16:19:11.280 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 44209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/mptfc.ko 2023-05-15T16:19:11.280 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/mptlan.ko 2023-05-15T16:19:11.280 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 122801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/mptsas.ko 2023-05-15T16:19:11.281 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 75937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/mptscsih.ko 2023-05-15T16:19:11.281 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 52449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/message/fusion/mptspi.ko 2023-05-15T16:19:11.281 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/ 2023-05-15T16:19:11.281 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/88pm800.ko 2023-05-15T16:19:11.281 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/88pm805.ko 2023-05-15T16:19:11.281 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/88pm80x.ko 2023-05-15T16:19:11.281 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/arizona-i2c.ko 2023-05-15T16:19:11.281 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 121913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/arizona.ko 2023-05-15T16:19:11.282 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/bcm590xx.ko 2023-05-15T16:19:11.282 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/cros_ec_dev.ko 2023-05-15T16:19:11.282 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/dln2.ko 2023-05-15T16:19:11.282 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/janz-cmodio.ko 2023-05-15T16:19:11.282 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 52177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/kempld-core.ko 2023-05-15T16:19:11.282 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/lm3533-core.ko 2023-05-15T16:19:11.282 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/lm3533-ctrlbank.ko 2023-05-15T16:19:11.282 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/lp3943.ko 2023-05-15T16:19:11.283 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/lpc_ich.ko 2023-05-15T16:19:11.283 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/lpc_sch.ko 2023-05-15T16:19:11.283 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/max8907.ko 2023-05-15T16:19:11.283 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/mc13xxx-core.ko 2023-05-15T16:19:11.283 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/mc13xxx-i2c.ko 2023-05-15T16:19:11.283 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/menf21bmc.ko 2023-05-15T16:19:11.283 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/pcf50633-adc.ko 2023-05-15T16:19:11.284 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/pcf50633-gpio.ko 2023-05-15T16:19:11.284 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/pcf50633.ko 2023-05-15T16:19:11.284 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/rdc321x-southbridge.ko 2023-05-15T16:19:11.284 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/retu-mfd.ko 2023-05-15T16:19:11.284 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 76113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/si476x-core.ko 2023-05-15T16:19:11.284 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/sm501.ko 2023-05-15T16:19:11.284 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/ti_am335x_tscadc.ko 2023-05-15T16:19:11.284 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/tps65010.ko 2023-05-15T16:19:11.285 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/tps6507x.ko 2023-05-15T16:19:11.285 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/viperboard.ko 2023-05-15T16:19:11.285 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/vx855.ko 2023-05-15T16:19:11.285 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/wl1273-core.ko 2023-05-15T16:19:11.285 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 43329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/mfd/wm8994.ko 2023-05-15T16:19:11.285 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ 2023-05-15T16:19:11.285 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ad525x_dpot-i2c.ko 2023-05-15T16:19:11.285 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ad525x_dpot.ko 2023-05-15T16:19:11.286 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/altera-stapl/ 2023-05-15T16:19:11.286 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 45865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-05-15T16:19:11.286 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/apds9802als.ko 2023-05-15T16:19:11.286 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/apds990x.ko 2023-05-15T16:19:11.286 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 45153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/bh1770glc.ko 2023-05-15T16:19:11.286 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/c2port/ 2023-05-15T16:19:11.286 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/c2port/c2port-duramar2150.ko 2023-05-15T16:19:11.287 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/c2port/core.ko 2023-05-15T16:19:11.287 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/cb710/ 2023-05-15T16:19:11.287 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/cb710/cb710.ko 2023-05-15T16:19:11.287 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ds1682.ko 2023-05-15T16:19:11.287 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/dummy-irq.ko 2023-05-15T16:19:11.287 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/echo/ 2023-05-15T16:19:11.287 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/echo/echo.ko 2023-05-15T16:19:11.287 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/eeprom/ 2023-05-15T16:19:11.288 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/eeprom/at24.ko 2023-05-15T16:19:11.288 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/eeprom/eeprom.ko 2023-05-15T16:19:11.288 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-05-15T16:19:11.288 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/eeprom/max6875.ko 2023-05-15T16:19:11.288 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/enclosure.ko 2023-05-15T16:19:11.288 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/genwqe/ 2023-05-15T16:19:11.288 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 151777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/genwqe/genwqe_card.ko 2023-05-15T16:19:11.289 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/hmc6352.ko 2023-05-15T16:19:11.289 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/hpilo.ko 2023-05-15T16:19:11.289 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ibmasm/ 2023-05-15T16:19:11.289 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 72113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ibmasm/ibmasm.ko 2023-05-15T16:19:11.289 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ics932s401.ko 2023-05-15T16:19:11.289 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/isl29003.ko 2023-05-15T16:19:11.289 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/isl29020.ko 2023-05-15T16:19:11.289 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/lis3lv02d/ 2023-05-15T16:19:11.290 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-05-15T16:19:11.290 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-05-15T16:19:11.290 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/mei/ 2023-05-15T16:19:11.290 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 123577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/mei/mei-me.ko 2023-05-15T16:19:11.290 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 56017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/mei/mei-txe.ko 2023-05-15T16:19:11.290 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 304113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/mei/mei.ko 2023-05-15T16:19:11.290 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30921 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/phantom.ko 2023-05-15T16:19:11.290 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ti-st/ 2023-05-15T16:19:11.291 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 74113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/ti-st/st_drv.ko 2023-05-15T16:19:11.291 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/tifm_7xx1.ko 2023-05-15T16:19:11.291 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/tifm_core.ko 2023-05-15T16:19:11.291 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/tsl2550.ko 2023-05-15T16:19:11.291 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 48249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/vmw_balloon.ko 2023-05-15T16:19:11.291 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/vmw_vmci/ 2023-05-15T16:19:11.291 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 180377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-05-15T16:19:11.291 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ 2023-05-15T16:19:11.292 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/bonding/ 2023-05-15T16:19:11.292 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 484433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/bonding/bonding.ko 2023-05-15T16:19:11.292 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dsa/ 2023-05-15T16:19:11.292 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dsa/b53/ 2023-05-15T16:19:11.292 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 98553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dsa/b53/b53_common.ko 2023-05-15T16:19:11.292 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dsa/bcm-sf2.ko 2023-05-15T16:19:11.292 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dsa/mv88e6060.ko 2023-05-15T16:19:11.292 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dsa/mv88e6xxx/ 2023-05-15T16:19:11.293 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 447025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-05-15T16:19:11.293 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/dummy.ko 2023-05-15T16:19:11.293 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/eql.ko 2023-05-15T16:19:11.293 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/ 2023-05-15T16:19:11.293 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/3com/ 2023-05-15T16:19:11.293 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 45289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-05-15T16:19:11.293 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-05-15T16:19:11.294 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 130081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-05-15T16:19:11.294 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 68353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-05-15T16:19:11.294 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/8390/ 2023-05-15T16:19:11.294 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/8390/8390.ko 2023-05-15T16:19:11.294 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 59193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-05-15T16:19:11.294 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-05-15T16:19:11.294 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 98561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-05-15T16:19:11.294 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/adaptec/ 2023-05-15T16:19:11.295 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-05-15T16:19:11.295 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/agere/ 2023-05-15T16:19:11.295 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 68713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/agere/et131x.ko 2023-05-15T16:19:11.295 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/alteon/ 2023-05-15T16:19:11.295 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 59081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-05-15T16:19:11.295 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/altera/ 2023-05-15T16:19:11.295 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-05-15T16:19:11.295 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/amd/ 2023-05-15T16:19:11.296 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-05-15T16:19:11.296 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 48785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-05-15T16:19:11.296 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 86849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-05-15T16:19:11.296 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/ 2023-05-15T16:19:11.296 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/alx/ 2023-05-15T16:19:11.296 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 97153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-05-15T16:19:11.296 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/atl1c/ 2023-05-15T16:19:11.296 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 104297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-05-15T16:19:11.297 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/atl1e/ 2023-05-15T16:19:11.297 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 89745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-05-15T16:19:11.297 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/atlx/ 2023-05-15T16:19:11.297 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 80993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-05-15T16:19:11.297 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 69273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-05-15T16:19:11.297 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/ 2023-05-15T16:19:11.297 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 77881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-05-15T16:19:11.298 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 176761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-05-15T16:19:11.298 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/bnx2x/ 2023-05-15T16:19:11.298 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1422217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-05-15T16:19:11.298 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 127561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-05-15T16:19:11.298 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/genet/ 2023-05-15T16:19:11.298 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 130553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-05-15T16:19:11.298 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 311593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-05-15T16:19:11.298 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/brocade/ 2023-05-15T16:19:11.299 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/brocade/bna/ 2023-05-15T16:19:11.299 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 323097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-05-15T16:19:11.299 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/ 2023-05-15T16:19:11.299 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb/ 2023-05-15T16:19:11.299 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 193001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-05-15T16:19:11.299 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb3/ 2023-05-15T16:19:11.299 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 345433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-05-15T16:19:11.299 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb4/ 2023-05-15T16:19:11.300 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1038537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-05-15T16:19:11.365 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb4vf/ 2023-05-15T16:19:11.365 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 165945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-05-15T16:19:11.366 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/libcxgb/ 2023-05-15T16:19:11.366 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-05-15T16:19:11.366 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/cisco/ 2023-05-15T16:19:11.366 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/cisco/enic/ 2023-05-15T16:19:11.366 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 203169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-05-15T16:19:11.366 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/ 2023-05-15T16:19:11.366 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/tulip/ 2023-05-15T16:19:11.367 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 68953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-05-15T16:19:11.367 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 60993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-05-15T16:19:11.367 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 140721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-05-15T16:19:11.367 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-05-15T16:19:11.367 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 62361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-05-15T16:19:11.367 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-05-15T16:19:11.367 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dlink/ 2023-05-15T16:19:11.368 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 60369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-05-15T16:19:11.368 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 62393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-05-15T16:19:11.368 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 45289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/dnet.ko 2023-05-15T16:19:11.368 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/ec_bhf.ko 2023-05-15T16:19:11.368 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/emulex/ 2023-05-15T16:19:11.368 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/emulex/benet/ 2023-05-15T16:19:11.368 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 280937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-05-15T16:19:11.369 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/ethoc.ko 2023-05-15T16:19:11.369 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/fealnx.ko 2023-05-15T16:19:11.369 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/fujitsu/ 2023-05-15T16:19:11.369 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 44841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/fujitsu/fmvj18x_cs.ko 2023-05-15T16:19:11.369 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/ 2023-05-15T16:19:11.369 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 89969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/e100.ko 2023-05-15T16:19:11.369 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/e1000/ 2023-05-15T16:19:11.369 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 295217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-05-15T16:19:11.370 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/e1000e/ 2023-05-15T16:19:11.370 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 583489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-05-15T16:19:11.370 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/fm10k/ 2023-05-15T16:19:11.370 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 245881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-05-15T16:19:11.370 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/i40e/ 2023-05-15T16:19:11.370 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 918521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-05-15T16:19:11.370 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/iavf/ 2023-05-15T16:19:11.370 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 301361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-05-15T16:19:11.371 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/igb/ 2023-05-15T16:19:11.371 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 513657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-05-15T16:19:11.371 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/igbvf/ 2023-05-15T16:19:11.371 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 92241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-05-15T16:19:11.371 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/ixgb/ 2023-05-15T16:19:11.371 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 124121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/ixgb/ixgb.ko 2023-05-15T16:19:11.371 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/ixgbe/ 2023-05-15T16:19:11.372 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 733809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-05-15T16:19:11.372 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/ixgbevf/ 2023-05-15T16:19:11.372 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 151361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-05-15T16:19:11.372 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 86417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/jme.ko 2023-05-15T16:19:11.372 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/marvell/ 2023-05-15T16:19:11.372 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-05-15T16:19:11.372 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 101889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/marvell/skge.ko 2023-05-15T16:19:11.372 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 122185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-05-15T16:19:11.373 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/mellanox/ 2023-05-15T16:19:11.373 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/mellanox/mlx4/ 2023-05-15T16:19:11.373 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 709977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-05-15T16:19:11.373 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 280081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-05-15T16:19:11.373 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/mellanox/mlx5/ 2023-05-15T16:19:11.373 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/mellanox/mlx5/core/ 2023-05-15T16:19:11.373 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1034761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-05-15T16:19:11.374 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/micrel/ 2023-05-15T16:19:11.374 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 52545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/micrel/ks8842.ko 2023-05-15T16:19:11.374 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/micrel/ks8851_common.ko 2023-05-15T16:19:11.374 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19129 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/micrel/ks8851_par.ko 2023-05-15T16:19:11.374 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 95169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-05-15T16:19:11.374 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/myricom/ 2023-05-15T16:19:11.374 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/myricom/myri10ge/ 2023-05-15T16:19:11.375 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 108305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-05-15T16:19:11.375 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/natsemi/ 2023-05-15T16:19:11.375 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 72945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-05-15T16:19:11.375 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-05-15T16:19:11.375 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/neterion/ 2023-05-15T16:19:11.375 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 150401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-05-15T16:19:11.375 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/nvidia/ 2023-05-15T16:19:11.375 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 136281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-05-15T16:19:11.376 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/packetengines/ 2023-05-15T16:19:11.376 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-05-15T16:19:11.376 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-05-15T16:19:11.376 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/qlogic/ 2023-05-15T16:19:11.376 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/qlogic/netxen/ 2023-05-15T16:19:11.376 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 227049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-05-15T16:19:11.376 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 86585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-05-15T16:19:11.377 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/qlogic/qlcnic/ 2023-05-15T16:19:11.377 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 671353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-05-15T16:19:11.377 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/rdc/ 2023-05-15T16:19:11.377 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-05-15T16:19:11.377 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/realtek/ 2023-05-15T16:19:11.377 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 66881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-05-15T16:19:11.377 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 83481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-05-15T16:19:11.377 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/realtek/atp.ko 2023-05-15T16:19:11.378 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 183041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-05-15T16:19:11.378 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/samsung/ 2023-05-15T16:19:11.378 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/samsung/sxgbe/ 2023-05-15T16:19:11.378 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 103713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/samsung/sxgbe/samsung-sxgbe.ko 2023-05-15T16:19:11.378 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sfc/ 2023-05-15T16:19:11.378 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 862657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-05-15T16:19:11.378 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/silan/ 2023-05-15T16:19:11.378 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-05-15T16:19:11.379 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sis/ 2023-05-15T16:19:11.379 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sis/sis190.ko 2023-05-15T16:19:11.379 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 62841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sis/sis900.ko 2023-05-15T16:19:11.379 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/smsc/ 2023-05-15T16:19:11.379 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 61041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-05-15T16:19:11.379 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 66689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-05-15T16:19:11.379 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 72905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-05-15T16:19:11.379 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 67777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-05-15T16:19:11.380 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/stmicro/ 2023-05-15T16:19:11.380 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/stmicro/stmmac/ 2023-05-15T16:19:11.380 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-generic.ko 2023-05-15T16:19:11.380 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-05-15T16:19:11.380 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac-platform.ko 2023-05-15T16:19:11.380 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 474905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-05-15T16:19:11.380 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sun/ 2023-05-15T16:19:11.381 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 102945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sun/cassini.ko 2023-05-15T16:19:11.381 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 165841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sun/niu.ko 2023-05-15T16:19:11.381 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 65977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sun/sungem.ko 2023-05-15T16:19:11.381 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 83257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-05-15T16:19:11.381 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/tehuti/ 2023-05-15T16:19:11.381 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-05-15T16:19:11.381 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/ti/ 2023-05-15T16:19:11.381 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 86025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/ti/tlan.ko 2023-05-15T16:19:11.382 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/via/ 2023-05-15T16:19:11.382 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 79761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-05-15T16:19:11.382 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 83169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-05-15T16:19:11.382 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/wiznet/ 2023-05-15T16:19:11.382 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 45289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-05-15T16:19:11.382 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-05-15T16:19:11.382 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/xircom/ 2023-05-15T16:19:11.382 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 59545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-05-15T16:19:11.383 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/fddi/ 2023-05-15T16:19:11.383 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/fddi/defxx.ko 2023-05-15T16:19:11.383 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/fddi/skfp/ 2023-05-15T16:19:11.383 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 216481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/fddi/skfp/skfp.ko 2023-05-15T16:19:11.383 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 76673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/geneve.ko 2023-05-15T16:19:11.383 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/hyperv/ 2023-05-15T16:19:11.383 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 234841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-05-15T16:19:11.384 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ieee802154/ 2023-05-15T16:19:11.384 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ieee802154/fakelb.ko 2023-05-15T16:19:11.384 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ifb.ko 2023-05-15T16:19:11.384 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ipvlan/ 2023-05-15T16:19:11.384 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 82705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ipvlan/ipvlan.ko 2023-05-15T16:19:11.384 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 60233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/macvlan.ko 2023-05-15T16:19:11.384 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/macvtap.ko 2023-05-15T16:19:11.384 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/mdio/ 2023-05-15T16:19:11.385 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-05-15T16:19:11.385 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-05-15T16:19:11.385 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/mdio/mdio-gpio.ko 2023-05-15T16:19:11.385 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/mdio.ko 2023-05-15T16:19:11.385 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/mii.ko 2023-05-15T16:19:11.385 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/netconsole.ko 2023-05-15T16:19:11.385 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/nlmon.ko 2023-05-15T16:19:11.386 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/pcs/ 2023-05-15T16:19:11.386 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/pcs/pcs-altera-tse.ko 2023-05-15T16:19:11.386 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-05-15T16:19:11.386 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/ 2023-05-15T16:19:11.386 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/amd.ko 2023-05-15T16:19:11.386 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-05-15T16:19:11.386 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 44265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/bcm7xxx.ko 2023-05-15T16:19:11.386 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/bcm87xx.ko 2023-05-15T16:19:11.387 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/broadcom.ko 2023-05-15T16:19:11.387 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/cicada.ko 2023-05-15T16:19:11.387 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/davicom.ko 2023-05-15T16:19:11.387 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/et1011c.ko 2023-05-15T16:19:11.387 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/icplus.ko 2023-05-15T16:19:11.387 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/lxt.ko 2023-05-15T16:19:11.387 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 75673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/marvell.ko 2023-05-15T16:19:11.387 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 74585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/micrel.ko 2023-05-15T16:19:11.388 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/national.ko 2023-05-15T16:19:11.388 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 91833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/phylink.ko 2023-05-15T16:19:11.388 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/qsemi.ko 2023-05-15T16:19:11.388 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/realtek.ko 2023-05-15T16:19:11.388 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/smsc.ko 2023-05-15T16:19:11.388 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/ste10Xp.ko 2023-05-15T16:19:11.388 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/phy/vitesse.ko 2023-05-15T16:19:11.388 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/plip/ 2023-05-15T16:19:11.389 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 43073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/plip/plip.ko 2023-05-15T16:19:11.389 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/ 2023-05-15T16:19:11.389 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/bsd_comp.ko 2023-05-15T16:19:11.389 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/ppp_async.ko 2023-05-15T16:19:11.389 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/ppp_deflate.ko 2023-05-15T16:19:11.389 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/ppp_mppe.ko 2023-05-15T16:19:11.389 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/ppp_synctty.ko 2023-05-15T16:19:11.390 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/pppoe.ko 2023-05-15T16:19:11.390 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/pppox.ko 2023-05-15T16:19:11.390 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/ppp/pptp.ko 2023-05-15T16:19:11.390 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/sb1000.ko 2023-05-15T16:19:11.390 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/slip/ 2023-05-15T16:19:11.390 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/slip/slip.ko 2023-05-15T16:19:11.390 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/sungem_phy.ko 2023-05-15T16:19:11.390 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 63113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/tap.ko 2023-05-15T16:19:11.391 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/team/ 2023-05-15T16:19:11.391 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 104289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/team/team.ko 2023-05-15T16:19:11.391 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/team/team_mode_activebackup.ko 2023-05-15T16:19:11.391 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/team/team_mode_broadcast.ko 2023-05-15T16:19:11.391 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-05-15T16:19:11.391 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/team/team_mode_random.ko 2023-05-15T16:19:11.391 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-05-15T16:19:11.391 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 87345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/veth.ko 2023-05-15T16:19:11.392 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/vmxnet3/ 2023-05-15T16:19:11.392 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 120049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-05-15T16:19:11.392 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/vxlan/ 2023-05-15T16:19:11.392 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 238977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/vxlan/vxlan.ko 2023-05-15T16:19:11.392 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/xen-netback/ 2023-05-15T16:19:11.392 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 143305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/net/xen-netback/xen-netback.ko 2023-05-15T16:19:11.392 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ntb/ 2023-05-15T16:19:11.393 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ntb/ntb.ko 2023-05-15T16:19:11.393 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/nvme/ 2023-05-15T16:19:11.393 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/nvme/host/ 2023-05-15T16:19:11.393 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 257665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/nvme/host/nvme-core.ko 2023-05-15T16:19:11.393 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 101393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/nvme/host/nvme.ko 2023-05-15T16:19:11.393 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/parport/ 2023-05-15T16:19:11.393 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 128697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/parport/parport.ko 2023-05-15T16:19:11.393 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/parport/parport_cs.ko 2023-05-15T16:19:11.394 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 83385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/parport/parport_pc.ko 2023-05-15T16:19:11.394 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/parport/parport_serial.ko 2023-05-15T16:19:11.394 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pci/ 2023-05-15T16:19:11.394 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pci/hotplug/ 2023-05-15T16:19:11.394 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-05-15T16:19:11.394 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pci/hotplug/cpcihp_generic.ko 2023-05-15T16:19:11.394 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pci/hotplug/cpcihp_zt5550.ko 2023-05-15T16:19:11.394 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pci/pci-stub.ko 2023-05-15T16:19:11.395 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pci/xen-pcifront.ko 2023-05-15T16:19:11.395 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pcmcia/ 2023-05-15T16:19:11.395 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pcmcia/i82092.ko 2023-05-15T16:19:11.395 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 143273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pcmcia/pcmcia.ko 2023-05-15T16:19:11.395 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 60265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pcmcia/pcmcia_core.ko 2023-05-15T16:19:11.395 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pcmcia/pcmcia_rsrc.ko 2023-05-15T16:19:11.395 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pcmcia/pd6729.ko 2023-05-15T16:19:11.395 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 112481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pcmcia/yenta_socket.ko 2023-05-15T16:19:11.396 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/phy/ 2023-05-15T16:19:11.396 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/phy/broadcom/ 2023-05-15T16:19:11.396 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/phy/broadcom/phy-bcm-kona-usb2.ko 2023-05-15T16:19:11.396 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/phy/samsung/ 2023-05-15T16:19:11.396 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/phy/samsung/phy-exynos-usb2.ko 2023-05-15T16:19:11.396 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pinctrl/ 2023-05-15T16:19:11.396 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pinctrl/intel/ 2023-05-15T16:19:11.397 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 70569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-05-15T16:19:11.397 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/ 2023-05-15T16:19:11.397 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/ 2023-05-15T16:19:11.397 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/cros-ec-sensorhub.ko 2023-05-15T16:19:11.397 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/cros_ec.ko 2023-05-15T16:19:11.397 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/cros_ec_chardev.ko 2023-05-15T16:19:11.397 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/cros_ec_debugfs.ko 2023-05-15T16:19:11.397 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/cros_ec_lightbar.ko 2023-05-15T16:19:11.398 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/cros_ec_sysfs.ko 2023-05-15T16:19:11.398 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/chrome/cros_usbpd_notify.ko 2023-05-15T16:19:11.398 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/ 2023-05-15T16:19:11.398 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 66617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/acer-wmi.ko 2023-05-15T16:19:11.398 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/acerhdf.ko 2023-05-15T16:19:11.398 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/apple-gmux.ko 2023-05-15T16:19:11.398 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 59225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/asus-laptop.ko 2023-05-15T16:19:11.398 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-05-15T16:19:11.399 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 105897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/asus-wmi.ko 2023-05-15T16:19:11.399 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/classmate-laptop.ko 2023-05-15T16:19:11.399 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 48625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-05-15T16:19:11.399 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-05-15T16:19:11.399 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-05-15T16:19:11.399 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-05-15T16:19:11.399 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/hdaps.ko 2023-05-15T16:19:11.399 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/ibm_rtl.ko 2023-05-15T16:19:11.400 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/intel/ 2023-05-15T16:19:11.400 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-05-15T16:19:11.400 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/intel/intel-smartconnect.ko 2023-05-15T16:19:11.400 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/intel_ips.ko 2023-05-15T16:19:11.400 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/msi-wmi.ko 2023-05-15T16:19:11.400 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/mxm-wmi.ko 2023-05-15T16:19:11.400 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-05-15T16:19:11.401 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/samsung-laptop.ko 2023-05-15T16:19:11.401 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/samsung-q10.ko 2023-05-15T16:19:11.401 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/topstar-laptop.ko 2023-05-15T16:19:11.401 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-05-15T16:19:11.401 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/toshiba_haps.ko 2023-05-15T16:19:11.401 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/wmi-bmof.ko 2023-05-15T16:19:11.401 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/platform/x86/wmi.ko 2023-05-15T16:19:11.401 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/ 2023-05-15T16:19:11.402 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/ 2023-05-15T16:19:11.402 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/88pm860x_battery.ko 2023-05-15T16:19:11.402 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/88pm860x_charger.ko 2023-05-15T16:19:11.402 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/bq2415x_charger.ko 2023-05-15T16:19:11.402 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 53529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/bq24190_charger.ko 2023-05-15T16:19:11.402 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/bq24735-charger.ko 2023-05-15T16:19:11.402 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/cros_peripheral_charger.ko 2023-05-15T16:19:11.402 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/da9030_battery.ko 2023-05-15T16:19:11.403 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/da9052-battery.ko 2023-05-15T16:19:11.403 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/ds2760_battery.ko 2023-05-15T16:19:11.403 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/ds2780_battery.ko 2023-05-15T16:19:11.403 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22921 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/ds2781_battery.ko 2023-05-15T16:19:11.403 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/ds2782_battery.ko 2023-05-15T16:19:11.403 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/gpio-charger.ko 2023-05-15T16:19:11.403 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/isp1704_charger.ko 2023-05-15T16:19:11.403 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/lp8727_charger.ko 2023-05-15T16:19:11.404 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/max14577_charger.ko 2023-05-15T16:19:11.404 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/max17040_battery.ko 2023-05-15T16:19:11.404 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/max17042_battery.ko 2023-05-15T16:19:11.404 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/max8903_charger.ko 2023-05-15T16:19:11.404 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/max8925_power.ko 2023-05-15T16:19:11.404 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/pcf50633-charger.ko 2023-05-15T16:19:11.404 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/sbs-battery.ko 2023-05-15T16:19:11.405 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/test_power.ko 2023-05-15T16:19:11.405 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/tps65090-charger.ko 2023-05-15T16:19:11.405 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/wm831x_backup.ko 2023-05-15T16:19:11.405 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/wm831x_power.ko 2023-05-15T16:19:11.405 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/power/supply/wm8350_power.ko 2023-05-15T16:19:11.405 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/powercap/ 2023-05-15T16:19:11.405 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 53721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/powercap/intel_rapl_common.ko 2023-05-15T16:19:11.405 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/powercap/intel_rapl_msr.ko 2023-05-15T16:19:11.406 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pps/ 2023-05-15T16:19:11.406 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pps/clients/ 2023-05-15T16:19:11.406 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pps/clients/pps-gpio.ko 2023-05-15T16:19:11.406 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pps/clients/pps-ldisc.ko 2023-05-15T16:19:11.406 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pps/clients/pps_parport.ko 2023-05-15T16:19:11.406 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/pps/pps_core.ko 2023-05-15T16:19:11.406 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ptp/ 2023-05-15T16:19:11.406 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 64265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ptp/ptp.ko 2023-05-15T16:19:11.407 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ptp/ptp_kvm.ko 2023-05-15T16:19:11.407 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/ 2023-05-15T16:19:11.407 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-88pm80x.ko 2023-05-15T16:19:11.407 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-88pm860x.ko 2023-05-15T16:19:11.407 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-bq32k.ko 2023-05-15T16:19:11.407 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-bq4802.ko 2023-05-15T16:19:11.407 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-da9052.ko 2023-05-15T16:19:11.408 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-da9055.ko 2023-05-15T16:19:11.408 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-da9063.ko 2023-05-15T16:19:11.408 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds1286.ko 2023-05-15T16:19:11.408 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 68081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds1307.ko 2023-05-15T16:19:11.408 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds1374.ko 2023-05-15T16:19:11.408 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds1511.ko 2023-05-15T16:19:11.408 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds1553.ko 2023-05-15T16:19:11.408 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds1672.ko 2023-05-15T16:19:11.409 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds1742.ko 2023-05-15T16:19:11.409 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds2404.ko 2023-05-15T16:19:11.409 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-ds3232.ko 2023-05-15T16:19:11.409 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-em3027.ko 2023-05-15T16:19:11.409 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-fm3130.ko 2023-05-15T16:19:11.409 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-isl12022.ko 2023-05-15T16:19:11.409 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-isl1208.ko 2023-05-15T16:19:11.409 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-lp8788.ko 2023-05-15T16:19:11.410 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-m41t80.ko 2023-05-15T16:19:11.410 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-m48t35.ko 2023-05-15T16:19:11.410 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-m48t59.ko 2023-05-15T16:19:11.410 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-m48t86.ko 2023-05-15T16:19:11.410 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-max6900.ko 2023-05-15T16:19:11.410 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-max8907.ko 2023-05-15T16:19:11.410 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-max8925.ko 2023-05-15T16:19:11.411 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-max8997.ko 2023-05-15T16:19:11.411 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-max8998.ko 2023-05-15T16:19:11.411 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-mc13xxx.ko 2023-05-15T16:19:11.411 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-msm6242.ko 2023-05-15T16:19:11.411 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-palmas.ko 2023-05-15T16:19:11.411 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-pcf2127.ko 2023-05-15T16:19:11.411 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-pcf50633.ko 2023-05-15T16:19:11.411 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-pcf85063.ko 2023-05-15T16:19:11.412 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-pcf8523.ko 2023-05-15T16:19:11.412 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-pcf8563.ko 2023-05-15T16:19:11.412 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-pcf8583.ko 2023-05-15T16:19:11.412 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-rc5t583.ko 2023-05-15T16:19:11.412 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-rp5c01.ko 2023-05-15T16:19:11.412 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-rs5c372.ko 2023-05-15T16:19:11.412 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-05-15T16:19:11.412 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-rx8025.ko 2023-05-15T16:19:11.413 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-rx8581.ko 2023-05-15T16:19:11.413 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-s35390a.ko 2023-05-15T16:19:11.413 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-05-15T16:19:11.413 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-tps6586x.ko 2023-05-15T16:19:11.413 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-tps65910.ko 2023-05-15T16:19:11.413 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-wm831x.ko 2023-05-15T16:19:11.413 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-wm8350.ko 2023-05-15T16:19:11.413 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/rtc/rtc-x1205.ko 2023-05-15T16:19:11.414 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/ 2023-05-15T16:19:11.414 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 77209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/3w-9xxx.ko 2023-05-15T16:19:11.414 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 57169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/3w-sas.ko 2023-05-15T16:19:11.414 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/3w-xxxx.ko 2023-05-15T16:19:11.414 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 134673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/BusLogic.ko 2023-05-15T16:19:11.414 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/a100u2w.ko 2023-05-15T16:19:11.414 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/aacraid/ 2023-05-15T16:19:11.415 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 271161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/aacraid/aacraid.ko 2023-05-15T16:19:11.415 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 100129 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/advansys.ko 2023-05-15T16:19:11.415 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/aic7xxx/ 2023-05-15T16:19:11.415 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 355761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-05-15T16:19:11.415 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 295313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-05-15T16:19:11.415 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/aic94xx/ 2023-05-15T16:19:11.415 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 188825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/aic94xx/aic94xx.ko 2023-05-15T16:19:11.415 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/am53c974.ko 2023-05-15T16:19:11.416 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/arcmsr/ 2023-05-15T16:19:11.416 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 106065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-05-15T16:19:11.416 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/atp870u.ko 2023-05-15T16:19:11.416 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/be2iscsi/ 2023-05-15T16:19:11.416 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 246913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-05-15T16:19:11.416 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/bfa/ 2023-05-15T16:19:11.416 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1172201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/bfa/bfa.ko 2023-05-15T16:19:11.417 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/bnx2fc/ 2023-05-15T16:19:11.417 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 236737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-05-15T16:19:11.417 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/bnx2i/ 2023-05-15T16:19:11.417 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 114969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-05-15T16:19:11.417 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/ch.ko 2023-05-15T16:19:11.417 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/csiostor/ 2023-05-15T16:19:11.417 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 308401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/csiostor/csiostor.ko 2023-05-15T16:19:11.417 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/cxgbi/ 2023-05-15T16:19:11.418 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/cxgbi/cxgb3i/ 2023-05-15T16:19:11.418 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 75689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-05-15T16:19:11.418 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/cxgbi/cxgb4i/ 2023-05-15T16:19:11.418 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 101017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-05-15T16:19:11.418 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 141417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-05-15T16:19:11.418 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 75105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/dc395x.ko 2023-05-15T16:19:11.418 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/dmx3191d.ko 2023-05-15T16:19:11.418 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/esas2r/ 2023-05-15T16:19:11.419 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 211977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/esas2r/esas2r.ko 2023-05-15T16:19:11.419 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 59441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/esp_scsi.ko 2023-05-15T16:19:11.419 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/fcoe/ 2023-05-15T16:19:11.419 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 77713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/fcoe/fcoe.ko 2023-05-15T16:19:11.419 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 154601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-05-15T16:19:11.419 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/fdomain.ko 2023-05-15T16:19:11.419 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/fnic/ 2023-05-15T16:19:11.420 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 262025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/fnic/fnic.ko 2023-05-15T16:19:11.420 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 201305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/hpsa.ko 2023-05-15T16:19:11.420 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/hptiop.ko 2023-05-15T16:19:11.420 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 48721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/hv_storvsc.ko 2023-05-15T16:19:11.420 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/imm.ko 2023-05-15T16:19:11.420 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 43561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/initio.ko 2023-05-15T16:19:11.420 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 285985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/ipr.ko 2023-05-15T16:19:11.420 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 101449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/ips.ko 2023-05-15T16:19:11.421 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/isci/ 2023-05-15T16:19:11.421 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 316817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/isci/isci.ko 2023-05-15T16:19:11.421 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-05-15T16:19:11.421 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 52201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/iscsi_tcp.ko 2023-05-15T16:19:11.421 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/libfc/ 2023-05-15T16:19:11.421 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 307873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/libfc/libfc.ko 2023-05-15T16:19:11.421 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 139737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/libiscsi.ko 2023-05-15T16:19:11.421 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/libiscsi_tcp.ko 2023-05-15T16:19:11.422 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/libsas/ 2023-05-15T16:19:11.422 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 212217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/libsas/libsas.ko 2023-05-15T16:19:11.422 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/lpfc/ 2023-05-15T16:19:11.422 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 2194601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/lpfc/lpfc.ko 2023-05-15T16:19:11.422 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/megaraid/ 2023-05-15T16:19:11.422 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 73113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-05-15T16:19:11.422 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-05-15T16:19:11.423 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 310241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-05-15T16:19:11.423 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 84289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/megaraid.ko 2023-05-15T16:19:11.423 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/mpt3sas/ 2023-05-15T16:19:11.423 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 659569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-05-15T16:19:11.423 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/mvsas/ 2023-05-15T16:19:11.423 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 119425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/mvsas/mvsas.ko 2023-05-15T16:19:11.423 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 77665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/mvumi.ko 2023-05-15T16:19:11.423 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pcmcia/ 2023-05-15T16:19:11.424 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 81113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pcmcia/aha152x_cs.ko 2023-05-15T16:19:11.424 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pcmcia/fdomain_cs.ko 2023-05-15T16:19:11.424 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pcmcia/qlogic_cs.ko 2023-05-15T16:19:11.424 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pcmcia/sym53c500_cs.ko 2023-05-15T16:19:11.424 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pm8001/ 2023-05-15T16:19:11.424 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 360881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-05-15T16:19:11.424 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 123073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/pmcraid.ko 2023-05-15T16:19:11.424 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/ppa.ko 2023-05-15T16:19:11.425 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/qla1280.ko 2023-05-15T16:19:11.425 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/qla2xxx/ 2023-05-15T16:19:11.425 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1850553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-05-15T16:19:11.425 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 85353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-05-15T16:19:11.425 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/qla4xxx/ 2023-05-15T16:19:11.425 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 558737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-05-15T16:19:11.425 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/qlogicfas408.ko 2023-05-15T16:19:11.425 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/raid_class.ko 2023-05-15T16:19:11.426 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 242441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/scsi_debug.ko 2023-05-15T16:19:11.426 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 171561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/scsi_transport_fc.ko 2023-05-15T16:19:11.426 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 270153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-05-15T16:19:11.426 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 94049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/scsi_transport_sas.ko 2023-05-15T16:19:11.426 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 72321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/scsi_transport_spi.ko 2023-05-15T16:19:11.426 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 43169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/scsi_transport_srp.ko 2023-05-15T16:19:11.426 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/ses.ko 2023-05-15T16:19:11.426 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 115409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/st.ko 2023-05-15T16:19:11.427 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/stex.ko 2023-05-15T16:19:11.427 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/sym53c8xx_2/ 2023-05-15T16:19:11.427 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 161697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-05-15T16:19:11.427 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/virtio_scsi.ko 2023-05-15T16:19:11.427 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/vmw_pvscsi.ko 2023-05-15T16:19:11.427 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/wd719x.ko 2023-05-15T16:19:11.427 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/scsi/xen-scsifront.ko 2023-05-15T16:19:11.428 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ssb/ 2023-05-15T16:19:11.428 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 126593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ssb/ssb.ko 2023-05-15T16:19:11.428 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/ 2023-05-15T16:19:11.428 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/iscsi/ 2023-05-15T16:19:11.428 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 730161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-05-15T16:19:11.428 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/loopback/ 2023-05-15T16:19:11.428 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/loopback/tcm_loop.ko 2023-05-15T16:19:11.428 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/target_core_file.ko 2023-05-15T16:19:11.429 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/target_core_iblock.ko 2023-05-15T16:19:11.429 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 913305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/target_core_mod.ko 2023-05-15T16:19:11.429 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 43833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/target_core_pscsi.ko 2023-05-15T16:19:11.429 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 121793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/target_core_user.ko 2023-05-15T16:19:11.429 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/tcm_fc/ 2023-05-15T16:19:11.429 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 75905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-05-15T16:19:11.429 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/ 2023-05-15T16:19:11.430 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/ 2023-05-15T16:19:11.430 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/ 2023-05-15T16:19:11.430 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-05-15T16:19:11.430 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-05-15T16:19:11.430 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-05-15T16:19:11.430 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-05-15T16:19:11.430 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-05-15T16:19:11.430 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-05-15T16:19:11.431 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-05-15T16:19:11.431 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-05-15T16:19:11.431 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-05-15T16:19:11.431 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-05-15T16:19:11.431 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-05-15T16:19:11.431 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-05-15T16:19:11.431 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/intel_menlow.ko 2023-05-15T16:19:11.431 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/intel_powerclamp.ko 2023-05-15T16:19:11.432 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-05-15T16:19:11.432 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-05-15T16:19:11.432 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-05-15T16:19:11.432 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/ 2023-05-15T16:19:11.432 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/ipwireless/ 2023-05-15T16:19:11.432 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 77649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-05-15T16:19:11.432 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 57377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/moxa.ko 2023-05-15T16:19:11.432 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/mxser.ko 2023-05-15T16:19:11.433 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 104345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/n_gsm.ko 2023-05-15T16:19:11.433 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/n_hdlc.ko 2023-05-15T16:19:11.433 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 67641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/nozomi.ko 2023-05-15T16:19:11.433 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/ 2023-05-15T16:19:11.433 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/8250/ 2023-05-15T16:19:11.433 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/8250/8250_dw.ko 2023-05-15T16:19:11.433 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 59065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-05-15T16:19:11.434 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/altera_jtaguart.ko 2023-05-15T16:19:11.434 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/altera_uart.ko 2023-05-15T16:19:11.434 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/arc_uart.ko 2023-05-15T16:19:11.434 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 69793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/fsl_lpuart.ko 2023-05-15T16:19:11.434 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/jsm/ 2023-05-15T16:19:11.434 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 102521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/jsm/jsm.ko 2023-05-15T16:19:11.434 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/rp2.ko 2023-05-15T16:19:11.434 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 51705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/serial/sc16is7xx.ko 2023-05-15T16:19:11.435 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 99985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/tty/synclink_gt.ko 2023-05-15T16:19:11.435 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ufs/ 2023-05-15T16:19:11.435 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ufs/core/ 2023-05-15T16:19:11.435 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 518025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ufs/core/ufshcd-core.ko 2023-05-15T16:19:11.435 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ufs/host/ 2023-05-15T16:19:11.435 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-05-15T16:19:11.435 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/ufs/host/ufshcd-pltfrm.ko 2023-05-15T16:19:11.435 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/ 2023-05-15T16:19:11.436 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 43353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio.ko 2023-05-15T16:19:11.436 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_aec.ko 2023-05-15T16:19:11.436 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_cif.ko 2023-05-15T16:19:11.436 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_dmem_genirq.ko 2023-05-15T16:19:11.436 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_mf624.ko 2023-05-15T16:19:11.436 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_netx.ko 2023-05-15T16:19:11.436 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_pci_generic.ko 2023-05-15T16:19:11.436 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_pdrv_genirq.ko 2023-05-15T16:19:11.437 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/uio/uio_sercos3.ko 2023-05-15T16:19:11.437 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/ 2023-05-15T16:19:11.437 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/c67x00/ 2023-05-15T16:19:11.437 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 72777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/c67x00/c67x00.ko 2023-05-15T16:19:11.437 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/chipidea/ 2023-05-15T16:19:11.437 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 144897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/chipidea/ci_hdrc.ko 2023-05-15T16:19:11.437 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/chipidea/ci_hdrc_msm.ko 2023-05-15T16:19:11.438 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/chipidea/ci_hdrc_pci.ko 2023-05-15T16:19:11.438 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/chipidea/ci_hdrc_usb2.ko 2023-05-15T16:19:11.438 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/class/ 2023-05-15T16:19:11.438 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 85025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/class/cdc-acm.ko 2023-05-15T16:19:11.438 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/class/cdc-wdm.ko 2023-05-15T16:19:11.438 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/class/usblp.ko 2023-05-15T16:19:11.438 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 89409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/class/usbtmc.ko 2023-05-15T16:19:11.438 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/common/ 2023-05-15T16:19:11.439 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/common/ulpi.ko 2023-05-15T16:19:11.439 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/dwc2/ 2023-05-15T16:19:11.439 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/dwc2/dwc2_pci.ko 2023-05-15T16:19:11.439 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/dwc3/ 2023-05-15T16:19:11.439 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/dwc3/dwc3-haps.ko 2023-05-15T16:19:11.439 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/dwc3/dwc3-pci.ko 2023-05-15T16:19:11.439 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 433729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/dwc3/dwc3.ko 2023-05-15T16:19:11.439 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/ 2023-05-15T16:19:11.440 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/ 2023-05-15T16:19:11.440 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/u_ether.ko 2023-05-15T16:19:11.440 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/u_serial.ko 2023-05-15T16:19:11.440 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_acm.ko 2023-05-15T16:19:11.440 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_ecm.ko 2023-05-15T16:19:11.440 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_ecm_subset.ko 2023-05-15T16:19:11.440 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_eem.ko 2023-05-15T16:19:11.441 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 90825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_fs.ko 2023-05-15T16:19:11.441 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_hid.ko 2023-05-15T16:19:11.441 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 117593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_mass_storage.ko 2023-05-15T16:19:11.441 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 57425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_ncm.ko 2023-05-15T16:19:11.441 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_obex.ko 2023-05-15T16:19:11.441 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_phonet.ko 2023-05-15T16:19:11.441 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 57521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_printer.ko 2023-05-15T16:19:11.441 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 83697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_rndis.ko 2023-05-15T16:19:11.442 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_serial.ko 2023-05-15T16:19:11.442 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 58001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_ss_lb.ko 2023-05-15T16:19:11.442 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 67913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/function/usb_f_tcm.ko 2023-05-15T16:19:11.442 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/ 2023-05-15T16:19:11.442 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_acm_ms.ko 2023-05-15T16:19:11.442 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_cdc.ko 2023-05-15T16:19:11.442 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_dbgp.ko 2023-05-15T16:19:11.442 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_ether.ko 2023-05-15T16:19:11.443 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_ffs.ko 2023-05-15T16:19:11.443 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_hid.ko 2023-05-15T16:19:11.443 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_mass_storage.ko 2023-05-15T16:19:11.443 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_ncm.ko 2023-05-15T16:19:11.443 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_nokia.ko 2023-05-15T16:19:11.443 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_printer.ko 2023-05-15T16:19:11.443 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_serial.ko 2023-05-15T16:19:11.443 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/g_zero.ko 2023-05-15T16:19:11.444 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 61665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/gadgetfs.ko 2023-05-15T16:19:11.444 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/legacy/tcm_usb_gadget.ko 2023-05-15T16:19:11.444 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 154617 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/libcomposite.ko 2023-05-15T16:19:11.444 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/ 2023-05-15T16:19:11.444 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/amd5536udc_pci.ko 2023-05-15T16:19:11.444 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/bdc/ 2023-05-15T16:19:11.444 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 157161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/bdc/bdc.ko 2023-05-15T16:19:11.444 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/goku_udc.ko 2023-05-15T16:19:11.445 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 52441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/gr_udc.ko 2023-05-15T16:19:11.445 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 69193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/mv_u3d_core.ko 2023-05-15T16:19:11.445 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 55473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/mv_udc.ko 2023-05-15T16:19:11.445 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 75545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/net2272.ko 2023-05-15T16:19:11.445 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 74529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/net2280.ko 2023-05-15T16:19:11.445 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 72745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/pch_udc.ko 2023-05-15T16:19:11.445 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 65297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/pxa27x_udc.ko 2023-05-15T16:19:11.446 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 65585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/r8a66597-udc.ko 2023-05-15T16:19:11.446 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 79913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/snps_udc_core.ko 2023-05-15T16:19:11.446 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 139729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/gadget/udc/udc-core.ko 2023-05-15T16:19:11.446 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/ 2023-05-15T16:19:11.446 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/bcma-hcd.ko 2023-05-15T16:19:11.446 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 79529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/isp116x-hcd.ko 2023-05-15T16:19:11.446 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 87185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/oxu210hp-hcd.ko 2023-05-15T16:19:11.446 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 78425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/r8a66597-hcd.ko 2023-05-15T16:19:11.447 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/sl811-hcd.ko 2023-05-15T16:19:11.447 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/sl811_cs.ko 2023-05-15T16:19:11.447 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/ssb-hcd.ko 2023-05-15T16:19:11.447 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 92241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/u132-hcd.ko 2023-05-15T16:19:11.447 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/host/xhci-plat-hcd.ko 2023-05-15T16:19:11.447 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/image/ 2023-05-15T16:19:11.447 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/image/mdc800.ko 2023-05-15T16:19:11.447 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/image/microtek.ko 2023-05-15T16:19:11.448 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/ 2023-05-15T16:19:11.448 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/adutux.ko 2023-05-15T16:19:11.448 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/appledisplay.ko 2023-05-15T16:19:11.448 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/cypress_cy7c63.ko 2023-05-15T16:19:11.448 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/cytherm.ko 2023-05-15T16:19:11.448 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/ehset.ko 2023-05-15T16:19:11.448 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/emi26.ko 2023-05-15T16:19:11.449 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/emi62.ko 2023-05-15T16:19:11.449 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/ezusb.ko 2023-05-15T16:19:11.449 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 73217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/ftdi-elan.ko 2023-05-15T16:19:11.449 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/idmouse.ko 2023-05-15T16:19:11.449 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/iowarrior.ko 2023-05-15T16:19:11.449 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/isight_firmware.ko 2023-05-15T16:19:11.449 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/ldusb.ko 2023-05-15T16:19:11.449 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/legousbtower.ko 2023-05-15T16:19:11.450 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/lvstest.ko 2023-05-15T16:19:11.450 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/sisusbvga/ 2023-05-15T16:19:11.450 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 64033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-05-15T16:19:11.450 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/trancevibrator.ko 2023-05-15T16:19:11.450 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/usb3503.ko 2023-05-15T16:19:11.450 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/usblcd.ko 2023-05-15T16:19:11.450 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/usbsevseg.ko 2023-05-15T16:19:11.450 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 70313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/usbtest.ko 2023-05-15T16:19:11.451 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/uss720.ko 2023-05-15T16:19:11.451 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/misc/yurex.ko 2023-05-15T16:19:11.451 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/mon/ 2023-05-15T16:19:11.451 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 72321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/mon/usbmon.ko 2023-05-15T16:19:11.451 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/musb/ 2023-05-15T16:19:11.451 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 294641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/musb/musb_hdrc.ko 2023-05-15T16:19:11.451 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/phy/ 2023-05-15T16:19:11.451 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/phy/phy-generic.ko 2023-05-15T16:19:11.452 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/phy/phy-gpio-vbus-usb.ko 2023-05-15T16:19:11.452 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/phy/phy-isp1301.ko 2023-05-15T16:19:11.452 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/phy/phy-tahvo.ko 2023-05-15T16:19:11.452 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ 2023-05-15T16:19:11.452 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/aircable.ko 2023-05-15T16:19:11.452 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ark3116.ko 2023-05-15T16:19:11.452 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/belkin_sa.ko 2023-05-15T16:19:11.453 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ch341.ko 2023-05-15T16:19:11.453 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 69601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/cp210x.ko 2023-05-15T16:19:11.453 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/cyberjack.ko 2023-05-15T16:19:11.453 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 57497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/cypress_m8.ko 2023-05-15T16:19:11.453 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/digi_acceleport.ko 2023-05-15T16:19:11.453 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/empeg.ko 2023-05-15T16:19:11.453 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 43457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/f81232.ko 2023-05-15T16:19:11.453 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 174409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ftdi_sio.ko 2023-05-15T16:19:11.454 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 52273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/garmin_gps.ko 2023-05-15T16:19:11.454 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 136441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/io_edgeport.ko 2023-05-15T16:19:11.454 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 123961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/io_ti.ko 2023-05-15T16:19:11.454 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 67329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ipaq.ko 2023-05-15T16:19:11.454 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ipw.ko 2023-05-15T16:19:11.454 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ir-usb.ko 2023-05-15T16:19:11.454 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 57505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-05-15T16:19:11.454 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 106985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/keyspan.ko 2023-05-15T16:19:11.455 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/keyspan_pda.ko 2023-05-15T16:19:11.455 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/kl5kusb105.ko 2023-05-15T16:19:11.455 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/kobil_sct.ko 2023-05-15T16:19:11.455 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/mct_u232.ko 2023-05-15T16:19:11.455 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/metro-usb.ko 2023-05-15T16:19:11.455 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 65801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/mos7720.ko 2023-05-15T16:19:11.455 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 77673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/mos7840.ko 2023-05-15T16:19:11.455 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 55569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/mxuport.ko 2023-05-15T16:19:11.456 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/navman.ko 2023-05-15T16:19:11.456 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/omninet.ko 2023-05-15T16:19:11.456 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/opticon.ko 2023-05-15T16:19:11.456 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 187217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/option.ko 2023-05-15T16:19:11.456 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/oti6858.ko 2023-05-15T16:19:11.456 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 53633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/pl2303.ko 2023-05-15T16:19:11.456 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/qcaux.ko 2023-05-15T16:19:11.456 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/qcserial.ko 2023-05-15T16:19:11.457 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/quatech2.ko 2023-05-15T16:19:11.457 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/safe_serial.ko 2023-05-15T16:19:11.457 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 50865 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/sierra.ko 2023-05-15T16:19:11.457 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/spcp8x5.ko 2023-05-15T16:19:11.457 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ssu100.ko 2023-05-15T16:19:11.457 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/symbolserial.ko 2023-05-15T16:19:11.457 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 60513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-05-15T16:19:11.458 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-05-15T16:19:11.458 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/usb_debug.ko 2023-05-15T16:19:11.458 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/usb_wwan.ko 2023-05-15T16:19:11.458 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 122417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/usbserial.ko 2023-05-15T16:19:11.458 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/visor.ko 2023-05-15T16:19:11.458 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/whiteheat.ko 2023-05-15T16:19:11.458 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/wishbone-serial.ko 2023-05-15T16:19:11.458 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/serial/xsens_mt.ko 2023-05-15T16:19:11.459 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ 2023-05-15T16:19:11.459 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 52345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/uas.ko 2023-05-15T16:19:11.459 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-alauda.ko 2023-05-15T16:19:11.459 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-cypress.ko 2023-05-15T16:19:11.459 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-datafab.ko 2023-05-15T16:19:11.459 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-05-15T16:19:11.459 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-freecom.ko 2023-05-15T16:19:11.459 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-isd200.ko 2023-05-15T16:19:11.460 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-05-15T16:19:11.460 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-karma.ko 2023-05-15T16:19:11.460 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-onetouch.ko 2023-05-15T16:19:11.460 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-realtek.ko 2023-05-15T16:19:11.460 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-sddr09.ko 2023-05-15T16:19:11.460 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-sddr55.ko 2023-05-15T16:19:11.460 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/ums-usbat.ko 2023-05-15T16:19:11.460 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 176329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/storage/usb-storage.ko 2023-05-15T16:19:11.461 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/usbip/ 2023-05-15T16:19:11.461 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 65265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/usbip/usbip-core.ko 2023-05-15T16:19:11.461 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 71009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/usbip/usbip-host.ko 2023-05-15T16:19:11.461 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 104905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-05-15T16:19:11.461 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vfio/ 2023-05-15T16:19:11.461 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vfio/pci/ 2023-05-15T16:19:11.461 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 145057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-05-15T16:19:11.461 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vfio/pci/vfio-pci.ko 2023-05-15T16:19:11.462 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 97561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vfio/vfio.ko 2023-05-15T16:19:11.462 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 71257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-05-15T16:19:11.462 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vhost/ 2023-05-15T16:19:11.462 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 98209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vhost/vhost.ko 2023-05-15T16:19:11.462 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vhost/vhost_iotlb.ko 2023-05-15T16:19:11.462 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 57665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vhost/vhost_net.ko 2023-05-15T16:19:11.462 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 86785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/vhost/vhost_scsi.ko 2023-05-15T16:19:11.462 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/ 2023-05-15T16:19:11.463 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/ 2023-05-15T16:19:11.463 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/88pm860x_bl.ko 2023-05-15T16:19:11.463 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/aat2870_bl.ko 2023-05-15T16:19:11.463 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/adp5520_bl.ko 2023-05-15T16:19:11.463 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/adp8860_bl.ko 2023-05-15T16:19:11.463 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/adp8870_bl.ko 2023-05-15T16:19:11.463 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/apple_bl.ko 2023-05-15T16:19:11.464 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/as3711_bl.ko 2023-05-15T16:19:11.464 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/bd6107.ko 2023-05-15T16:19:11.464 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/da903x_bl.ko 2023-05-15T16:19:11.464 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/da9052_bl.ko 2023-05-15T16:19:11.464 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/gpio_backlight.ko 2023-05-15T16:19:11.464 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14337 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/kb3886_bl.ko 2023-05-15T16:19:11.464 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/lcd.ko 2023-05-15T16:19:11.464 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/lm3533_bl.ko 2023-05-15T16:19:11.465 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/lm3639_bl.ko 2023-05-15T16:19:11.465 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/lv5207lp.ko 2023-05-15T16:19:11.465 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/max8925_bl.ko 2023-05-15T16:19:11.465 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/pandora_bl.ko 2023-05-15T16:19:11.465 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/pcf50633-backlight.ko 2023-05-15T16:19:11.465 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/platform_lcd.ko 2023-05-15T16:19:11.465 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/video/backlight/wm831x_bl.ko 2023-05-15T16:19:11.465 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/ 2023-05-15T16:19:11.466 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/masters/ 2023-05-15T16:19:11.466 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/masters/ds2482.ko 2023-05-15T16:19:11.466 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/masters/ds2490.ko 2023-05-15T16:19:11.466 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/masters/matrox_w1.ko 2023-05-15T16:19:11.466 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/masters/w1-gpio.ko 2023-05-15T16:19:11.466 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/ 2023-05-15T16:19:11.466 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-05-15T16:19:11.467 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-05-15T16:19:11.467 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-05-15T16:19:11.467 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-05-15T16:19:11.467 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-05-15T16:19:11.467 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-05-15T16:19:11.467 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-05-15T16:19:11.467 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-05-15T16:19:11.467 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-05-15T16:19:11.468 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_smem.ko 2023-05-15T16:19:11.468 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 55993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/slaves/w1_therm.ko 2023-05-15T16:19:11.468 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 101081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/w1/wire.ko 2023-05-15T16:19:11.468 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/ 2023-05-15T16:19:11.468 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/acquirewdt.ko 2023-05-15T16:19:11.468 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/advantechwdt.ko 2023-05-15T16:19:11.468 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/alim1535_wdt.ko 2023-05-15T16:19:11.468 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/alim7101_wdt.ko 2023-05-15T16:19:11.469 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/cpu5wdt.ko 2023-05-15T16:19:11.469 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/da9052_wdt.ko 2023-05-15T16:19:11.469 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/da9055_wdt.ko 2023-05-15T16:19:11.469 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/da9063_wdt.ko 2023-05-15T16:19:11.469 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/dw_wdt.ko 2023-05-15T16:19:11.469 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/eurotechwdt.ko 2023-05-15T16:19:11.469 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/f71808e_wdt.ko 2023-05-15T16:19:11.469 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/hpwdt.ko 2023-05-15T16:19:11.470 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/i6300esb.ko 2023-05-15T16:19:11.470 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-05-15T16:19:11.470 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/iTCO_wdt.ko 2023-05-15T16:19:11.470 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/ib700wdt.ko 2023-05-15T16:19:11.470 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/ibmasr.ko 2023-05-15T16:19:11.470 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-05-15T16:19:11.470 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/it8712f_wdt.ko 2023-05-15T16:19:11.470 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/it87_wdt.ko 2023-05-15T16:19:11.471 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/kempld_wdt.ko 2023-05-15T16:19:11.471 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/machzwd.ko 2023-05-15T16:19:11.471 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/mena21_wdt.ko 2023-05-15T16:19:11.471 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/menf21bmc_wdt.ko 2023-05-15T16:19:11.471 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/nv_tco.ko 2023-05-15T16:19:11.471 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/of_xilinx_wdt.ko 2023-05-15T16:19:11.471 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/pc87413_wdt.ko 2023-05-15T16:19:11.471 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/pcwd_pci.ko 2023-05-15T16:19:11.472 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/pcwd_usb.ko 2023-05-15T16:19:11.472 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/retu_wdt.ko 2023-05-15T16:19:11.472 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/sbc60xxwdt.ko 2023-05-15T16:19:11.472 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/sbc_epx_c3.ko 2023-05-15T16:19:11.472 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-05-15T16:19:11.473 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/sc1200wdt.ko 2023-05-15T16:19:11.473 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/sch311x_wdt.ko 2023-05-15T16:19:11.473 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/smsc37b787_wdt.ko 2023-05-15T16:19:11.473 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/softdog.ko 2023-05-15T16:19:11.473 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/sp5100_tco.ko 2023-05-15T16:19:11.473 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/twl4030_wdt.ko 2023-05-15T16:19:11.473 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/via_wdt.ko 2023-05-15T16:19:11.473 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-05-15T16:19:11.474 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/w83877f_wdt.ko 2023-05-15T16:19:11.474 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/w83977f_wdt.ko 2023-05-15T16:19:11.474 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/wafer5823wdt.ko 2023-05-15T16:19:11.474 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/wdt_pci.ko 2023-05-15T16:19:11.474 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/wm831x_wdt.ko 2023-05-15T16:19:11.474 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/wm8350_wdt.ko 2023-05-15T16:19:11.474 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/watchdog/xen_wdt.ko 2023-05-15T16:19:11.474 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/ 2023-05-15T16:19:11.475 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xen-evtchn.ko 2023-05-15T16:19:11.475 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xen-gntalloc.ko 2023-05-15T16:19:11.475 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xen-gntdev.ko 2023-05-15T16:19:11.475 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xen-pciback/ 2023-05-15T16:19:11.475 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 176105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-05-15T16:19:11.475 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xen-privcmd.ko 2023-05-15T16:19:11.475 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 71449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xen-scsiback.ko 2023-05-15T16:19:11.476 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xenfs/ 2023-05-15T16:19:11.476 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/drivers/xen/xenfs/xenfs.ko 2023-05-15T16:19:11.476 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ 2023-05-15T16:19:11.476 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/9p/ 2023-05-15T16:19:11.476 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 171305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/9p/9p.ko 2023-05-15T16:19:11.476 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/adfs/ 2023-05-15T16:19:11.476 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 60449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/adfs/adfs.ko 2023-05-15T16:19:11.476 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/affs/ 2023-05-15T16:19:11.477 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 162241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/affs/affs.ko 2023-05-15T16:19:11.477 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/afs/ 2023-05-15T16:19:11.477 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 924521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/afs/kafs.ko 2023-05-15T16:19:11.477 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/autofs/ 2023-05-15T16:19:11.477 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 100321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/autofs/autofs4.ko 2023-05-15T16:19:11.477 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/befs/ 2023-05-15T16:19:11.477 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 63977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/befs/befs.ko 2023-05-15T16:19:11.477 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/bfs/ 2023-05-15T16:19:11.478 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/bfs/bfs.ko 2023-05-15T16:19:11.478 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/binfmt_misc.ko 2023-05-15T16:19:11.478 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/btrfs/ 2023-05-15T16:19:11.478 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 3475873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/btrfs/btrfs.ko 2023-05-15T16:19:11.478 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/cachefiles/ 2023-05-15T16:19:11.478 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 299529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/cachefiles/cachefiles.ko 2023-05-15T16:19:11.478 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ceph/ 2023-05-15T16:19:11.478 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1228449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ceph/ceph.ko 2023-05-15T16:19:11.479 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/cifs/ 2023-05-15T16:19:11.479 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 2614625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/cifs/cifs.ko 2023-05-15T16:19:11.479 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/coda/ 2023-05-15T16:19:11.479 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 99153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/coda/coda.ko 2023-05-15T16:19:11.479 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/configfs/ 2023-05-15T16:19:11.479 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 105385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/configfs/configfs.ko 2023-05-15T16:19:11.479 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/cramfs/ 2023-05-15T16:19:11.479 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/cramfs/cramfs.ko 2023-05-15T16:19:11.480 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/dlm/ 2023-05-15T16:19:11.480 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 624153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/dlm/dlm.ko 2023-05-15T16:19:11.480 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/efs/ 2023-05-15T16:19:11.480 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/efs/efs.ko 2023-05-15T16:19:11.480 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/f2fs/ 2023-05-15T16:19:11.480 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1470857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/f2fs/f2fs.ko 2023-05-15T16:19:11.480 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/fat/ 2023-05-15T16:19:11.481 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/fat/msdos.ko 2023-05-15T16:19:11.481 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/freevxfs/ 2023-05-15T16:19:11.481 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 41961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/freevxfs/freevxfs.ko 2023-05-15T16:19:11.481 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/fscache/ 2023-05-15T16:19:11.481 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 218289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/fscache/fscache.ko 2023-05-15T16:19:11.481 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/fuse/ 2023-05-15T16:19:11.481 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/fuse/cuse.ko 2023-05-15T16:19:11.481 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/gfs2/ 2023-05-15T16:19:11.482 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1222241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/gfs2/gfs2.ko 2023-05-15T16:19:11.482 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/hfs/ 2023-05-15T16:19:11.482 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 140857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/hfs/hfs.ko 2023-05-15T16:19:11.482 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/hfsplus/ 2023-05-15T16:19:11.482 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 220953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/hfsplus/hfsplus.ko 2023-05-15T16:19:11.482 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/hpfs/ 2023-05-15T16:19:11.482 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 193145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/hpfs/hpfs.ko 2023-05-15T16:19:11.482 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/isofs/ 2023-05-15T16:19:11.483 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 73961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/isofs/isofs.ko 2023-05-15T16:19:11.483 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/jfs/ 2023-05-15T16:19:11.483 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 418945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/jfs/jfs.ko 2023-05-15T16:19:11.483 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/lockd/ 2023-05-15T16:19:11.483 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 254633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/lockd/lockd.ko 2023-05-15T16:19:11.483 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/minix/ 2023-05-15T16:19:11.483 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 87417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/minix/minix.ko 2023-05-15T16:19:11.484 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/netfs/ 2023-05-15T16:19:11.484 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 128313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/netfs/netfs.ko 2023-05-15T16:19:11.484 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/ 2023-05-15T16:19:11.484 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/blocklayout/ 2023-05-15T16:19:11.484 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 81025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-05-15T16:19:11.484 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/filelayout/ 2023-05-15T16:19:11.484 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 58929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-05-15T16:19:11.484 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/flexfilelayout/ 2023-05-15T16:19:11.485 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 117209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-05-15T16:19:11.485 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1016665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/nfs.ko 2023-05-15T16:19:11.485 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 65665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/nfsv2.ko 2023-05-15T16:19:11.485 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 119217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/nfsv3.ko 2023-05-15T16:19:11.485 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 2003553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs/nfsv4.ko 2023-05-15T16:19:11.485 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs_common/ 2023-05-15T16:19:11.485 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs_common/grace.ko 2023-05-15T16:19:11.486 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfs_common/nfs_acl.ko 2023-05-15T16:19:11.486 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfsd/ 2023-05-15T16:19:11.486 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1400409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nfsd/nfsd.ko 2023-05-15T16:19:11.486 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nilfs2/ 2023-05-15T16:19:11.486 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 587089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nilfs2/nilfs2.ko 2023-05-15T16:19:11.486 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/ 2023-05-15T16:19:11.486 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-celtic.ko 2023-05-15T16:19:11.486 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-centeuro.ko 2023-05-15T16:19:11.487 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-croatian.ko 2023-05-15T16:19:11.487 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-cyrillic.ko 2023-05-15T16:19:11.487 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-gaelic.ko 2023-05-15T16:19:11.487 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-greek.ko 2023-05-15T16:19:11.487 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-iceland.ko 2023-05-15T16:19:11.487 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-inuit.ko 2023-05-15T16:19:11.487 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-roman.ko 2023-05-15T16:19:11.487 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-romanian.ko 2023-05-15T16:19:11.488 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/mac-turkish.ko 2023-05-15T16:19:11.488 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_ascii.ko 2023-05-15T16:19:11.488 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp1250.ko 2023-05-15T16:19:11.488 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp1251.ko 2023-05-15T16:19:11.488 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp1255.ko 2023-05-15T16:19:11.488 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp737.ko 2023-05-15T16:19:11.488 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp775.ko 2023-05-15T16:19:11.488 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp850.ko 2023-05-15T16:19:11.489 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp852.ko 2023-05-15T16:19:11.489 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp855.ko 2023-05-15T16:19:11.489 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp857.ko 2023-05-15T16:19:11.489 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp860.ko 2023-05-15T16:19:11.489 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp861.ko 2023-05-15T16:19:11.489 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp862.ko 2023-05-15T16:19:11.489 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp863.ko 2023-05-15T16:19:11.489 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp864.ko 2023-05-15T16:19:11.490 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp865.ko 2023-05-15T16:19:11.490 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp866.ko 2023-05-15T16:19:11.490 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp869.ko 2023-05-15T16:19:11.490 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp874.ko 2023-05-15T16:19:11.490 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 93649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp932.ko 2023-05-15T16:19:11.490 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 142185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp936.ko 2023-05-15T16:19:11.490 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 165257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp949.ko 2023-05-15T16:19:11.491 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 117625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_cp950.ko 2023-05-15T16:19:11.491 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_euc-jp.ko 2023-05-15T16:19:11.491 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-1.ko 2023-05-15T16:19:11.491 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-13.ko 2023-05-15T16:19:11.491 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-14.ko 2023-05-15T16:19:11.491 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-15.ko 2023-05-15T16:19:11.491 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-2.ko 2023-05-15T16:19:11.491 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-3.ko 2023-05-15T16:19:11.492 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-4.ko 2023-05-15T16:19:11.492 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-5.ko 2023-05-15T16:19:11.492 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-6.ko 2023-05-15T16:19:11.492 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-7.ko 2023-05-15T16:19:11.492 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_iso8859-9.ko 2023-05-15T16:19:11.492 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_koi8-r.ko 2023-05-15T16:19:11.492 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_koi8-ru.ko 2023-05-15T16:19:11.492 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_koi8-u.ko 2023-05-15T16:19:11.493 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/nls/nls_utf8.ko 2023-05-15T16:19:11.493 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ntfs/ 2023-05-15T16:19:11.493 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 218585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ntfs/ntfs.ko 2023-05-15T16:19:11.493 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/ 2023-05-15T16:19:11.493 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/cluster/ 2023-05-15T16:19:11.493 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 240737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-05-15T16:19:11.493 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/dlm/ 2023-05-15T16:19:11.494 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 439201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-05-15T16:19:11.494 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/dlmfs/ 2023-05-15T16:19:11.494 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 53377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-05-15T16:19:11.494 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 2510441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/ocfs2.ko 2023-05-15T16:19:11.494 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-05-15T16:19:11.494 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-05-15T16:19:11.494 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-05-15T16:19:11.494 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/omfs/ 2023-05-15T16:19:11.495 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 52145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/omfs/omfs.ko 2023-05-15T16:19:11.495 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/overlayfs/ 2023-05-15T16:19:11.495 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 320649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/overlayfs/overlay.ko 2023-05-15T16:19:11.495 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/pstore/ 2023-05-15T16:19:11.495 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/pstore/ramoops.ko 2023-05-15T16:19:11.495 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/qnx4/ 2023-05-15T16:19:11.495 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/qnx4/qnx4.ko 2023-05-15T16:19:11.496 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/qnx6/ 2023-05-15T16:19:11.496 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/qnx6/qnx6.ko 2023-05-15T16:19:11.496 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/quota/ 2023-05-15T16:19:11.496 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/quota/quota_tree.ko 2023-05-15T16:19:11.496 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/quota/quota_v1.ko 2023-05-15T16:19:11.496 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/quota/quota_v2.ko 2023-05-15T16:19:11.496 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/reiserfs/ 2023-05-15T16:19:11.496 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 527801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/reiserfs/reiserfs.ko 2023-05-15T16:19:11.497 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/romfs/ 2023-05-15T16:19:11.497 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/romfs/romfs.ko 2023-05-15T16:19:11.497 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/smbfs_common/ 2023-05-15T16:19:11.497 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/smbfs_common/cifs_arc4.ko 2023-05-15T16:19:11.497 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/smbfs_common/cifs_md4.ko 2023-05-15T16:19:11.497 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/squashfs/ 2023-05-15T16:19:11.497 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 131193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/squashfs/squashfs.ko 2023-05-15T16:19:11.498 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/sysv/ 2023-05-15T16:19:11.498 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 88441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/sysv/sysv.ko 2023-05-15T16:19:11.498 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/udf/ 2023-05-15T16:19:11.498 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 247873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/udf/udf.ko 2023-05-15T16:19:11.498 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ufs/ 2023-05-15T16:19:11.498 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 160129 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/ufs/ufs.ko 2023-05-15T16:19:11.498 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/xfs/ 2023-05-15T16:19:11.498 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 3829249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/fs/xfs/xfs.ko 2023-05-15T16:19:11.499 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/kernel/ 2023-05-15T16:19:11.499 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/kernel/locking/ 2023-05-15T16:19:11.499 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 65265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/kernel/locking/locktorture.ko 2023-05-15T16:19:11.499 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/kernel/time/ 2023-05-15T16:19:11.499 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/kernel/time/test_udelay.ko 2023-05-15T16:19:11.499 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 55009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/kernel/torture.ko 2023-05-15T16:19:11.499 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/ 2023-05-15T16:19:11.499 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/crc-itu-t.ko 2023-05-15T16:19:11.500 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 5729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/crc7.ko 2023-05-15T16:19:11.500 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6081 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/crc8.ko 2023-05-15T16:19:11.500 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/crypto/ 2023-05-15T16:19:11.500 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/crypto/libarc4.ko 2023-05-15T16:19:11.500 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/crypto/libdes.ko 2023-05-15T16:19:11.500 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/interval_tree_test.ko 2023-05-15T16:19:11.500 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/libcrc32c.ko 2023-05-15T16:19:11.500 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/lru_cache.ko 2023-05-15T16:19:11.501 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/lz4/ 2023-05-15T16:19:11.501 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/lz4/lz4_compress.ko 2023-05-15T16:19:11.501 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/lz4/lz4hc_compress.ko 2023-05-15T16:19:11.501 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/math/ 2023-05-15T16:19:11.501 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 5897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/math/cordic.ko 2023-05-15T16:19:11.501 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/memory-notifier-error-inject.ko 2023-05-15T16:19:11.501 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/notifier-error-inject.ko 2023-05-15T16:19:11.502 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/percpu_test.ko 2023-05-15T16:19:11.502 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/pm-notifier-error-inject.ko 2023-05-15T16:19:11.502 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/raid6/ 2023-05-15T16:19:11.502 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 141873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/raid6/raid6_pq.ko 2023-05-15T16:19:11.502 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/rbtree_test.ko 2023-05-15T16:19:11.502 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/reed_solomon/ 2023-05-15T16:19:11.502 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/reed_solomon/reed_solomon.ko 2023-05-15T16:19:11.502 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/test-kstrtox.ko 2023-05-15T16:19:11.503 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/test-string_helpers.ko 2023-05-15T16:19:11.503 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 4760329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/test_bpf.ko 2023-05-15T16:19:11.503 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 48057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/test_firmware.ko 2023-05-15T16:19:11.503 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 5873 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/test_module.ko 2023-05-15T16:19:11.503 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21177 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/test_user_copy.ko 2023-05-15T16:19:11.503 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/ts_bm.ko 2023-05-15T16:19:11.503 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/ts_fsm.ko 2023-05-15T16:19:11.503 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/ts_kmp.ko 2023-05-15T16:19:11.504 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/xz/ 2023-05-15T16:19:11.504 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/lib/xz/xz_dec_test.ko 2023-05-15T16:19:11.504 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/mm/ 2023-05-15T16:19:11.504 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/mm/hwpoison-inject.ko 2023-05-15T16:19:11.504 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ 2023-05-15T16:19:11.504 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/ 2023-05-15T16:19:11.504 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/6lowpan.ko 2023-05-15T16:19:11.504 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/nhc_dest.ko 2023-05-15T16:19:11.505 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/nhc_fragment.ko 2023-05-15T16:19:11.505 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/nhc_hop.ko 2023-05-15T16:19:11.505 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/nhc_ipv6.ko 2023-05-15T16:19:11.505 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/nhc_mobility.ko 2023-05-15T16:19:11.505 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/nhc_routing.ko 2023-05-15T16:19:11.505 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/6lowpan/nhc_udp.ko 2023-05-15T16:19:11.505 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/802/ 2023-05-15T16:19:11.506 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/802/garp.ko 2023-05-15T16:19:11.506 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33657 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/802/mrp.ko 2023-05-15T16:19:11.506 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/802/p8022.ko 2023-05-15T16:19:11.506 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/802/psnap.ko 2023-05-15T16:19:11.506 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/802/stp.ko 2023-05-15T16:19:11.506 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/8021q/ 2023-05-15T16:19:11.506 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 80641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/8021q/8021q.ko 2023-05-15T16:19:11.506 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/9p/ 2023-05-15T16:19:11.507 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 191305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/9p/9pnet.ko 2023-05-15T16:19:11.507 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/9p/9pnet_fd.ko 2023-05-15T16:19:11.507 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/9p/9pnet_rdma.ko 2023-05-15T16:19:11.507 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/9p/9pnet_virtio.ko 2023-05-15T16:19:11.507 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/batman-adv/ 2023-05-15T16:19:11.507 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 652281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/batman-adv/batman-adv.ko 2023-05-15T16:19:11.507 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/ 2023-05-15T16:19:11.507 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 63505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/br_netfilter.ko 2023-05-15T16:19:11.508 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 772145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/bridge.ko 2023-05-15T16:19:11.508 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ 2023-05-15T16:19:11.508 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-05-15T16:19:11.508 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_among.ko 2023-05-15T16:19:11.508 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8673 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_arp.ko 2023-05-15T16:19:11.508 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-05-15T16:19:11.508 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-05-15T16:19:11.509 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_ip.ko 2023-05-15T16:19:11.509 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-05-15T16:19:11.509 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_limit.ko 2023-05-15T16:19:11.509 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_log.ko 2023-05-15T16:19:11.509 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_mark.ko 2023-05-15T16:19:11.509 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-05-15T16:19:11.509 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-05-15T16:19:11.509 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-05-15T16:19:11.510 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-05-15T16:19:11.510 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_snat.ko 2023-05-15T16:19:11.510 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_stp.ko 2023-05-15T16:19:11.510 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-05-15T16:19:11.510 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-05-15T16:19:11.510 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-05-15T16:19:11.510 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-05-15T16:19:11.510 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 73961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/ebtables.ko 2023-05-15T16:19:11.511 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-05-15T16:19:11.511 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13449 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-05-15T16:19:11.511 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ceph/ 2023-05-15T16:19:11.511 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1029801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ceph/libceph.ko 2023-05-15T16:19:11.511 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/core/ 2023-05-15T16:19:11.511 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 124297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/core/pktgen.ko 2023-05-15T16:19:11.511 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dccp/ 2023-05-15T16:19:11.511 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 188577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dccp/dccp.ko 2023-05-15T16:19:11.512 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dccp/dccp_diag.ko 2023-05-15T16:19:11.512 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 55633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dccp/dccp_ipv4.ko 2023-05-15T16:19:11.512 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 58905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dccp/dccp_ipv6.ko 2023-05-15T16:19:11.512 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dsa/ 2023-05-15T16:19:11.512 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 274753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dsa/dsa_core.ko 2023-05-15T16:19:11.512 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dsa/tag_brcm.ko 2023-05-15T16:19:11.512 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dsa/tag_dsa.ko 2023-05-15T16:19:11.513 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dsa/tag_none.ko 2023-05-15T16:19:11.513 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/dsa/tag_trailer.ko 2023-05-15T16:19:11.513 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/hsr/ 2023-05-15T16:19:11.513 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 99385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/hsr/hsr.ko 2023-05-15T16:19:11.513 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ieee802154/ 2023-05-15T16:19:11.513 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ieee802154/6lowpan/ 2023-05-15T16:19:11.513 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 44745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-05-15T16:19:11.513 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 245489 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ieee802154/ieee802154.ko 2023-05-15T16:19:11.514 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ieee802154/ieee802154_socket.ko 2023-05-15T16:19:11.514 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/ 2023-05-15T16:19:11.514 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/ah4.ko 2023-05-15T16:19:11.514 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/esp4.ko 2023-05-15T16:19:11.514 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 44425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/fou.ko 2023-05-15T16:19:11.514 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/gre.ko 2023-05-15T16:19:11.514 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/inet_diag.ko 2023-05-15T16:19:11.514 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 59737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/ip_gre.ko 2023-05-15T16:19:11.515 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 57265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/ip_tunnel.ko 2023-05-15T16:19:11.515 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33737 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/ip_vti.ko 2023-05-15T16:19:11.515 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/ipcomp.ko 2023-05-15T16:19:11.515 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/ipip.ko 2023-05-15T16:19:11.515 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/ 2023-05-15T16:19:11.515 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/arp_tables.ko 2023-05-15T16:19:11.515 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-05-15T16:19:11.515 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-05-15T16:19:11.516 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 53921 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/ip_tables.ko 2023-05-15T16:19:11.516 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-05-15T16:19:11.516 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/ipt_REJECT.ko 2023-05-15T16:19:11.516 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-05-15T16:19:11.516 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-05-15T16:19:11.516 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-05-15T16:19:11.516 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/iptable_filter.ko 2023-05-15T16:19:11.517 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-05-15T16:19:11.517 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-05-15T16:19:11.517 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-05-15T16:19:11.517 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/iptable_security.ko 2023-05-15T16:19:11.517 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11281 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-05-15T16:19:11.517 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-05-15T16:19:11.517 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-05-15T16:19:11.517 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-05-15T16:19:11.518 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-05-15T16:19:11.518 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_reject_ipv4.ko 2023-05-15T16:19:11.518 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-05-15T16:19:11.518 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-05-15T16:19:11.518 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-05-15T16:19:11.518 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-05-15T16:19:11.518 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-05-15T16:19:11.518 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_bic.ko 2023-05-15T16:19:11.519 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_dctcp.ko 2023-05-15T16:19:11.519 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14689 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_diag.ko 2023-05-15T16:19:11.519 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_highspeed.ko 2023-05-15T16:19:11.519 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_htcp.ko 2023-05-15T16:19:11.519 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_hybla.ko 2023-05-15T16:19:11.519 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10977 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_illinois.ko 2023-05-15T16:19:11.519 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_lp.ko 2023-05-15T16:19:11.519 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_scalable.ko 2023-05-15T16:19:11.520 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_vegas.ko 2023-05-15T16:19:11.520 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_veno.ko 2023-05-15T16:19:11.520 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10529 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_westwood.ko 2023-05-15T16:19:11.520 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tcp_yeah.ko 2023-05-15T16:19:11.520 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21785 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/tunnel4.ko 2023-05-15T16:19:11.520 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15921 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/udp_diag.ko 2023-05-15T16:19:11.520 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/udp_tunnel.ko 2023-05-15T16:19:11.521 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv4/xfrm4_tunnel.ko 2023-05-15T16:19:11.521 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/ 2023-05-15T16:19:11.521 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/ah6.ko 2023-05-15T16:19:11.521 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/esp6.ko 2023-05-15T16:19:11.521 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13993 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/fou6.ko 2023-05-15T16:19:11.521 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 80297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/ip6_gre.ko 2023-05-15T16:19:11.521 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 90857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/ip6_tunnel.ko 2023-05-15T16:19:11.521 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-05-15T16:19:11.522 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 53369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/ip6_vti.ko 2023-05-15T16:19:11.522 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/ipcomp6.ko 2023-05-15T16:19:11.522 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/mip6.ko 2023-05-15T16:19:11.522 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ 2023-05-15T16:19:11.522 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-05-15T16:19:11.522 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_NPT.ko 2023-05-15T16:19:11.522 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-05-15T16:19:11.522 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-05-15T16:19:11.523 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-05-15T16:19:11.523 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-05-15T16:19:11.523 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-05-15T16:19:11.523 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-05-15T16:19:11.523 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-05-15T16:19:11.523 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-05-15T16:19:11.523 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-05-15T16:19:11.523 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-05-15T16:19:11.524 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-05-15T16:19:11.524 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-05-15T16:19:11.524 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-05-15T16:19:11.524 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-05-15T16:19:11.524 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-05-15T16:19:11.524 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 37929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-05-15T16:19:11.524 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-05-15T16:19:11.525 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-05-15T16:19:11.525 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-05-15T16:19:11.525 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-05-15T16:19:11.525 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-05-15T16:19:11.525 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-05-15T16:19:11.525 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8577 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-05-15T16:19:11.525 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 72545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/sit.ko 2023-05-15T16:19:11.525 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/tunnel6.ko 2023-05-15T16:19:11.526 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22481 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/ipv6/xfrm6_tunnel.ko 2023-05-15T16:19:11.526 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/key/ 2023-05-15T16:19:11.526 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 82505 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/key/af_key.ko 2023-05-15T16:19:11.526 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/ 2023-05-15T16:19:11.526 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 120265 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/l2tp_core.ko 2023-05-15T16:19:11.526 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19841 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/l2tp_debugfs.ko 2023-05-15T16:19:11.526 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/l2tp_eth.ko 2023-05-15T16:19:11.526 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 34969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/l2tp_ip.ko 2023-05-15T16:19:11.527 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/l2tp_ip6.ko 2023-05-15T16:19:11.527 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/l2tp_netlink.ko 2023-05-15T16:19:11.527 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 53057 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/l2tp/l2tp_ppp.ko 2023-05-15T16:19:11.527 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/lapb/ 2023-05-15T16:19:11.527 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 46641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/lapb/lapb.ko 2023-05-15T16:19:11.527 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/llc/ 2023-05-15T16:19:11.527 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/llc/llc.ko 2023-05-15T16:19:11.528 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 266497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/llc/llc2.ko 2023-05-15T16:19:11.528 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/mac802154/ 2023-05-15T16:19:11.528 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 279905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/mac802154/mac802154.ko 2023-05-15T16:19:11.528 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/mpls/ 2023-05-15T16:19:11.528 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/mpls/mpls_gso.ko 2023-05-15T16:19:11.528 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ 2023-05-15T16:19:11.528 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ 2023-05-15T16:19:11.528 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 116641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set.ko 2023-05-15T16:19:11.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28017 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-05-15T16:19:11.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-05-15T16:19:11.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-05-15T16:19:11.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 101537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-05-15T16:19:11.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 102681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-05-15T16:19:11.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 104097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-05-15T16:19:11.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 104697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-05-15T16:19:11.529 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 113953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-05-15T16:19:11.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 60665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-05-15T16:19:11.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 110721 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-05-15T16:19:11.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 114241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-05-15T16:19:11.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 113889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-05-15T16:19:11.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 112713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-05-15T16:19:11.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 115777 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-05-15T16:19:11.530 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-05-15T16:19:11.530 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ 2023-05-15T16:19:11.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 410073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs.ko 2023-05-15T16:19:11.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11473 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-05-15T16:19:11.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-05-15T16:19:11.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-05-15T16:19:11.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-05-15T16:19:11.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-05-15T16:19:11.531 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-05-15T16:19:11.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7257 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-05-15T16:19:11.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-05-15T16:19:11.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8801 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-05-15T16:19:11.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-05-15T16:19:11.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13089 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-05-15T16:19:11.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-05-15T16:19:11.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-05-15T16:19:11.532 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 47601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conncount.ko 2023-05-15T16:19:11.533 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 396769 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack.ko 2023-05-15T16:19:11.533 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15321 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-05-15T16:19:11.533 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-05-15T16:19:11.533 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-05-15T16:19:11.533 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 117313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_h323.ko 2023-05-15T16:19:11.533 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_irc.ko 2023-05-15T16:19:11.533 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8377 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-05-15T16:19:11.533 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 107825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-05-15T16:19:11.534 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-05-15T16:19:11.534 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_sane.ko 2023-05-15T16:19:11.534 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 65305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_sip.ko 2023-05-15T16:19:11.534 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-05-15T16:19:11.534 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-05-15T16:19:11.534 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_dup_netdev.ko 2023-05-15T16:19:11.534 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 86233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_flow_table.ko 2023-05-15T16:19:11.534 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_flow_table_inet.ko 2023-05-15T16:19:11.535 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36705 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_log_syslog.ko 2023-05-15T16:19:11.535 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 91201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_nat.ko 2023-05-15T16:19:11.535 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_nat_amanda.ko 2023-05-15T16:19:11.535 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12129 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_nat_ftp.ko 2023-05-15T16:19:11.535 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11361 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_nat_irc.ko 2023-05-15T16:19:11.535 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_nat_sip.ko 2023-05-15T16:19:11.535 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_nat_tftp.ko 2023-05-15T16:19:11.536 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_synproxy_core.ko 2023-05-15T16:19:11.536 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 575513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nf_tables.ko 2023-05-15T16:19:11.547 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 42137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nfnetlink.ko 2023-05-15T16:19:11.547 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nfnetlink_acct.ko 2023-05-15T16:19:11.547 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nfnetlink_cttimeout.ko 2023-05-15T16:19:11.548 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40225 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nfnetlink_log.ko 2023-05-15T16:19:11.548 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 21729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nfnetlink_osf.ko 2023-05-15T16:19:11.548 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 49001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nfnetlink_queue.ko 2023-05-15T16:19:11.548 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9961 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_chain_nat.ko 2023-05-15T16:19:11.548 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_compat.ko 2023-05-15T16:19:11.548 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 40217 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_ct.ko 2023-05-15T16:19:11.548 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9169 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_dup_netdev.ko 2023-05-15T16:19:11.549 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10161 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_fib.ko 2023-05-15T16:19:11.549 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13385 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_fwd_netdev.ko 2023-05-15T16:19:11.549 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_hash.ko 2023-05-15T16:19:11.549 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_limit.ko 2023-05-15T16:19:11.549 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_log.ko 2023-05-15T16:19:11.549 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_masq.ko 2023-05-15T16:19:11.549 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_nat.ko 2023-05-15T16:19:11.550 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13241 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_numgen.ko 2023-05-15T16:19:11.550 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_osf.ko 2023-05-15T16:19:11.550 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_queue.ko 2023-05-15T16:19:11.550 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_redir.ko 2023-05-15T16:19:11.550 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_reject.ko 2023-05-15T16:19:11.550 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9585 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_reject_inet.ko 2023-05-15T16:19:11.550 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_socket.ko 2023-05-15T16:19:11.550 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_synproxy.ko 2023-05-15T16:19:11.551 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/nft_tproxy.ko 2023-05-15T16:19:11.551 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 98833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/x_tables.ko 2023-05-15T16:19:11.551 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11665 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_AUDIT.ko 2023-05-15T16:19:11.551 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_CHECKSUM.ko 2023-05-15T16:19:11.551 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_CLASSIFY.ko 2023-05-15T16:19:11.551 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-05-15T16:19:11.551 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 17809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_CT.ko 2023-05-15T16:19:11.551 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_DSCP.ko 2023-05-15T16:19:11.552 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_HL.ko 2023-05-15T16:19:11.552 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_HMARK.ko 2023-05-15T16:19:11.552 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 38513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_IDLETIMER.ko 2023-05-15T16:19:11.552 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_LED.ko 2023-05-15T16:19:11.552 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_LOG.ko 2023-05-15T16:19:11.552 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_MASQUERADE.ko 2023-05-15T16:19:11.552 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_NETMAP.ko 2023-05-15T16:19:11.553 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_NFLOG.ko 2023-05-15T16:19:11.553 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_NFQUEUE.ko 2023-05-15T16:19:11.553 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_RATEEST.ko 2023-05-15T16:19:11.553 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_REDIRECT.ko 2023-05-15T16:19:11.553 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_SECMARK.ko 2023-05-15T16:19:11.553 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_TCPMSS.ko 2023-05-15T16:19:11.553 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-05-15T16:19:11.553 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16937 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_TEE.ko 2023-05-15T16:19:11.554 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_TPROXY.ko 2023-05-15T16:19:11.554 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_TRACE.ko 2023-05-15T16:19:11.554 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_addrtype.ko 2023-05-15T16:19:11.554 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13457 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_bpf.ko 2023-05-15T16:19:11.554 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15209 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_cgroup.ko 2023-05-15T16:19:11.554 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_cluster.ko 2023-05-15T16:19:11.554 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7073 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_comment.ko 2023-05-15T16:19:11.554 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_connbytes.ko 2023-05-15T16:19:11.555 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10649 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_connlabel.ko 2023-05-15T16:19:11.555 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_connlimit.ko 2023-05-15T16:19:11.555 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_connmark.ko 2023-05-15T16:19:11.555 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_conntrack.ko 2023-05-15T16:19:11.555 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_cpu.ko 2023-05-15T16:19:11.555 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_dccp.ko 2023-05-15T16:19:11.555 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_devgroup.ko 2023-05-15T16:19:11.555 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_dscp.ko 2023-05-15T16:19:11.556 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_ecn.ko 2023-05-15T16:19:11.556 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11041 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_esp.ko 2023-05-15T16:19:11.556 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 43025 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_hashlimit.ko 2023-05-15T16:19:11.556 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10889 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_helper.ko 2023-05-15T16:19:11.556 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_hl.ko 2023-05-15T16:19:11.556 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11553 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_ipcomp.ko 2023-05-15T16:19:11.556 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11033 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_iprange.ko 2023-05-15T16:19:11.557 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11289 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_ipvs.ko 2023-05-15T16:19:11.557 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_l2tp.ko 2023-05-15T16:19:11.557 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_length.ko 2023-05-15T16:19:11.557 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_limit.ko 2023-05-15T16:19:11.557 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7113 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_mac.ko 2023-05-15T16:19:11.557 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8153 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_mark.ko 2023-05-15T16:19:11.557 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_multiport.ko 2023-05-15T16:19:11.557 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13513 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_nat.ko 2023-05-15T16:19:11.558 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_nfacct.ko 2023-05-15T16:19:11.558 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_osf.ko 2023-05-15T16:19:11.558 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9121 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_owner.ko 2023-05-15T16:19:11.558 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_physdev.ko 2023-05-15T16:19:11.558 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7137 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_pkttype.ko 2023-05-15T16:19:11.558 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_policy.ko 2023-05-15T16:19:11.558 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9049 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_quota.ko 2023-05-15T16:19:11.558 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_rateest.ko 2023-05-15T16:19:11.559 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7761 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_realm.ko 2023-05-15T16:19:11.559 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36065 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_recent.ko 2023-05-15T16:19:11.559 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12897 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_sctp.ko 2023-05-15T16:19:11.559 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_set.ko 2023-05-15T16:19:11.559 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_socket.ko 2023-05-15T16:19:11.559 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9009 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_state.ko 2023-05-15T16:19:11.559 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_statistic.ko 2023-05-15T16:19:11.559 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8313 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_string.ko 2023-05-15T16:19:11.560 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8129 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_tcpmss.ko 2023-05-15T16:19:11.560 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13305 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_tcpudp.ko 2023-05-15T16:19:11.560 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_time.ko 2023-05-15T16:19:11.560 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8681 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netfilter/xt_u32.ko 2023-05-15T16:19:11.560 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netlink/ 2023-05-15T16:19:11.560 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 13417 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/netlink/netlink_diag.ko 2023-05-15T16:19:11.560 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/nsh/ 2023-05-15T16:19:11.561 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/nsh/nsh.ko 2023-05-15T16:19:11.561 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/openvswitch/ 2023-05-15T16:19:11.561 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 377353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/openvswitch/openvswitch.ko 2023-05-15T16:19:11.561 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9825 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/openvswitch/vport-geneve.ko 2023-05-15T16:19:11.561 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/openvswitch/vport-gre.ko 2023-05-15T16:19:11.561 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 11297 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/openvswitch/vport-vxlan.ko 2023-05-15T16:19:11.561 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/packet/ 2023-05-15T16:19:11.561 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/packet/af_packet_diag.ko 2023-05-15T16:19:11.562 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/phonet/ 2023-05-15T16:19:11.562 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 109633 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/phonet/phonet.ko 2023-05-15T16:19:11.562 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 54353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/phonet/pn_pep.ko 2023-05-15T16:19:11.562 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/rds/ 2023-05-15T16:19:11.562 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 248545 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/rds/rds.ko 2023-05-15T16:19:11.562 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 164641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/rds/rds_rdma.ko 2023-05-15T16:19:11.562 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 66441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/rds/rds_tcp.ko 2023-05-15T16:19:11.562 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/rxrpc/ 2023-05-15T16:19:11.563 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 805849 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/rxrpc/rxrpc.ko 2023-05-15T16:19:11.563 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/ 2023-05-15T16:19:11.563 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_csum.ko 2023-05-15T16:19:11.563 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23105 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_gact.ko 2023-05-15T16:19:11.563 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 25185 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_ipt.ko 2023-05-15T16:19:11.563 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33569 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_mirred.ko 2023-05-15T16:19:11.563 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22929 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_nat.ko 2023-05-15T16:19:11.563 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 39593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_pedit.ko 2023-05-15T16:19:11.564 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 31561 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_police.ko 2023-05-15T16:19:11.564 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_simple.ko 2023-05-15T16:19:11.564 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35921 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_skbedit.ko 2023-05-15T16:19:11.564 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 35625 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/act_vlan.ko 2023-05-15T16:19:11.564 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/cls_basic.ko 2023-05-15T16:19:11.564 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32409 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/cls_bpf.ko 2023-05-15T16:19:11.564 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18729 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/cls_cgroup.ko 2023-05-15T16:19:11.565 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/cls_flow.ko 2023-05-15T16:19:11.565 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29809 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/cls_fw.ko 2023-05-15T16:19:11.565 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 36793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/cls_route.ko 2023-05-15T16:19:11.565 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 57985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/cls_u32.ko 2023-05-15T16:19:11.565 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/em_cmp.ko 2023-05-15T16:19:11.565 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 12969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/em_ipset.ko 2023-05-15T16:19:11.565 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/em_meta.ko 2023-05-15T16:19:11.565 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 7393 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/em_nbyte.ko 2023-05-15T16:19:11.566 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10193 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/em_text.ko 2023-05-15T16:19:11.566 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 6753 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/em_u32.ko 2023-05-15T16:19:11.566 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19609 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_choke.ko 2023-05-15T16:19:11.566 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_codel.ko 2023-05-15T16:19:11.566 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 30441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_drr.ko 2023-05-15T16:19:11.566 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 29913 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_fq.ko 2023-05-15T16:19:11.566 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28953 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_fq_codel.ko 2023-05-15T16:19:11.566 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 32145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_gred.ko 2023-05-15T16:19:11.567 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 44345 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_hfsc.ko 2023-05-15T16:19:11.567 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20369 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_hhf.ko 2023-05-15T16:19:11.567 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 63001 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_htb.ko 2023-05-15T16:19:11.567 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15249 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_ingress.ko 2023-05-15T16:19:11.567 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_mqprio.ko 2023-05-15T16:19:11.567 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9353 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_mqprio_lib.ko 2023-05-15T16:19:11.567 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23441 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_multiq.ko 2023-05-15T16:19:11.568 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 33329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_netem.ko 2023-05-15T16:19:11.568 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 23497 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_pie.ko 2023-05-15T16:19:11.568 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9833 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_plug.ko 2023-05-15T16:19:11.568 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22817 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_prio.ko 2023-05-15T16:19:11.568 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 43969 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_qfq.ko 2023-05-15T16:19:11.568 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 28697 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_red.ko 2023-05-15T16:19:11.568 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 24881 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_sfb.ko 2023-05-15T16:19:11.569 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 27985 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_sfq.ko 2023-05-15T16:19:11.569 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_tbf.ko 2023-05-15T16:19:11.569 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 26857 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sched/sch_teql.ko 2023-05-15T16:19:11.569 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sctp/ 2023-05-15T16:19:11.569 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 920945 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sctp/sctp.ko 2023-05-15T16:19:11.569 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 18601 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sctp/sctp_diag.ko 2023-05-15T16:19:11.569 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sunrpc/ 2023-05-15T16:19:11.569 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sunrpc/auth_gss/ 2023-05-15T16:19:11.570 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 327521 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-05-15T16:19:11.570 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 61329 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-05-15T16:19:11.570 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 1405641 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sunrpc/sunrpc.ko 2023-05-15T16:19:11.570 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sunrpc/xprtrdma/ 2023-05-15T16:19:11.570 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 681905 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-05-15T16:19:11.570 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/tipc/ 2023-05-15T16:19:11.570 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 9593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/tipc/diag.ko 2023-05-15T16:19:11.570 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 853201 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/tipc/tipc.ko 2023-05-15T16:19:11.571 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/unix/ 2023-05-15T16:19:11.571 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 15233 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/unix/unix_diag.ko 2023-05-15T16:19:11.571 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/vmw_vsock/ 2023-05-15T16:19:11.571 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 78425 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-05-15T16:19:11.571 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 67537 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-05-15T16:19:11.571 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 82401 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/vmw_vsock/vsock.ko 2023-05-15T16:19:11.571 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10273 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/vmw_vsock/vsock_diag.ko 2023-05-15T16:19:11.571 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 16713 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/vmw_vsock/vsock_loopback.ko 2023-05-15T16:19:11.572 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/x25/ 2023-05-15T16:19:11.572 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 124593 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/x25/x25.ko 2023-05-15T16:19:11.572 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/xfrm/ 2023-05-15T16:19:11.572 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 20793 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/xfrm/xfrm_algo.ko 2023-05-15T16:19:11.572 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 19745 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/xfrm/xfrm_ipcomp.ko 2023-05-15T16:19:11.572 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 101145 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/net/xfrm/xfrm_user.ko 2023-05-15T16:19:11.572 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/virt/ 2023-05-15T16:19:11.573 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/virt/lib/ 2023-05-15T16:19:11.573 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 14433 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/kernel/virt/lib/irqbypass.ko 2023-05-15T16:19:11.573 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 636465 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.alias 2023-05-15T16:19:11.573 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 622282 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.alias.bin 2023-05-15T16:19:11.573 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 8260 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.builtin 2023-05-15T16:19:11.573 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 22530 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.builtin.alias.bin 2023-05-15T16:19:11.573 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 10532 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.builtin.bin 2023-05-15T16:19:11.573 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 70097 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.builtin.modinfo 2023-05-15T16:19:11.574 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 146789 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.dep 2023-05-15T16:19:11.574 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 233606 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.dep.bin 2023-05-15T16:19:11.574 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 210 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.devname 2023-05-15T16:19:11.574 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 73038 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.order 2023-05-15T16:19:11.574 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 879 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.softdep 2023-05-15T16:19:11.574 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 251751 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.symbols 2023-05-15T16:19:11.574 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 306320 2023-05-15 02:23 ./lib/modules/6.3.0-g7312ab6f53ec/modules.symbols.bin 2023-05-15T16:19:11.574 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./usr/ 2023-05-15T16:19:11.575 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./usr/share/ 2023-05-15T16:19:11.575 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./usr/share/doc/ 2023-05-15T16:19:11.575 INFO:teuthology.orchestra.run.smithi171.stdout:drwxr-xr-x root/root 0 2023-05-15 02:23 ./usr/share/doc/linux-image-6.3.0-g7312ab6f53ec/ 2023-05-15T16:19:11.575 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 169 2023-05-15 02:23 ./usr/share/doc/linux-image-6.3.0-g7312ab6f53ec/changelog.Debian.gz 2023-05-15T16:19:11.575 INFO:teuthology.orchestra.run.smithi171.stdout:-rw-r--r-- root/root 691 2023-05-15 02:23 ./usr/share/doc/linux-image-6.3.0-g7312ab6f53ec/copyright 2023-05-15T16:19:11.576 DEBUG:teuthology.task.kernel:get_image_version: 6.3.0-g7312ab6f53ec 2023-05-15T16:19:11.576 INFO:teuthology.task.kernel:searching for kernel 6.3.0-g7312ab6f53ec 2023-05-15T16:19:11.577 DEBUG:teuthology.orchestra.run.smithi171:> egrep '(submenu|menuentry.*6.3.0-g7312ab6f53ec).*{' /boot/grub/grub.cfg 2023-05-15T16:19:11.583 INFO:teuthology.orchestra.run.smithi171.stdout:submenu 'Advanced options for Ubuntu' $menuentry_id_option 'gnulinux-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-05-15T16:19:11.583 INFO:teuthology.orchestra.run.smithi171.stdout: menuentry 'Ubuntu, with Linux 6.3.0-g7312ab6f53ec' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.3.0-g7312ab6f53ec-advanced-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-05-15T16:19:11.583 INFO:teuthology.orchestra.run.smithi171.stdout: menuentry 'Ubuntu, with Linux 6.3.0-g7312ab6f53ec (recovery mode)' --class ubuntu --class gnu-linux --class gnu --class os $menuentry_id_option 'gnulinux-6.3.0-g7312ab6f53ec-recovery-7e9e2103-8bb7-4452-b35a-3b1230743254' { 2023-05-15T16:19:11.584 INFO:teuthology.task.kernel:submenu_title:Advanced options for Ubuntu> 2023-05-15T16:19:11.584 INFO:teuthology.task.kernel:default_title:Ubuntu, with Linux 6.3.0-g7312ab6f53ec 2023-05-15T16:19:11.584 DEBUG:teuthology.orchestra.run.smithi171:> /bin/echo -e 'cat </dev/null && sudo chmod a+x -- '/etc/grub.d/01_ceph_kernel.tmp~' && sudo mv -- '/etc/grub.d/01_ceph_kernel.tmp~' /etc/grub.d/01_ceph_kernel && sudo update-grub && rm /tmp/linux-image.deb && ( sleep 1 && sudo shutdown -r now & ) 2023-05-15T16:19:11.625 DEBUG:teuthology.task.kernel:Waiting for install on ubuntu@smithi171.front.sepia.ceph.com to complete... 2023-05-15T16:19:12.072 INFO:teuthology.orchestra.run.smithi171.stderr:Sourcing file `/etc/default/grub' 2023-05-15T16:19:12.073 INFO:teuthology.orchestra.run.smithi171.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-05-15T16:19:12.080 INFO:teuthology.orchestra.run.smithi171.stderr:Generating grub configuration file ... 2023-05-15T16:19:12.277 INFO:teuthology.orchestra.run.smithi171.stderr:Found linux image: /boot/vmlinuz-6.3.0-g7312ab6f53ec 2023-05-15T16:19:12.283 INFO:teuthology.orchestra.run.smithi171.stderr:Found initrd image: /boot/initrd.img-6.3.0-g7312ab6f53ec 2023-05-15T16:19:12.528 INFO:teuthology.orchestra.run.smithi171.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2023-05-15T16:19:12.534 INFO:teuthology.orchestra.run.smithi171.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2023-05-15T16:19:12.572 INFO:teuthology.orchestra.run.smithi171.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2023-05-15T16:19:12.577 INFO:teuthology.orchestra.run.smithi171.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2023-05-15T16:19:12.697 INFO:teuthology.orchestra.run.smithi171.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2023-05-15T16:19:12.697 INFO:teuthology.orchestra.run.smithi171.stderr:Systems on them will not be added to the GRUB boot configuration. 2023-05-15T16:19:12.697 INFO:teuthology.orchestra.run.smithi171.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2023-05-15T16:19:12.706 INFO:teuthology.orchestra.run.smithi171.stderr:done 2023-05-15T16:19:43.813 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-05-15T16:19:43.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2023-05-15T16:19:43.814 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-15T16:20:02.288 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2023-05-15T16:20:32.290 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2023-05-15T16:20:32.291 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-15T16:21:32.292 DEBUG:teuthology.orchestra.remote:timed out 2023-05-15T16:22:02.294 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2023-05-15T16:22:02.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-15T16:22:02.630 DEBUG:teuthology.orchestra.run.smithi171:> true 2023-05-15T16:22:03.352 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2023-05-15T16:22:03.352 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.3.0-g7312ab6f53ec"... 2023-05-15T16:22:03.353 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2023-05-15T16:22:03.401 INFO:teuthology.orchestra.run.smithi171.stdout:6.3.0-g7312ab6f53ec 2023-05-15T16:22:03.401 DEBUG:teuthology.task.kernel:current kernel version is 6.3.0-g7312ab6f53ec vs 6.3.0-g7312ab6f53ec 2023-05-15T16:22:03.401 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-05-15T16:22:03.402 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-05-15T16:22:04.403 DEBUG:teuthology.parallel:result is None 2023-05-15T16:22:04.404 INFO:teuthology.run_tasks:Running task internal.base... 2023-05-15T16:22:04.411 INFO:teuthology.task.internal:Creating test directory... 2023-05-15T16:22:04.411 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-15T16:22:04.414 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-15T16:22:04.416 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-05-15T16:22:04.424 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-05-15T16:22:04.460 INFO:teuthology.run_tasks:Running task internal.archive... 2023-05-15T16:22:04.501 INFO:teuthology.task.internal:Creating archive directory... 2023-05-15T16:22:04.501 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-15T16:22:04.504 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-15T16:22:04.506 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-05-15T16:22:04.532 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-05-15T16:22:04.544 INFO:teuthology.task.internal:Enabling coredump saving... 2023-05-15T16:22:04.544 DEBUG:teuthology.orchestra.run.smithi062:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-15T16:22:04.569 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-15T16:22:04.570 DEBUG:teuthology.orchestra.run.smithi161:> test -f /run/.containerenv -o -f /.dockerenv 2023-05-15T16:22:04.575 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-15T16:22:04.575 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-15T16:22:04.615 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-15T16:22:04.621 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-05-15T16:22:04.653 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-15T16:22:04.659 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-15T16:22:04.672 INFO:teuthology.orchestra.run.smithi161.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-15T16:22:04.678 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-15T16:22:04.696 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-15T16:22:04.717 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-05-15T16:22:04.719 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-05-15T16:22:04.727 INFO:teuthology.task.internal:Configuring sudo... 2023-05-15T16:22:04.728 DEBUG:teuthology.orchestra.run.smithi062:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-15T16:22:04.731 DEBUG:teuthology.orchestra.run.smithi161:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-15T16:22:04.733 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-05-15T16:22:04.752 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-05-15T16:22:04.761 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-05-15T16:22:04.762 DEBUG:teuthology.orchestra.run.smithi062:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-15T16:22:04.786 DEBUG:teuthology.orchestra.run.smithi161:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-15T16:22:04.792 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-05-15T16:22:04.805 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-15T16:22:04.838 DEBUG:teuthology.orchestra.run.smithi062:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-15T16:22:04.885 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:22:04.887 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-15T16:22:04.946 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-15T16:22:04.951 DEBUG:teuthology.orchestra.run.smithi161:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-15T16:22:04.999 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-05-15T16:22:05.000 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-15T16:22:05.058 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-05-15T16:22:05.066 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-05-15T16:22:05.117 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2023-05-15T16:22:05.118 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-05-15T16:22:05.187 DEBUG:teuthology.orchestra.run.smithi062:> sudo service rsyslog restart 2023-05-15T16:22:05.190 DEBUG:teuthology.orchestra.run.smithi161:> sudo service rsyslog restart 2023-05-15T16:22:05.192 DEBUG:teuthology.orchestra.run.smithi171:> sudo service rsyslog restart 2023-05-15T16:22:05.327 INFO:teuthology.run_tasks:Running task internal.timer... 2023-05-15T16:22:05.335 INFO:teuthology.task.internal:Starting timer... 2023-05-15T16:22:05.336 INFO:teuthology.run_tasks:Running task pcp... 2023-05-15T16:22:05.396 INFO:teuthology.run_tasks:Running task selinux... 2023-05-15T16:22:05.439 DEBUG:teuthology.task.selinux:Excluding smithi062: OS 'ubuntu' does not support SELinux 2023-05-15T16:22:05.440 DEBUG:teuthology.task.selinux:Excluding smithi161: OS 'ubuntu' does not support SELinux 2023-05-15T16:22:05.440 DEBUG:teuthology.task.selinux:Excluding smithi171: OS 'ubuntu' does not support SELinux 2023-05-15T16:22:05.441 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-05-15T16:22:05.441 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-05-15T16:22:05.441 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-05-15T16:22:05.441 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-05-15T16:22:05.488 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-05-15T16:22:05.488 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-05-15T16:22:05.509 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-05-15T16:22:05.511 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi062.front.sepia.ceph.com,smithi161.front.sepia.ceph.com,smithi171.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-05-15T16:33:33.779 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi062.front.sepia.ceph.com'), Remote(name='ubuntu@smithi161.front.sepia.ceph.com'), Remote(name='ubuntu@smithi171.front.sepia.ceph.com')] 2023-05-15T16:33:33.781 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi062.front.sepia.ceph.com' 2023-05-15T16:33:33.782 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi062.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-15T16:33:33.860 DEBUG:teuthology.orchestra.run.smithi062:> true 2023-05-15T16:33:33.984 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi161.front.sepia.ceph.com' 2023-05-15T16:33:33.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi161.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-15T16:33:34.066 DEBUG:teuthology.orchestra.run.smithi161:> true 2023-05-15T16:33:34.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2023-05-15T16:33:34.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-05-15T16:33:34.285 DEBUG:teuthology.orchestra.run.smithi171:> true 2023-05-15T16:33:34.423 INFO:teuthology.run_tasks:Running task clock... 2023-05-15T16:33:34.434 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-05-15T16:33:34.434 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-15T16:33:34.435 DEBUG:teuthology.orchestra.run.smithi062:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-15T16:33:34.437 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-15T16:33:34.438 DEBUG:teuthology.orchestra.run.smithi161:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-15T16:33:34.440 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-05-15T16:33:34.440 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-05-15T16:33:34.465 INFO:teuthology.orchestra.run.smithi062.stdout:15 May 16:33:34 ntpd[27462]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-05-15T16:33:34.465 INFO:teuthology.orchestra.run.smithi062.stdout:15 May 16:33:34 ntpd[27462]: Command line: ntpd -gq 2023-05-15T16:33:34.466 INFO:teuthology.orchestra.run.smithi062.stdout:15 May 16:33:34 ntpd[27462]: ---------------------------------------------------- 2023-05-15T16:33:34.466 INFO:teuthology.orchestra.run.smithi062.stdout:15 May 16:33:34 ntpd[27462]: ntp-4 is maintained by Network Time Foundation, 2023-05-15T16:33:34.466 INFO:teuthology.orchestra.run.smithi062.stdout:15 May 16:33:34 ntpd[27462]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-05-15T16:33:34.466 INFO:teuthology.orchestra.run.smithi062.stdout:15 May 16:33:34 ntpd[27462]: corporation. Support and training for ntp-4 are 2023-05-15T16:33:34.467 INFO:teuthology.orchestra.run.smithi062.stdout:15 May 16:33:34 ntpd[27462]: available at https://www.nwtime.org/support 2023-05-15T16:33:34.467 INFO:teuthology.orchestra.run.smithi062.stdout:15 May 16:33:34 ntpd[27462]: ---------------------------------------------------- 2023-05-15T16:33:34.468 INFO:teuthology.orchestra.run.smithi062.stdout:15 May 16:33:34 ntpd[27462]: proto: precision = 0.063 usec (-24) 2023-05-15T16:33:34.469 INFO:teuthology.orchestra.run.smithi062.stdout:15 May 16:33:34 ntpd[27462]: basedate set to 2022-02-04 2023-05-15T16:33:34.469 INFO:teuthology.orchestra.run.smithi062.stdout:15 May 16:33:34 ntpd[27462]: gps base set to 2022-02-06 (week 2196) 2023-05-15T16:33:34.470 INFO:teuthology.orchestra.run.smithi062.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-15T16:33:34.470 INFO:teuthology.orchestra.run.smithi062.stdout:15 May 16:33:34 ntpd[27462]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-15T16:33:34.471 INFO:teuthology.orchestra.run.smithi062.stdout:15 May 16:33:34 ntpd[27462]: restrict ::: KOD does nothing without LIMITED. 2023-05-15T16:33:34.471 INFO:teuthology.orchestra.run.smithi062.stderr:restrict ::: KOD does nothing without LIMITED. 2023-05-15T16:33:34.472 INFO:teuthology.orchestra.run.smithi062.stdout:15 May 16:33:34 ntpd[27462]: Listen and drop on 0 v6wildcard [::]:123 2023-05-15T16:33:34.473 INFO:teuthology.orchestra.run.smithi062.stdout:15 May 16:33:34 ntpd[27462]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-05-15T16:33:34.473 INFO:teuthology.orchestra.run.smithi062.stdout:15 May 16:33:34 ntpd[27462]: Listen normally on 2 lo 127.0.0.1:123 2023-05-15T16:33:34.474 INFO:teuthology.orchestra.run.smithi062.stdout:15 May 16:33:34 ntpd[27462]: Listen normally on 3 enp3s0f1 172.21.15.62:123 2023-05-15T16:33:34.474 INFO:teuthology.orchestra.run.smithi062.stdout:15 May 16:33:34 ntpd[27462]: Listen normally on 4 lo [::1]:123 2023-05-15T16:33:34.474 INFO:teuthology.orchestra.run.smithi062.stdout:15 May 16:33:34 ntpd[27462]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:febb:d1c3%5]:123 2023-05-15T16:33:34.474 INFO:teuthology.orchestra.run.smithi062.stdout:15 May 16:33:34 ntpd[27462]: Listening on routing socket on fd #22 for interface updates 2023-05-15T16:33:34.476 INFO:teuthology.orchestra.run.smithi161.stdout:15 May 16:33:34 ntpd[27526]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-05-15T16:33:34.476 INFO:teuthology.orchestra.run.smithi161.stdout:15 May 16:33:34 ntpd[27526]: Command line: ntpd -gq 2023-05-15T16:33:34.477 INFO:teuthology.orchestra.run.smithi161.stdout:15 May 16:33:34 ntpd[27526]: ---------------------------------------------------- 2023-05-15T16:33:34.477 INFO:teuthology.orchestra.run.smithi161.stdout:15 May 16:33:34 ntpd[27526]: ntp-4 is maintained by Network Time Foundation, 2023-05-15T16:33:34.477 INFO:teuthology.orchestra.run.smithi161.stdout:15 May 16:33:34 ntpd[27526]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-05-15T16:33:34.478 INFO:teuthology.orchestra.run.smithi161.stdout:15 May 16:33:34 ntpd[27526]: corporation. Support and training for ntp-4 are 2023-05-15T16:33:34.478 INFO:teuthology.orchestra.run.smithi161.stdout:15 May 16:33:34 ntpd[27526]: available at https://www.nwtime.org/support 2023-05-15T16:33:34.478 INFO:teuthology.orchestra.run.smithi161.stdout:15 May 16:33:34 ntpd[27526]: ---------------------------------------------------- 2023-05-15T16:33:34.479 INFO:teuthology.orchestra.run.smithi161.stdout:15 May 16:33:34 ntpd[27526]: proto: precision = 0.060 usec (-24) 2023-05-15T16:33:34.479 INFO:teuthology.orchestra.run.smithi161.stdout:15 May 16:33:34 ntpd[27526]: basedate set to 2022-02-04 2023-05-15T16:33:34.480 INFO:teuthology.orchestra.run.smithi161.stdout:15 May 16:33:34 ntpd[27526]: gps base set to 2022-02-06 (week 2196) 2023-05-15T16:33:34.481 INFO:teuthology.orchestra.run.smithi161.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-15T16:33:34.481 INFO:teuthology.orchestra.run.smithi161.stdout:15 May 16:33:34 ntpd[27526]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-15T16:33:34.482 INFO:teuthology.orchestra.run.smithi161.stdout:15 May 16:33:34 ntpd[27526]: restrict ::: KOD does nothing without LIMITED. 2023-05-15T16:33:34.483 INFO:teuthology.orchestra.run.smithi161.stderr:restrict ::: KOD does nothing without LIMITED. 2023-05-15T16:33:34.484 INFO:teuthology.orchestra.run.smithi161.stdout:15 May 16:33:34 ntpd[27526]: Listen and drop on 0 v6wildcard [::]:123 2023-05-15T16:33:34.484 INFO:teuthology.orchestra.run.smithi161.stdout:15 May 16:33:34 ntpd[27526]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-05-15T16:33:34.484 INFO:teuthology.orchestra.run.smithi161.stdout:15 May 16:33:34 ntpd[27526]: Listen normally on 2 lo 127.0.0.1:123 2023-05-15T16:33:34.484 INFO:teuthology.orchestra.run.smithi161.stdout:15 May 16:33:34 ntpd[27526]: Listen normally on 3 enp3s0f1 172.21.15.161:123 2023-05-15T16:33:34.485 INFO:teuthology.orchestra.run.smithi161.stdout:15 May 16:33:34 ntpd[27526]: Listen normally on 4 lo [::1]:123 2023-05-15T16:33:34.485 INFO:teuthology.orchestra.run.smithi161.stdout:15 May 16:33:34 ntpd[27526]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7251%5]:123 2023-05-15T16:33:34.485 INFO:teuthology.orchestra.run.smithi161.stdout:15 May 16:33:34 ntpd[27526]: Listening on routing socket on fd #22 for interface updates 2023-05-15T16:33:34.504 INFO:teuthology.orchestra.run.smithi171.stdout:15 May 16:33:34 ntpd[27032]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2023-05-15T16:33:34.504 INFO:teuthology.orchestra.run.smithi171.stdout:15 May 16:33:34 ntpd[27032]: Command line: ntpd -gq 2023-05-15T16:33:34.505 INFO:teuthology.orchestra.run.smithi171.stdout:15 May 16:33:34 ntpd[27032]: ---------------------------------------------------- 2023-05-15T16:33:34.505 INFO:teuthology.orchestra.run.smithi171.stdout:15 May 16:33:34 ntpd[27032]: ntp-4 is maintained by Network Time Foundation, 2023-05-15T16:33:34.505 INFO:teuthology.orchestra.run.smithi171.stdout:15 May 16:33:34 ntpd[27032]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2023-05-15T16:33:34.505 INFO:teuthology.orchestra.run.smithi171.stdout:15 May 16:33:34 ntpd[27032]: corporation. Support and training for ntp-4 are 2023-05-15T16:33:34.505 INFO:teuthology.orchestra.run.smithi171.stdout:15 May 16:33:34 ntpd[27032]: available at https://www.nwtime.org/support 2023-05-15T16:33:34.505 INFO:teuthology.orchestra.run.smithi171.stdout:15 May 16:33:34 ntpd[27032]: ---------------------------------------------------- 2023-05-15T16:33:34.506 INFO:teuthology.orchestra.run.smithi171.stdout:15 May 16:33:34 ntpd[27032]: proto: precision = 0.042 usec (-24) 2023-05-15T16:33:34.506 INFO:teuthology.orchestra.run.smithi171.stdout:15 May 16:33:34 ntpd[27032]: basedate set to 2022-02-04 2023-05-15T16:33:34.506 INFO:teuthology.orchestra.run.smithi171.stdout:15 May 16:33:34 ntpd[27032]: gps base set to 2022-02-06 (week 2196) 2023-05-15T16:33:34.506 INFO:teuthology.orchestra.run.smithi171.stdout:15 May 16:33:34 ntpd[27032]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-15T16:33:34.507 INFO:teuthology.orchestra.run.smithi171.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-05-15T16:33:34.507 INFO:teuthology.orchestra.run.smithi171.stderr:restrict ::: KOD does nothing without LIMITED. 2023-05-15T16:33:34.508 INFO:teuthology.orchestra.run.smithi171.stdout:15 May 16:33:34 ntpd[27032]: restrict ::: KOD does nothing without LIMITED. 2023-05-15T16:33:34.508 INFO:teuthology.orchestra.run.smithi171.stdout:15 May 16:33:34 ntpd[27032]: Listen and drop on 0 v6wildcard [::]:123 2023-05-15T16:33:34.508 INFO:teuthology.orchestra.run.smithi171.stdout:15 May 16:33:34 ntpd[27032]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-05-15T16:33:34.508 INFO:teuthology.orchestra.run.smithi171.stdout:15 May 16:33:34 ntpd[27032]: Listen normally on 2 lo 127.0.0.1:123 2023-05-15T16:33:34.508 INFO:teuthology.orchestra.run.smithi171.stdout:15 May 16:33:34 ntpd[27032]: Listen normally on 3 enp3s0f1 172.21.15.171:123 2023-05-15T16:33:34.509 INFO:teuthology.orchestra.run.smithi171.stdout:15 May 16:33:34 ntpd[27032]: Listen normally on 4 lo [::1]:123 2023-05-15T16:33:34.509 INFO:teuthology.orchestra.run.smithi171.stdout:15 May 16:33:34 ntpd[27032]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f6d%5]:123 2023-05-15T16:33:34.509 INFO:teuthology.orchestra.run.smithi171.stdout:15 May 16:33:34 ntpd[27032]: Listening on routing socket on fd #22 for interface updates 2023-05-15T16:33:35.469 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:35 ntpd[27526]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:35.470 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:35 ntpd[27526]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:35.504 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:35 ntpd[27032]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:35.505 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:35 ntpd[27032]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:35.505 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:35 ntpd[27032]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:35.505 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:35 ntpd[27032]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:35.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:35 ntpd[27032]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:35.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:35 ntpd[27032]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:35.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:35 ntpd[27032]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:35.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:35 ntpd[27032]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:35.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:35 ntpd[27032]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:35.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:35 ntpd[27032]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:35.507 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:35 ntpd[27032]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:35.507 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:35 ntpd[27032]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:36.465 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:36 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:36.466 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:36 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:36.466 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:36 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:36.466 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:36 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:36.466 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:36 ntpd[27462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:36.466 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:36 ntpd[27462]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:36.470 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:36 ntpd[27526]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:36.470 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:36 ntpd[27526]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:36.470 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:36 ntpd[27526]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:36.470 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:36 ntpd[27526]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:36.470 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:36 ntpd[27526]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:36.470 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:36 ntpd[27526]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:36.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:36 ntpd[27526]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:36.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:36 ntpd[27526]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:36.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:36 ntpd[27526]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:36.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:36 ntpd[27526]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:36.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:36 ntpd[27526]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:36.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:36 ntpd[27526]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:37.505 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:37 ntpd[27032]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:37.505 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:37 ntpd[27032]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:37.505 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:37 ntpd[27032]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:37.505 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:37 ntpd[27032]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:37.505 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:37 ntpd[27032]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:37.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:37 ntpd[27032]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:37.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:37 ntpd[27032]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:37.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:37 ntpd[27032]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:37.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:37 ntpd[27032]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:37.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:37 ntpd[27032]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:37.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:37 ntpd[27032]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:37.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:37 ntpd[27032]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:38.466 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:38 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:38.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:38 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:38.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:38 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:38.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:38 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:38.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:38 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:38.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:38 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:38.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:38 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:38.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:38 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:38 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:38 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:38 ntpd[27462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:38 ntpd[27462]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:38 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:38 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:38.468 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:38 ntpd[27462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:38 ntpd[27462]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:38 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:38 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:38 ntpd[27462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:38.469 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:38 ntpd[27462]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:38.470 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:38 ntpd[27526]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:38.470 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:38 ntpd[27526]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:38.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:38 ntpd[27526]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:38.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:38 ntpd[27526]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:38.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:38 ntpd[27526]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:38.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:38 ntpd[27526]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:38.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:38 ntpd[27526]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:38.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:38 ntpd[27526]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:38.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:38 ntpd[27526]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:38.472 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:38 ntpd[27526]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:38.472 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:38 ntpd[27526]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:38.472 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:38 ntpd[27526]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:39.470 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:39 ntpd[27526]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:39.470 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:39 ntpd[27526]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:39.470 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:39 ntpd[27526]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:39.470 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:39 ntpd[27526]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:39.470 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:39 ntpd[27526]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:39.470 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:39 ntpd[27526]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:39.505 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:39 ntpd[27032]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:39.505 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:39 ntpd[27032]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:39.505 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:39 ntpd[27032]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:39.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:39 ntpd[27032]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:39.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:39 ntpd[27032]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:39.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:39 ntpd[27032]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:39.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:39 ntpd[27032]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:39.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:39 ntpd[27032]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:39.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:39 ntpd[27032]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:39.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:39 ntpd[27032]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:39.507 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:39 ntpd[27032]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:39.507 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:39 ntpd[27032]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:39.507 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:39 ntpd[27032]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:39.507 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:39 ntpd[27032]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:39.507 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:39 ntpd[27032]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:39.507 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:39 ntpd[27032]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:39.507 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:39 ntpd[27032]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:39.507 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:39 ntpd[27032]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:39.508 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:39 ntpd[27032]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:39.508 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:39 ntpd[27032]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:40.466 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:40 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:40 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:40 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:40 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:40 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:40 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:40 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:40.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:40 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:40 ntpd[27462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:40 ntpd[27462]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:40 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:40 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:40 ntpd[27462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:40 ntpd[27462]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:40 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:40.468 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:40 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:40.469 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:40 ntpd[27462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:40.469 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:40 ntpd[27462]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:40.470 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:40 ntpd[27526]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:40.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:40 ntpd[27526]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:40.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:40 ntpd[27526]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:40.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:40 ntpd[27526]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:40.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:40 ntpd[27526]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:40.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:40 ntpd[27526]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:40.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:40 ntpd[27526]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:40.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:40 ntpd[27526]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:40.472 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:40 ntpd[27526]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:40.472 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:40 ntpd[27526]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:40.472 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:40 ntpd[27526]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:40.472 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:40 ntpd[27526]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:41.469 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:41 ntpd[27526]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:41.470 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:41 ntpd[27526]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:41.470 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:41 ntpd[27526]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:41.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:41 ntpd[27526]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:41.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:41 ntpd[27526]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:41.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:41 ntpd[27526]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:41.505 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:41 ntpd[27032]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:41.505 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:41 ntpd[27032]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:41.505 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:41 ntpd[27032]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:41.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:41 ntpd[27032]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:41.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:41 ntpd[27032]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:41.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:41 ntpd[27032]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:41.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:41 ntpd[27032]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:41.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:41 ntpd[27032]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:41.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:41 ntpd[27032]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:41.506 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:41 ntpd[27032]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:41.507 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:41 ntpd[27032]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:41.507 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:41 ntpd[27032]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:41.507 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:41 ntpd[27032]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:41.507 INFO:teuthology.orchestra.run.smithi171.stdout:15 May 16:33:41 ntpd[27032]: ntpd: time slew -0.000440 s 2023-05-15T16:33:41.507 INFO:teuthology.orchestra.run.smithi171.stdout:ntpd: time slew -0.000440s 2023-05-15T16:33:41.508 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:41 ntpd[27032]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:41.508 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:41 ntpd[27032]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-05-15T16:33:41.508 INFO:teuthology.orchestra.run.smithi171.stderr:15 May 16:33:41 ntpd[27032]: can't open /var/log/ntpstats/loopstats.20230515: Permission denied 2023-05-15T16:33:41.621 INFO:teuthology.orchestra.run.smithi171.stdout: remote refid st t when poll reach delay offset jitter 2023-05-15T16:33:41.621 INFO:teuthology.orchestra.run.smithi171.stdout:============================================================================== 2023-05-15T16:33:41.621 INFO:teuthology.orchestra.run.smithi171.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-15T16:33:41.622 INFO:teuthology.orchestra.run.smithi171.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-15T16:33:41.622 INFO:teuthology.orchestra.run.smithi171.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-15T16:33:41.622 INFO:teuthology.orchestra.run.smithi171.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-15T16:33:42.466 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:42 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:42.466 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:42 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:42.466 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:42 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:42.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:42 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:42.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:42 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:42.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:42 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:42.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:42 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:42.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:42 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:42.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:42 ntpd[27462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:42.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:42 ntpd[27462]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:42.467 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:42 ntpd[27462]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:42.468 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:42 ntpd[27462]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:42.468 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:42 ntpd[27462]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:42.468 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:42 ntpd[27462]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:42.468 INFO:teuthology.orchestra.run.smithi062.stdout:15 May 16:33:42 ntpd[27462]: ntpd: time slew -0.004295 s 2023-05-15T16:33:42.469 INFO:teuthology.orchestra.run.smithi062.stdout:ntpd: time slew -0.004295s 2023-05-15T16:33:42.469 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:42 ntpd[27462]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-05-15T16:33:42.469 INFO:teuthology.orchestra.run.smithi062.stderr:15 May 16:33:42 ntpd[27462]: can't open /var/log/ntpstats/loopstats.20230515: Permission denied 2023-05-15T16:33:42.470 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:42 ntpd[27526]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:42.470 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:42 ntpd[27526]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:42.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:42 ntpd[27526]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:42.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:42 ntpd[27526]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:42.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:42 ntpd[27526]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-05-15T16:33:42.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:42 ntpd[27526]: can't open /var/log/ntpstats/rawstats.20230515: Permission denied 2023-05-15T16:33:42.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:42 ntpd[27526]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-05-15T16:33:42.471 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:42 ntpd[27526]: can't open /var/log/ntpstats/peerstats.20230515: Permission denied 2023-05-15T16:33:42.472 INFO:teuthology.orchestra.run.smithi161.stdout:15 May 16:33:42 ntpd[27526]: ntpd: time slew -0.008483 s 2023-05-15T16:33:42.472 INFO:teuthology.orchestra.run.smithi161.stdout:ntpd: time slew -0.008483s 2023-05-15T16:33:42.472 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:42 ntpd[27526]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-05-15T16:33:42.472 INFO:teuthology.orchestra.run.smithi161.stderr:15 May 16:33:42 ntpd[27526]: can't open /var/log/ntpstats/loopstats.20230515: Permission denied 2023-05-15T16:33:42.550 INFO:teuthology.orchestra.run.smithi062.stdout: remote refid st t when poll reach delay offset jitter 2023-05-15T16:33:42.550 INFO:teuthology.orchestra.run.smithi062.stdout:============================================================================== 2023-05-15T16:33:42.550 INFO:teuthology.orchestra.run.smithi062.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-15T16:33:42.551 INFO:teuthology.orchestra.run.smithi062.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-15T16:33:42.551 INFO:teuthology.orchestra.run.smithi062.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-15T16:33:42.551 INFO:teuthology.orchestra.run.smithi062.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-15T16:33:42.625 INFO:teuthology.orchestra.run.smithi161.stdout: remote refid st t when poll reach delay offset jitter 2023-05-15T16:33:42.625 INFO:teuthology.orchestra.run.smithi161.stdout:============================================================================== 2023-05-15T16:33:42.625 INFO:teuthology.orchestra.run.smithi161.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-15T16:33:42.625 INFO:teuthology.orchestra.run.smithi161.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-15T16:33:42.625 INFO:teuthology.orchestra.run.smithi161.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-15T16:33:42.625 INFO:teuthology.orchestra.run.smithi161.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2023-05-15T16:33:42.626 INFO:teuthology.run_tasks:Running task install... 2023-05-15T16:33:42.634 DEBUG:teuthology.task.install:project ceph 2023-05-15T16:33:42.635 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'ef2746e02c24971e8f0b792fa43f63ba4ae04ec2'}} 2023-05-15T16:33:42.635 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ef2746e02c24971e8f0b792fa43f63ba4ae04ec2'} 2023-05-15T16:33:42.635 INFO:teuthology.task.install:Using flavor: default 2023-05-15T16:33:42.641 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-05-15T16:33:42.641 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-05-15T16:33:42.642 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-key list | grep Ceph 2023-05-15T16:33:42.643 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-key list | grep Ceph 2023-05-15T16:33:42.644 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-key list | grep Ceph 2023-05-15T16:33:42.704 INFO:teuthology.orchestra.run.smithi062.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-05-15T16:33:42.733 INFO:teuthology.orchestra.run.smithi062.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-05-15T16:33:42.733 INFO:teuthology.orchestra.run.smithi062.stdout:uid [ unknown] Ceph.com (release key) 2023-05-15T16:33:42.734 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-05-15T16:33:42.734 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-05-15T16:33:42.734 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ef2746e02c24971e8f0b792fa43f63ba4ae04ec2 2023-05-15T16:33:42.738 INFO:teuthology.orchestra.run.smithi161.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-05-15T16:33:42.742 INFO:teuthology.orchestra.run.smithi171.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2023-05-15T16:33:42.766 INFO:teuthology.orchestra.run.smithi161.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-05-15T16:33:42.767 INFO:teuthology.orchestra.run.smithi161.stdout:uid [ unknown] Ceph.com (release key) 2023-05-15T16:33:42.767 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-05-15T16:33:42.767 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-05-15T16:33:42.767 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ef2746e02c24971e8f0b792fa43f63ba4ae04ec2 2023-05-15T16:33:42.790 INFO:teuthology.orchestra.run.smithi171.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-05-15T16:33:42.790 INFO:teuthology.orchestra.run.smithi171.stdout:uid [ unknown] Ceph.com (release key) 2023-05-15T16:33:42.798 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2023-05-15T16:33:42.798 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2023-05-15T16:33:42.798 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ef2746e02c24971e8f0b792fa43f63ba4ae04ec2 2023-05-15T16:33:42.881 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default/ 2023-05-15T16:33:42.881 INFO:teuthology.task.install.deb:Package version is 18.0.0-3097-gef2746e0-1jammy 2023-05-15T16:33:42.900 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default/ 2023-05-15T16:33:42.901 INFO:teuthology.task.install.deb:Package version is 18.0.0-3097-gef2746e0-1jammy 2023-05-15T16:33:42.932 INFO:teuthology.task.install.deb:Pulling from https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default/ 2023-05-15T16:33:42.932 INFO:teuthology.task.install.deb:Package version is 18.0.0-3097-gef2746e0-1jammy 2023-05-15T16:33:42.999 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:33:43.000 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-05-15T16:33:43.006 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-05-15T16:33:43.007 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-05-15T16:33:43.014 DEBUG:teuthology.orchestra.run.smithi062:> sudo apt-get update 2023-05-15T16:33:43.021 DEBUG:teuthology.orchestra.run.smithi161:> sudo apt-get update 2023-05-15T16:33:43.038 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2023-05-15T16:33:43.038 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-05-15T16:33:43.056 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-get update 2023-05-15T16:33:43.236 INFO:teuthology.orchestra.run.smithi062.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy InRelease 2023-05-15T16:33:43.243 INFO:teuthology.orchestra.run.smithi161.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy InRelease 2023-05-15T16:33:43.257 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-05-15T16:33:43.264 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-05-15T16:33:43.281 INFO:teuthology.orchestra.run.smithi062.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy Release.gpg 2023-05-15T16:33:43.283 INFO:teuthology.orchestra.run.smithi171.stdout:Ign:1 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy InRelease 2023-05-15T16:33:43.288 INFO:teuthology.orchestra.run.smithi161.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy Release.gpg 2023-05-15T16:33:43.302 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2023-05-15T16:33:43.304 INFO:teuthology.orchestra.run.smithi171.stdout:Get:2 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2023-05-15T16:33:43.308 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-05-15T16:33:43.326 INFO:teuthology.orchestra.run.smithi171.stdout:Ign:3 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy Release.gpg 2023-05-15T16:33:43.328 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-15T16:33:43.328 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-05-15T16:33:43.333 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-05-15T16:33:43.338 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:5 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-05-15T16:33:43.341 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2023-05-15T16:33:43.348 INFO:teuthology.orchestra.run.smithi171.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.4 kB] 2023-05-15T16:33:43.367 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-15T16:33:43.367 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2023-05-15T16:33:43.388 INFO:teuthology.orchestra.run.smithi171.stdout:Get:7 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2023-05-15T16:33:43.401 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-05-15T16:33:43.434 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-05-15T16:33:43.483 INFO:teuthology.orchestra.run.smithi062.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-05-15T16:33:43.516 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-05-15T16:33:43.722 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 28.5 kB in 1s (54.2 kB/s) 2023-05-15T16:33:43.930 INFO:teuthology.orchestra.run.smithi171.stdout:Fetched 28.5 kB in 1s (42.8 kB/s) 2023-05-15T16:33:44.531 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2023-05-15T16:33:44.548 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3097-gef2746e0-1jammy cephadm=18.0.0-3097-gef2746e0-1jammy ceph-mds=18.0.0-3097-gef2746e0-1jammy ceph-mgr=18.0.0-3097-gef2746e0-1jammy ceph-common=18.0.0-3097-gef2746e0-1jammy ceph-fuse=18.0.0-3097-gef2746e0-1jammy ceph-test=18.0.0-3097-gef2746e0-1jammy ceph-volume=18.0.0-3097-gef2746e0-1jammy radosgw=18.0.0-3097-gef2746e0-1jammy python3-rados=18.0.0-3097-gef2746e0-1jammy python3-rgw=18.0.0-3097-gef2746e0-1jammy python3-cephfs=18.0.0-3097-gef2746e0-1jammy python3-rbd=18.0.0-3097-gef2746e0-1jammy libcephfs2=18.0.0-3097-gef2746e0-1jammy libcephfs-dev=18.0.0-3097-gef2746e0-1jammy librados2=18.0.0-3097-gef2746e0-1jammy librbd1=18.0.0-3097-gef2746e0-1jammy rbd-fuse=18.0.0-3097-gef2746e0-1jammy python3-cephfs=18.0.0-3097-gef2746e0-1jammy cephfs-shell=18.0.0-3097-gef2746e0-1jammy cephfs-top=18.0.0-3097-gef2746e0-1jammy cephfs-mirror=18.0.0-3097-gef2746e0-1jammy 2023-05-15T16:33:44.611 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2023-05-15T16:33:44.766 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2023-05-15T16:33:44.785 DEBUG:teuthology.orchestra.run.smithi171:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3097-gef2746e0-1jammy cephadm=18.0.0-3097-gef2746e0-1jammy ceph-mds=18.0.0-3097-gef2746e0-1jammy ceph-mgr=18.0.0-3097-gef2746e0-1jammy ceph-common=18.0.0-3097-gef2746e0-1jammy ceph-fuse=18.0.0-3097-gef2746e0-1jammy ceph-test=18.0.0-3097-gef2746e0-1jammy ceph-volume=18.0.0-3097-gef2746e0-1jammy radosgw=18.0.0-3097-gef2746e0-1jammy python3-rados=18.0.0-3097-gef2746e0-1jammy python3-rgw=18.0.0-3097-gef2746e0-1jammy python3-cephfs=18.0.0-3097-gef2746e0-1jammy python3-rbd=18.0.0-3097-gef2746e0-1jammy libcephfs2=18.0.0-3097-gef2746e0-1jammy libcephfs-dev=18.0.0-3097-gef2746e0-1jammy librados2=18.0.0-3097-gef2746e0-1jammy librbd1=18.0.0-3097-gef2746e0-1jammy rbd-fuse=18.0.0-3097-gef2746e0-1jammy python3-cephfs=18.0.0-3097-gef2746e0-1jammy cephfs-shell=18.0.0-3097-gef2746e0-1jammy cephfs-top=18.0.0-3097-gef2746e0-1jammy cephfs-mirror=18.0.0-3097-gef2746e0-1jammy 2023-05-15T16:33:44.794 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2023-05-15T16:33:44.795 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2023-05-15T16:33:44.857 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2023-05-15T16:33:44.964 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2023-05-15T16:33:44.964 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-15T16:33:44.964 INFO:teuthology.orchestra.run.smithi062.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-15T16:33:44.965 INFO:teuthology.orchestra.run.smithi062.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-15T16:33:44.965 INFO:teuthology.orchestra.run.smithi062.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-05-15T16:33:44.965 INFO:teuthology.orchestra.run.smithi062.stdout: python2.7-minimal 2023-05-15T16:33:44.965 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-15T16:33:44.966 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2023-05-15T16:33:44.966 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-05-15T16:33:44.966 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-05-15T16:33:44.967 INFO:teuthology.orchestra.run.smithi062.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-15T16:33:44.967 INFO:teuthology.orchestra.run.smithi062.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-05-15T16:33:44.967 INFO:teuthology.orchestra.run.smithi062.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-05-15T16:33:44.968 INFO:teuthology.orchestra.run.smithi062.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-05-15T16:33:44.968 INFO:teuthology.orchestra.run.smithi062.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-05-15T16:33:44.968 INFO:teuthology.orchestra.run.smithi062.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-05-15T16:33:44.968 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-05-15T16:33:44.968 INFO:teuthology.orchestra.run.smithi062.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-05-15T16:33:44.968 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-05-15T16:33:44.968 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-05-15T16:33:44.969 INFO:teuthology.orchestra.run.smithi062.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-05-15T16:33:44.969 INFO:teuthology.orchestra.run.smithi062.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-05-15T16:33:44.969 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-05-15T16:33:44.969 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-05-15T16:33:44.969 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-05-15T16:33:44.969 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-05-15T16:33:44.969 INFO:teuthology.orchestra.run.smithi062.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-05-15T16:33:44.969 INFO:teuthology.orchestra.run.smithi062.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-05-15T16:33:44.970 INFO:teuthology.orchestra.run.smithi062.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-05-15T16:33:44.970 INFO:teuthology.orchestra.run.smithi062.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-05-15T16:33:44.970 INFO:teuthology.orchestra.run.smithi062.stdout: qttranslations5-l10n socat xmlstarlet 2023-05-15T16:33:44.970 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2023-05-15T16:33:44.970 INFO:teuthology.orchestra.run.smithi062.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-05-15T16:33:44.970 INFO:teuthology.orchestra.run.smithi062.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-05-15T16:33:44.971 INFO:teuthology.orchestra.run.smithi062.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-05-15T16:33:44.971 INFO:teuthology.orchestra.run.smithi062.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-05-15T16:33:44.971 INFO:teuthology.orchestra.run.smithi062.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-05-15T16:33:44.971 INFO:teuthology.orchestra.run.smithi062.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-05-15T16:33:44.971 INFO:teuthology.orchestra.run.smithi062.stdout: python3-watchdog 2023-05-15T16:33:44.971 INFO:teuthology.orchestra.run.smithi062.stdout:Recommended packages: 2023-05-15T16:33:44.971 INFO:teuthology.orchestra.run.smithi062.stdout: btrfs-tools 2023-05-15T16:33:45.008 INFO:teuthology.orchestra.run.smithi171.stdout:Building dependency tree... 2023-05-15T16:33:45.009 INFO:teuthology.orchestra.run.smithi171.stdout:Reading state information... 2023-05-15T16:33:45.074 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2023-05-15T16:33:45.075 INFO:teuthology.orchestra.run.smithi062.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-05-15T16:33:45.075 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-05-15T16:33:45.075 INFO:teuthology.orchestra.run.smithi062.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-05-15T16:33:45.076 INFO:teuthology.orchestra.run.smithi062.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-05-15T16:33:45.076 INFO:teuthology.orchestra.run.smithi062.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-15T16:33:45.077 INFO:teuthology.orchestra.run.smithi062.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-05-15T16:33:45.077 INFO:teuthology.orchestra.run.smithi062.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-05-15T16:33:45.077 INFO:teuthology.orchestra.run.smithi062.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-05-15T16:33:45.077 INFO:teuthology.orchestra.run.smithi062.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-05-15T16:33:45.077 INFO:teuthology.orchestra.run.smithi062.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-05-15T16:33:45.077 INFO:teuthology.orchestra.run.smithi062.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-05-15T16:33:45.077 INFO:teuthology.orchestra.run.smithi062.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-05-15T16:33:45.078 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-05-15T16:33:45.078 INFO:teuthology.orchestra.run.smithi062.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-05-15T16:33:45.078 INFO:teuthology.orchestra.run.smithi062.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-05-15T16:33:45.078 INFO:teuthology.orchestra.run.smithi062.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-05-15T16:33:45.078 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-05-15T16:33:45.078 INFO:teuthology.orchestra.run.smithi062.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-05-15T16:33:45.078 INFO:teuthology.orchestra.run.smithi062.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-05-15T16:33:45.078 INFO:teuthology.orchestra.run.smithi062.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-05-15T16:33:45.079 INFO:teuthology.orchestra.run.smithi062.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-05-15T16:33:45.079 INFO:teuthology.orchestra.run.smithi062.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-05-15T16:33:45.079 INFO:teuthology.orchestra.run.smithi062.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-05-15T16:33:45.079 INFO:teuthology.orchestra.run.smithi062.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-05-15T16:33:45.079 INFO:teuthology.orchestra.run.smithi062.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-05-15T16:33:45.079 INFO:teuthology.orchestra.run.smithi062.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-05-15T16:33:45.079 INFO:teuthology.orchestra.run.smithi062.stdout: socat xmlstarlet 2023-05-15T16:33:45.150 INFO:teuthology.orchestra.run.smithi171.stdout:The following packages were automatically installed and are no longer required: 2023-05-15T16:33:45.151 INFO:teuthology.orchestra.run.smithi171.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-15T16:33:45.151 INFO:teuthology.orchestra.run.smithi171.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-15T16:33:45.151 INFO:teuthology.orchestra.run.smithi171.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-15T16:33:45.151 INFO:teuthology.orchestra.run.smithi171.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-15T16:33:45.153 INFO:teuthology.orchestra.run.smithi171.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-15T16:33:45.153 INFO:teuthology.orchestra.run.smithi171.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-15T16:33:45.153 INFO:teuthology.orchestra.run.smithi171.stdout:The following additional packages will be installed: 2023-05-15T16:33:45.153 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-05-15T16:33:45.153 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-05-15T16:33:45.154 INFO:teuthology.orchestra.run.smithi171.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-15T16:33:45.154 INFO:teuthology.orchestra.run.smithi171.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-05-15T16:33:45.154 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-05-15T16:33:45.154 INFO:teuthology.orchestra.run.smithi171.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-05-15T16:33:45.154 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-05-15T16:33:45.154 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-05-15T16:33:45.154 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-05-15T16:33:45.155 INFO:teuthology.orchestra.run.smithi171.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-05-15T16:33:45.155 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-05-15T16:33:45.155 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-05-15T16:33:45.155 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-05-15T16:33:45.155 INFO:teuthology.orchestra.run.smithi171.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-05-15T16:33:45.155 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-05-15T16:33:45.155 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-05-15T16:33:45.156 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-05-15T16:33:45.156 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-05-15T16:33:45.156 INFO:teuthology.orchestra.run.smithi171.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-05-15T16:33:45.156 INFO:teuthology.orchestra.run.smithi171.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-05-15T16:33:45.156 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-05-15T16:33:45.156 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-05-15T16:33:45.156 INFO:teuthology.orchestra.run.smithi171.stdout: qttranslations5-l10n socat xmlstarlet 2023-05-15T16:33:45.157 INFO:teuthology.orchestra.run.smithi171.stdout:Suggested packages: 2023-05-15T16:33:45.157 INFO:teuthology.orchestra.run.smithi171.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-05-15T16:33:45.157 INFO:teuthology.orchestra.run.smithi171.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-05-15T16:33:45.157 INFO:teuthology.orchestra.run.smithi171.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-05-15T16:33:45.158 INFO:teuthology.orchestra.run.smithi171.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-05-15T16:33:45.158 INFO:teuthology.orchestra.run.smithi171.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-05-15T16:33:45.158 INFO:teuthology.orchestra.run.smithi171.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-05-15T16:33:45.158 INFO:teuthology.orchestra.run.smithi171.stdout: python3-watchdog 2023-05-15T16:33:45.158 INFO:teuthology.orchestra.run.smithi171.stdout:Recommended packages: 2023-05-15T16:33:45.158 INFO:teuthology.orchestra.run.smithi171.stdout: btrfs-tools 2023-05-15T16:33:45.220 INFO:teuthology.orchestra.run.smithi062.stdout:0 upgraded, 115 newly installed, 0 to remove and 145 not upgraded. 2023-05-15T16:33:45.221 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 180 MB of archives. 2023-05-15T16:33:45.221 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 808 MB of additional disk space will be used. 2023-05-15T16:33:45.221 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-3097-gef2746e0-1jammy [3,401 kB] 2023-05-15T16:33:45.268 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-05-15T16:33:45.287 INFO:teuthology.orchestra.run.smithi171.stdout:The following NEW packages will be installed: 2023-05-15T16:33:45.287 INFO:teuthology.orchestra.run.smithi171.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-05-15T16:33:45.287 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-05-15T16:33:45.287 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-05-15T16:33:45.287 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-05-15T16:33:45.289 INFO:teuthology.orchestra.run.smithi171.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-15T16:33:45.289 INFO:teuthology.orchestra.run.smithi171.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-05-15T16:33:45.289 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-05-15T16:33:45.289 INFO:teuthology.orchestra.run.smithi171.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-05-15T16:33:45.289 INFO:teuthology.orchestra.run.smithi171.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-05-15T16:33:45.289 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-05-15T16:33:45.289 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-05-15T16:33:45.290 INFO:teuthology.orchestra.run.smithi171.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-05-15T16:33:45.290 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-05-15T16:33:45.290 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-05-15T16:33:45.290 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-05-15T16:33:45.290 INFO:teuthology.orchestra.run.smithi171.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-05-15T16:33:45.290 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-05-15T16:33:45.290 INFO:teuthology.orchestra.run.smithi171.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-05-15T16:33:45.291 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-05-15T16:33:45.291 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-05-15T16:33:45.291 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-05-15T16:33:45.291 INFO:teuthology.orchestra.run.smithi171.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-05-15T16:33:45.291 INFO:teuthology.orchestra.run.smithi171.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-05-15T16:33:45.291 INFO:teuthology.orchestra.run.smithi171.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-05-15T16:33:45.291 INFO:teuthology.orchestra.run.smithi171.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-05-15T16:33:45.291 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-05-15T16:33:45.292 INFO:teuthology.orchestra.run.smithi171.stdout: socat xmlstarlet 2023-05-15T16:33:45.366 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-05-15T16:33:45.412 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-05-15T16:33:45.433 INFO:teuthology.orchestra.run.smithi171.stdout:0 upgraded, 115 newly installed, 0 to remove and 145 not upgraded. 2023-05-15T16:33:45.433 INFO:teuthology.orchestra.run.smithi171.stdout:Need to get 180 MB of archives. 2023-05-15T16:33:45.433 INFO:teuthology.orchestra.run.smithi171.stdout:After this operation, 808 MB of additional disk space will be used. 2023-05-15T16:33:45.433 INFO:teuthology.orchestra.run.smithi171.stdout:Get:1 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-3097-gef2746e0-1jammy [3,401 kB] 2023-05-15T16:33:45.489 INFO:teuthology.orchestra.run.smithi171.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-05-15T16:33:45.510 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-3097-gef2746e0-1jammy [3,094 kB] 2023-05-15T16:33:45.576 INFO:teuthology.orchestra.run.smithi171.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-05-15T16:33:45.616 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-05-15T16:33:45.623 INFO:teuthology.orchestra.run.smithi171.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-05-15T16:33:45.657 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-05-15T16:33:45.659 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-3097-gef2746e0-1jammy [652 kB] 2023-05-15T16:33:45.691 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-3097-gef2746e0-1jammy [343 kB] 2023-05-15T16:33:45.713 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-3097-gef2746e0-1jammy [22.9 kB] 2023-05-15T16:33:45.714 INFO:teuthology.orchestra.run.smithi062.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-3097-gef2746e0-1jammy [164 kB] 2023-05-15T16:33:45.719 INFO:teuthology.orchestra.run.smithi062.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-3097-gef2746e0-1jammy [48.5 kB] 2023-05-15T16:33:45.721 INFO:teuthology.orchestra.run.smithi062.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-3097-gef2746e0-1jammy [318 kB] 2023-05-15T16:33:45.736 INFO:teuthology.orchestra.run.smithi062.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-05-15T16:33:45.743 INFO:teuthology.orchestra.run.smithi062.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-3097-gef2746e0-1jammy [5,839 kB] 2023-05-15T16:33:45.750 INFO:teuthology.orchestra.run.smithi062.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-05-15T16:33:45.789 INFO:teuthology.orchestra.run.smithi171.stdout:Get:5 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-3097-gef2746e0-1jammy [3,094 kB] 2023-05-15T16:33:45.818 INFO:teuthology.orchestra.run.smithi171.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-05-15T16:33:45.819 INFO:teuthology.orchestra.run.smithi062.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-05-15T16:33:45.862 INFO:teuthology.orchestra.run.smithi171.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-05-15T16:33:45.939 INFO:teuthology.orchestra.run.smithi171.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-05-15T16:33:45.950 INFO:teuthology.orchestra.run.smithi171.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-05-15T16:33:45.995 INFO:teuthology.orchestra.run.smithi171.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-05-15T16:33:46.044 INFO:teuthology.orchestra.run.smithi171.stdout:Get:11 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-3097-gef2746e0-1jammy [652 kB] 2023-05-15T16:33:46.048 INFO:teuthology.orchestra.run.smithi062.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-3097-gef2746e0-1jammy [102 kB] 2023-05-15T16:33:46.051 INFO:teuthology.orchestra.run.smithi062.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-3097-gef2746e0-1jammy [431 kB] 2023-05-15T16:33:46.064 INFO:teuthology.orchestra.run.smithi062.stdout:Get:20 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-3097-gef2746e0-1jammy [21.8 MB] 2023-05-15T16:33:46.125 INFO:teuthology.orchestra.run.smithi171.stdout:Get:12 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-3097-gef2746e0-1jammy [343 kB] 2023-05-15T16:33:46.137 INFO:teuthology.orchestra.run.smithi171.stdout:Get:13 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-3097-gef2746e0-1jammy [22.9 kB] 2023-05-15T16:33:46.137 INFO:teuthology.orchestra.run.smithi171.stdout:Get:14 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-3097-gef2746e0-1jammy [164 kB] 2023-05-15T16:33:46.165 INFO:teuthology.orchestra.run.smithi171.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-05-15T16:33:46.170 INFO:teuthology.orchestra.run.smithi062.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-05-15T16:33:46.173 INFO:teuthology.orchestra.run.smithi171.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-05-15T16:33:46.175 INFO:teuthology.orchestra.run.smithi171.stdout:Get:17 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-3097-gef2746e0-1jammy [48.5 kB] 2023-05-15T16:33:46.177 INFO:teuthology.orchestra.run.smithi171.stdout:Get:18 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-3097-gef2746e0-1jammy [318 kB] 2023-05-15T16:33:46.187 INFO:teuthology.orchestra.run.smithi171.stdout:Get:19 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-3097-gef2746e0-1jammy [5,839 kB] 2023-05-15T16:33:46.193 INFO:teuthology.orchestra.run.smithi062.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-05-15T16:33:46.200 INFO:teuthology.orchestra.run.smithi171.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-05-15T16:33:46.266 INFO:teuthology.orchestra.run.smithi062.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-05-15T16:33:46.280 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:7 http://archive.ubuntu.com/ubuntu jammy InRelease 2023-05-15T16:33:46.300 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2023-05-15T16:33:46.318 INFO:teuthology.orchestra.run.smithi161.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2023-05-15T16:33:46.373 INFO:teuthology.orchestra.run.smithi171.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-05-15T16:33:46.466 INFO:teuthology.orchestra.run.smithi062.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-05-15T16:33:46.568 INFO:teuthology.orchestra.run.smithi171.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-05-15T16:33:46.597 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 28.5 kB in 3s (8,412 B/s) 2023-05-15T16:33:46.691 INFO:teuthology.orchestra.run.smithi062.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-05-15T16:33:46.713 INFO:teuthology.orchestra.run.smithi171.stdout:Get:23 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-3097-gef2746e0-1jammy [102 kB] 2023-05-15T16:33:46.714 INFO:teuthology.orchestra.run.smithi171.stdout:Get:24 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-3097-gef2746e0-1jammy [431 kB] 2023-05-15T16:33:46.778 INFO:teuthology.orchestra.run.smithi171.stdout:Get:25 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-3097-gef2746e0-1jammy [21.8 MB] 2023-05-15T16:33:46.932 INFO:teuthology.orchestra.run.smithi171.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-05-15T16:33:46.939 INFO:teuthology.orchestra.run.smithi171.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-05-15T16:33:46.941 INFO:teuthology.orchestra.run.smithi171.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-05-15T16:33:46.953 INFO:teuthology.orchestra.run.smithi171.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-05-15T16:33:46.954 INFO:teuthology.orchestra.run.smithi171.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-05-15T16:33:46.956 INFO:teuthology.orchestra.run.smithi171.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-05-15T16:33:46.957 INFO:teuthology.orchestra.run.smithi171.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-05-15T16:33:46.960 INFO:teuthology.orchestra.run.smithi171.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-05-15T16:33:46.961 INFO:teuthology.orchestra.run.smithi171.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-05-15T16:33:47.125 INFO:teuthology.orchestra.run.smithi171.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-05-15T16:33:47.294 INFO:teuthology.orchestra.run.smithi062.stdout:Get:26 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-3097-gef2746e0-1jammy [6,821 kB] 2023-05-15T16:33:47.390 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2023-05-15T16:33:47.405 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=18.0.0-3097-gef2746e0-1jammy cephadm=18.0.0-3097-gef2746e0-1jammy ceph-mds=18.0.0-3097-gef2746e0-1jammy ceph-mgr=18.0.0-3097-gef2746e0-1jammy ceph-common=18.0.0-3097-gef2746e0-1jammy ceph-fuse=18.0.0-3097-gef2746e0-1jammy ceph-test=18.0.0-3097-gef2746e0-1jammy ceph-volume=18.0.0-3097-gef2746e0-1jammy radosgw=18.0.0-3097-gef2746e0-1jammy python3-rados=18.0.0-3097-gef2746e0-1jammy python3-rgw=18.0.0-3097-gef2746e0-1jammy python3-cephfs=18.0.0-3097-gef2746e0-1jammy python3-rbd=18.0.0-3097-gef2746e0-1jammy libcephfs2=18.0.0-3097-gef2746e0-1jammy libcephfs-dev=18.0.0-3097-gef2746e0-1jammy librados2=18.0.0-3097-gef2746e0-1jammy librbd1=18.0.0-3097-gef2746e0-1jammy rbd-fuse=18.0.0-3097-gef2746e0-1jammy python3-cephfs=18.0.0-3097-gef2746e0-1jammy cephfs-shell=18.0.0-3097-gef2746e0-1jammy cephfs-top=18.0.0-3097-gef2746e0-1jammy cephfs-mirror=18.0.0-3097-gef2746e0-1jammy 2023-05-15T16:33:47.455 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2023-05-15T16:33:47.558 INFO:teuthology.orchestra.run.smithi171.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-05-15T16:33:47.568 INFO:teuthology.orchestra.run.smithi171.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-05-15T16:33:47.574 INFO:teuthology.orchestra.run.smithi171.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-05-15T16:33:47.575 INFO:teuthology.orchestra.run.smithi062.stdout:Get:27 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-3097-gef2746e0-1jammy [225 kB] 2023-05-15T16:33:47.578 INFO:teuthology.orchestra.run.smithi171.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-05-15T16:33:47.581 INFO:teuthology.orchestra.run.smithi062.stdout:Get:28 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-3097-gef2746e0-1jammy [114 kB] 2023-05-15T16:33:47.584 INFO:teuthology.orchestra.run.smithi062.stdout:Get:29 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-3097-gef2746e0-1jammy [1,462 kB] 2023-05-15T16:33:47.595 INFO:teuthology.orchestra.run.smithi171.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-05-15T16:33:47.599 INFO:teuthology.orchestra.run.smithi171.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-05-15T16:33:47.601 INFO:teuthology.orchestra.run.smithi171.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-05-15T16:33:47.609 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2023-05-15T16:33:47.609 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2023-05-15T16:33:47.642 INFO:teuthology.orchestra.run.smithi171.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-05-15T16:33:47.656 INFO:teuthology.orchestra.run.smithi171.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-05-15T16:33:47.658 INFO:teuthology.orchestra.run.smithi062.stdout:Get:30 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-3097-gef2746e0-1jammy [9,865 kB] 2023-05-15T16:33:47.661 INFO:teuthology.orchestra.run.smithi171.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-05-15T16:33:47.747 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages were automatically installed and are no longer required: 2023-05-15T16:33:47.747 INFO:teuthology.orchestra.run.smithi161.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-15T16:33:47.747 INFO:teuthology.orchestra.run.smithi161.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-15T16:33:47.749 INFO:teuthology.orchestra.run.smithi161.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-15T16:33:47.749 INFO:teuthology.orchestra.run.smithi161.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-05-15T16:33:47.749 INFO:teuthology.orchestra.run.smithi161.stdout: python2.7-minimal 2023-05-15T16:33:47.749 INFO:teuthology.orchestra.run.smithi161.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-15T16:33:47.749 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2023-05-15T16:33:47.749 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-05-15T16:33:47.750 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2023-05-15T16:33:47.750 INFO:teuthology.orchestra.run.smithi161.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-15T16:33:47.750 INFO:teuthology.orchestra.run.smithi161.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2023-05-15T16:33:47.750 INFO:teuthology.orchestra.run.smithi161.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.16.0 nvme-cli 2023-05-15T16:33:47.750 INFO:teuthology.orchestra.run.smithi161.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2023-05-15T16:33:47.750 INFO:teuthology.orchestra.run.smithi161.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2023-05-15T16:33:47.751 INFO:teuthology.orchestra.run.smithi161.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2023-05-15T16:33:47.751 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2023-05-15T16:33:47.751 INFO:teuthology.orchestra.run.smithi161.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2023-05-15T16:33:47.751 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2023-05-15T16:33:47.751 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2023-05-15T16:33:47.751 INFO:teuthology.orchestra.run.smithi161.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2023-05-15T16:33:47.751 INFO:teuthology.orchestra.run.smithi161.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-05-15T16:33:47.752 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2023-05-15T16:33:47.752 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2023-05-15T16:33:47.752 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2023-05-15T16:33:47.752 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2023-05-15T16:33:47.752 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplejson python3-singledispatch python3-sklearn 2023-05-15T16:33:47.752 INFO:teuthology.orchestra.run.smithi161.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2023-05-15T16:33:47.752 INFO:teuthology.orchestra.run.smithi161.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2023-05-15T16:33:47.753 INFO:teuthology.orchestra.run.smithi161.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2023-05-15T16:33:47.753 INFO:teuthology.orchestra.run.smithi161.stdout: qttranslations5-l10n socat xmlstarlet 2023-05-15T16:33:47.753 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2023-05-15T16:33:47.753 INFO:teuthology.orchestra.run.smithi161.stdout: python3-influxdb python-jinja2-doc python3-beaker python-mako-doc 2023-05-15T16:33:47.753 INFO:teuthology.orchestra.run.smithi161.stdout: python-natsort-doc python-openssl-doc python3-openssl-dbg httpd-wsgi 2023-05-15T16:33:47.754 INFO:teuthology.orchestra.run.smithi161.stdout: libapache2-mod-python libapache2-mod-scgi libjs-mochikit python-pecan-doc 2023-05-15T16:33:47.754 INFO:teuthology.orchestra.run.smithi161.stdout: python-psutil-doc subversion python-pygments-doc python-pyinotify-doc 2023-05-15T16:33:47.754 INFO:teuthology.orchestra.run.smithi161.stdout: python3-socks python-requests-doc python3-dap python-sklearn-doc ipython3 2023-05-15T16:33:47.754 INFO:teuthology.orchestra.run.smithi161.stdout: python-waitress-doc python-webob-doc python-webtest-doc python-werkzeug-doc 2023-05-15T16:33:47.754 INFO:teuthology.orchestra.run.smithi161.stdout: python3-watchdog 2023-05-15T16:33:47.754 INFO:teuthology.orchestra.run.smithi161.stdout:Recommended packages: 2023-05-15T16:33:47.754 INFO:teuthology.orchestra.run.smithi161.stdout: btrfs-tools 2023-05-15T16:33:47.847 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2023-05-15T16:33:47.848 INFO:teuthology.orchestra.run.smithi161.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-05-15T16:33:47.848 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-05-15T16:33:47.848 INFO:teuthology.orchestra.run.smithi161.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-05-15T16:33:47.848 INFO:teuthology.orchestra.run.smithi161.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2023-05-15T16:33:47.850 INFO:teuthology.orchestra.run.smithi161.stdout: libdouble-conversion3 libfmt8 libjq1 liblttng-ust1 liboath0 libonig5 2023-05-15T16:33:47.850 INFO:teuthology.orchestra.run.smithi161.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2023-05-15T16:33:47.850 INFO:teuthology.orchestra.run.smithi161.stdout: libradosstriper1 librbd1 librdkafka1 librgw2 libsqlite3-mod-ceph 2023-05-15T16:33:47.851 INFO:teuthology.orchestra.run.smithi161.stdout: libthrift-0.16.0 nvme-cli python-asyncssh-doc python-babel-localedata 2023-05-15T16:33:47.851 INFO:teuthology.orchestra.run.smithi161.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2023-05-15T16:33:47.851 INFO:teuthology.orchestra.run.smithi161.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2023-05-15T16:33:47.851 INFO:teuthology.orchestra.run.smithi161.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2023-05-15T16:33:47.851 INFO:teuthology.orchestra.run.smithi161.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2023-05-15T16:33:47.851 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2023-05-15T16:33:47.852 INFO:teuthology.orchestra.run.smithi161.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2023-05-15T16:33:47.852 INFO:teuthology.orchestra.run.smithi161.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2023-05-15T16:33:47.853 INFO:teuthology.orchestra.run.smithi161.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2023-05-15T16:33:47.853 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2023-05-15T16:33:47.853 INFO:teuthology.orchestra.run.smithi161.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-05-15T16:33:47.853 INFO:teuthology.orchestra.run.smithi161.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2023-05-15T16:33:47.853 INFO:teuthology.orchestra.run.smithi161.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2023-05-15T16:33:47.854 INFO:teuthology.orchestra.run.smithi161.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2023-05-15T16:33:47.854 INFO:teuthology.orchestra.run.smithi161.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-05-15T16:33:47.854 INFO:teuthology.orchestra.run.smithi161.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2023-05-15T16:33:47.854 INFO:teuthology.orchestra.run.smithi161.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2023-05-15T16:33:47.855 INFO:teuthology.orchestra.run.smithi161.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2023-05-15T16:33:47.855 INFO:teuthology.orchestra.run.smithi161.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2023-05-15T16:33:47.855 INFO:teuthology.orchestra.run.smithi161.stdout: socat xmlstarlet 2023-05-15T16:33:47.916 INFO:teuthology.orchestra.run.smithi171.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-05-15T16:33:47.999 INFO:teuthology.orchestra.run.smithi171.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-05-15T16:33:48.034 INFO:teuthology.orchestra.run.smithi161.stdout:0 upgraded, 115 newly installed, 0 to remove and 145 not upgraded. 2023-05-15T16:33:48.034 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 180 MB of archives. 2023-05-15T16:33:48.034 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 808 MB of additional disk space will be used. 2023-05-15T16:33:48.035 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2023-05-15T16:33:48.059 INFO:teuthology.orchestra.run.smithi062.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-05-15T16:33:48.089 INFO:teuthology.orchestra.run.smithi171.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-05-15T16:33:48.117 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2023-05-15T16:33:48.123 INFO:teuthology.orchestra.run.smithi062.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-05-15T16:33:48.139 INFO:teuthology.orchestra.run.smithi062.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-05-15T16:33:48.146 INFO:teuthology.orchestra.run.smithi171.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-05-15T16:33:48.162 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2023-05-15T16:33:48.178 INFO:teuthology.orchestra.run.smithi062.stdout:Get:34 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-3097-gef2746e0-1jammy [31.5 MB] 2023-05-15T16:33:48.221 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 18.0.0-3097-gef2746e0-1jammy [3,401 kB] 2023-05-15T16:33:48.231 INFO:teuthology.orchestra.run.smithi062.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-05-15T16:33:48.235 INFO:teuthology.orchestra.run.smithi062.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-05-15T16:33:48.249 INFO:teuthology.orchestra.run.smithi062.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-05-15T16:33:48.262 INFO:teuthology.orchestra.run.smithi062.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-05-15T16:33:48.268 INFO:teuthology.orchestra.run.smithi171.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-05-15T16:33:48.279 INFO:teuthology.orchestra.run.smithi062.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-05-15T16:33:48.294 INFO:teuthology.orchestra.run.smithi062.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-05-15T16:33:48.358 INFO:teuthology.orchestra.run.smithi171.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-05-15T16:33:48.358 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libfmt8 amd64 8.1.1+ds1-2 [60.2 kB] 2023-05-15T16:33:48.375 INFO:teuthology.orchestra.run.smithi171.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-05-15T16:33:48.401 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2023-05-15T16:33:48.403 INFO:teuthology.orchestra.run.smithi171.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests all 2.25.1+dfsg-2 [47.9 kB] 2023-05-15T16:33:48.415 INFO:teuthology.orchestra.run.smithi171.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-05-15T16:33:48.453 INFO:teuthology.orchestra.run.smithi171.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-05-15T16:33:48.461 INFO:teuthology.orchestra.run.smithi171.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-05-15T16:33:48.467 INFO:teuthology.orchestra.run.smithi062.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-05-15T16:33:48.476 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2023-05-15T16:33:48.487 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2023-05-15T16:33:48.533 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2023-05-15T16:33:48.653 INFO:teuthology.orchestra.run.smithi171.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-05-15T16:33:48.706 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2023-05-15T16:33:48.719 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2023-05-15T16:33:48.742 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2023-05-15T16:33:48.743 INFO:teuthology.orchestra.run.smithi171.stdout:Get:58 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-3097-gef2746e0-1jammy [6,821 kB] 2023-05-15T16:33:48.919 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2023-05-15T16:33:49.114 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2023-05-15T16:33:49.256 INFO:teuthology.orchestra.run.smithi062.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-05-15T16:33:49.270 INFO:teuthology.orchestra.run.smithi062.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-05-15T16:33:49.272 INFO:teuthology.orchestra.run.smithi171.stdout:Get:59 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-3097-gef2746e0-1jammy [225 kB] 2023-05-15T16:33:49.278 INFO:teuthology.orchestra.run.smithi062.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-05-15T16:33:49.282 INFO:teuthology.orchestra.run.smithi171.stdout:Get:60 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-3097-gef2746e0-1jammy [114 kB] 2023-05-15T16:33:49.283 INFO:teuthology.orchestra.run.smithi062.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-05-15T16:33:49.304 INFO:teuthology.orchestra.run.smithi171.stdout:Get:61 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-3097-gef2746e0-1jammy [1,462 kB] 2023-05-15T16:33:49.307 INFO:teuthology.orchestra.run.smithi062.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-05-15T16:33:49.313 INFO:teuthology.orchestra.run.smithi062.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-05-15T16:33:49.315 INFO:teuthology.orchestra.run.smithi062.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-05-15T16:33:49.351 INFO:teuthology.orchestra.run.smithi062.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-05-15T16:33:49.370 INFO:teuthology.orchestra.run.smithi062.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-05-15T16:33:49.376 INFO:teuthology.orchestra.run.smithi062.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-05-15T16:33:49.409 INFO:teuthology.orchestra.run.smithi171.stdout:Get:62 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-3097-gef2746e0-1jammy [9,865 kB] 2023-05-15T16:33:49.466 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 18.0.0-3097-gef2746e0-1jammy [3,094 kB] 2023-05-15T16:33:49.497 INFO:teuthology.orchestra.run.smithi171.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-05-15T16:33:49.497 INFO:teuthology.orchestra.run.smithi171.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-05-15T16:33:49.498 INFO:teuthology.orchestra.run.smithi171.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-05-15T16:33:49.498 INFO:teuthology.orchestra.run.smithi171.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-05-15T16:33:49.498 INFO:teuthology.orchestra.run.smithi171.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-05-15T16:33:49.499 INFO:teuthology.orchestra.run.smithi171.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-05-15T16:33:49.500 INFO:teuthology.orchestra.run.smithi171.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-05-15T16:33:49.500 INFO:teuthology.orchestra.run.smithi171.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-05-15T16:33:49.503 INFO:teuthology.orchestra.run.smithi171.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-05-15T16:33:49.511 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2023-05-15T16:33:49.517 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2023-05-15T16:33:49.519 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2023-05-15T16:33:49.528 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2023-05-15T16:33:49.529 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2023-05-15T16:33:49.530 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2023-05-15T16:33:49.532 INFO:teuthology.orchestra.run.smithi161.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2023-05-15T16:33:49.534 INFO:teuthology.orchestra.run.smithi161.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2023-05-15T16:33:49.534 INFO:teuthology.orchestra.run.smithi161.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2023-05-15T16:33:49.576 INFO:teuthology.orchestra.run.smithi171.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-05-15T16:33:49.635 INFO:teuthology.orchestra.run.smithi062.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-05-15T16:33:49.700 INFO:teuthology.orchestra.run.smithi161.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2023-05-15T16:33:49.719 INFO:teuthology.orchestra.run.smithi062.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-05-15T16:33:49.743 INFO:teuthology.orchestra.run.smithi171.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-05-15T16:33:49.809 INFO:teuthology.orchestra.run.smithi062.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-05-15T16:33:49.867 INFO:teuthology.orchestra.run.smithi062.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-05-15T16:33:49.985 INFO:teuthology.orchestra.run.smithi062.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-05-15T16:33:50.071 INFO:teuthology.orchestra.run.smithi062.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-05-15T16:33:50.090 INFO:teuthology.orchestra.run.smithi062.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-05-15T16:33:50.119 INFO:teuthology.orchestra.run.smithi062.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests all 2.25.1+dfsg-2 [47.9 kB] 2023-05-15T16:33:50.131 INFO:teuthology.orchestra.run.smithi062.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-05-15T16:33:50.132 INFO:teuthology.orchestra.run.smithi161.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2023-05-15T16:33:50.142 INFO:teuthology.orchestra.run.smithi161.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2023-05-15T16:33:50.148 INFO:teuthology.orchestra.run.smithi161.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2023-05-15T16:33:50.151 INFO:teuthology.orchestra.run.smithi161.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2023-05-15T16:33:50.169 INFO:teuthology.orchestra.run.smithi062.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-05-15T16:33:50.169 INFO:teuthology.orchestra.run.smithi161.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-05-15T16:33:50.173 INFO:teuthology.orchestra.run.smithi161.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2023-05-15T16:33:50.175 INFO:teuthology.orchestra.run.smithi161.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2023-05-15T16:33:50.176 INFO:teuthology.orchestra.run.smithi062.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-05-15T16:33:50.216 INFO:teuthology.orchestra.run.smithi161.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2023-05-15T16:33:50.225 INFO:teuthology.orchestra.run.smithi171.stdout:Get:74 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-3097-gef2746e0-1jammy [31.5 MB] 2023-05-15T16:33:50.230 INFO:teuthology.orchestra.run.smithi161.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2023-05-15T16:33:50.235 INFO:teuthology.orchestra.run.smithi161.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2023-05-15T16:33:50.314 INFO:teuthology.orchestra.run.smithi161.stdout:Get:36 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 18.0.0-3097-gef2746e0-1jammy [652 kB] 2023-05-15T16:33:50.355 INFO:teuthology.orchestra.run.smithi062.stdout:Get:63 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-3097-gef2746e0-1jammy [3,596 B] 2023-05-15T16:33:50.356 INFO:teuthology.orchestra.run.smithi062.stdout:Get:64 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-3097-gef2746e0-1jammy [806 kB] 2023-05-15T16:33:50.372 INFO:teuthology.orchestra.run.smithi062.stdout:Get:65 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-3097-gef2746e0-1jammy [2,145 kB] 2023-05-15T16:33:50.418 INFO:teuthology.orchestra.run.smithi062.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-3097-gef2746e0-1jammy [96.3 kB] 2023-05-15T16:33:50.420 INFO:teuthology.orchestra.run.smithi062.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-3097-gef2746e0-1jammy [120 kB] 2023-05-15T16:33:50.424 INFO:teuthology.orchestra.run.smithi062.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-3097-gef2746e0-1jammy [1,860 kB] 2023-05-15T16:33:50.462 INFO:teuthology.orchestra.run.smithi171.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-05-15T16:33:50.467 INFO:teuthology.orchestra.run.smithi171.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-05-15T16:33:50.468 INFO:teuthology.orchestra.run.smithi171.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-05-15T16:33:50.489 INFO:teuthology.orchestra.run.smithi161.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2023-05-15T16:33:50.503 INFO:teuthology.orchestra.run.smithi161.stdout:Get:38 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 18.0.0-3097-gef2746e0-1jammy [343 kB] 2023-05-15T16:33:50.544 INFO:teuthology.orchestra.run.smithi171.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-05-15T16:33:50.545 INFO:teuthology.orchestra.run.smithi171.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-05-15T16:33:50.545 INFO:teuthology.orchestra.run.smithi171.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-05-15T16:33:50.546 INFO:teuthology.orchestra.run.smithi171.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-05-15T16:33:50.547 INFO:teuthology.orchestra.run.smithi171.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-05-15T16:33:50.547 INFO:teuthology.orchestra.run.smithi171.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-05-15T16:33:50.548 INFO:teuthology.orchestra.run.smithi171.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-05-15T16:33:50.560 INFO:teuthology.orchestra.run.smithi062.stdout:Get:69 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-3097-gef2746e0-1jammy [8,615 kB] 2023-05-15T16:33:50.571 INFO:teuthology.orchestra.run.smithi161.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2023-05-15T16:33:50.578 INFO:teuthology.orchestra.run.smithi161.stdout:Get:40 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 18.0.0-3097-gef2746e0-1jammy [22.9 kB] 2023-05-15T16:33:50.578 INFO:teuthology.orchestra.run.smithi161.stdout:Get:41 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 18.0.0-3097-gef2746e0-1jammy [164 kB] 2023-05-15T16:33:50.648 INFO:teuthology.orchestra.run.smithi161.stdout:Get:42 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 18.0.0-3097-gef2746e0-1jammy [48.5 kB] 2023-05-15T16:33:50.649 INFO:teuthology.orchestra.run.smithi161.stdout:Get:43 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 18.0.0-3097-gef2746e0-1jammy [318 kB] 2023-05-15T16:33:50.663 INFO:teuthology.orchestra.run.smithi161.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2023-05-15T16:33:50.713 INFO:teuthology.orchestra.run.smithi171.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-05-15T16:33:50.718 INFO:teuthology.orchestra.run.smithi161.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2023-05-15T16:33:50.741 INFO:teuthology.orchestra.run.smithi062.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-05-15T16:33:50.769 INFO:teuthology.orchestra.run.smithi161.stdout:Get:46 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 18.0.0-3097-gef2746e0-1jammy [5,839 kB] 2023-05-15T16:33:50.847 INFO:teuthology.orchestra.run.smithi161.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2023-05-15T16:33:50.937 INFO:teuthology.orchestra.run.smithi161.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2023-05-15T16:33:50.956 INFO:teuthology.orchestra.run.smithi161.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-urllib3 all 1.26.5-1~exp1 [96.4 kB] 2023-05-15T16:33:50.980 INFO:teuthology.orchestra.run.smithi062.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-05-15T16:33:50.981 INFO:teuthology.orchestra.run.smithi062.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-05-15T16:33:50.983 INFO:teuthology.orchestra.run.smithi062.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-05-15T16:33:50.983 INFO:teuthology.orchestra.run.smithi062.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-05-15T16:33:50.984 INFO:teuthology.orchestra.run.smithi062.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-05-15T16:33:50.985 INFO:teuthology.orchestra.run.smithi062.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-05-15T16:33:50.986 INFO:teuthology.orchestra.run.smithi062.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-05-15T16:33:50.986 INFO:teuthology.orchestra.run.smithi062.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-05-15T16:33:50.987 INFO:teuthology.orchestra.run.smithi161.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-requests all 2.25.1+dfsg-2 [47.9 kB] 2023-05-15T16:33:50.989 INFO:teuthology.orchestra.run.smithi062.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-05-15T16:33:50.997 INFO:teuthology.orchestra.run.smithi062.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-05-15T16:33:51.000 INFO:teuthology.orchestra.run.smithi161.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2023-05-15T16:33:51.033 INFO:teuthology.orchestra.run.smithi062.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-05-15T16:33:51.037 INFO:teuthology.orchestra.run.smithi161.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2023-05-15T16:33:51.047 INFO:teuthology.orchestra.run.smithi161.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2023-05-15T16:33:51.142 INFO:teuthology.orchestra.run.smithi062.stdout:Get:82 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-3097-gef2746e0-1jammy [3,724 B] 2023-05-15T16:33:51.145 INFO:teuthology.orchestra.run.smithi062.stdout:Get:83 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-3097-gef2746e0-1jammy [46.2 MB] 2023-05-15T16:33:51.191 INFO:teuthology.orchestra.run.smithi062.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-05-15T16:33:51.196 INFO:teuthology.orchestra.run.smithi062.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-05-15T16:33:51.197 INFO:teuthology.orchestra.run.smithi062.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-05-15T16:33:51.214 INFO:teuthology.orchestra.run.smithi171.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-05-15T16:33:51.234 INFO:teuthology.orchestra.run.smithi062.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-05-15T16:33:51.234 INFO:teuthology.orchestra.run.smithi062.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-05-15T16:33:51.236 INFO:teuthology.orchestra.run.smithi062.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-05-15T16:33:51.236 INFO:teuthology.orchestra.run.smithi062.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-05-15T16:33:51.237 INFO:teuthology.orchestra.run.smithi161.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2023-05-15T16:33:51.237 INFO:teuthology.orchestra.run.smithi062.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-05-15T16:33:51.238 INFO:teuthology.orchestra.run.smithi062.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-05-15T16:33:51.243 INFO:teuthology.orchestra.run.smithi171.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-05-15T16:33:51.266 INFO:teuthology.orchestra.run.smithi171.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-05-15T16:33:51.274 INFO:teuthology.orchestra.run.smithi062.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-05-15T16:33:51.275 INFO:teuthology.orchestra.run.smithi171.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-05-15T16:33:51.300 INFO:teuthology.orchestra.run.smithi062.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-05-15T16:33:51.352 INFO:teuthology.orchestra.run.smithi171.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-05-15T16:33:51.381 INFO:teuthology.orchestra.run.smithi062.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-05-15T16:33:51.385 INFO:teuthology.orchestra.run.smithi062.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-05-15T16:33:51.385 INFO:teuthology.orchestra.run.smithi171.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-05-15T16:33:51.386 INFO:teuthology.orchestra.run.smithi171.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-05-15T16:33:51.393 INFO:teuthology.orchestra.run.smithi062.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-05-15T16:33:51.394 INFO:teuthology.orchestra.run.smithi062.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-05-15T16:33:51.405 INFO:teuthology.orchestra.run.smithi062.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-05-15T16:33:51.415 INFO:teuthology.orchestra.run.smithi062.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-05-15T16:33:51.416 INFO:teuthology.orchestra.run.smithi062.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-05-15T16:33:51.423 INFO:teuthology.orchestra.run.smithi171.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-05-15T16:33:51.427 INFO:teuthology.orchestra.run.smithi062.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-05-15T16:33:51.435 INFO:teuthology.orchestra.run.smithi062.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-05-15T16:33:51.447 INFO:teuthology.orchestra.run.smithi171.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-05-15T16:33:51.451 INFO:teuthology.orchestra.run.smithi171.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-05-15T16:33:51.472 INFO:teuthology.orchestra.run.smithi062.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-05-15T16:33:51.557 INFO:teuthology.orchestra.run.smithi062.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-05-15T16:33:51.604 INFO:teuthology.orchestra.run.smithi062.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-05-15T16:33:51.605 INFO:teuthology.orchestra.run.smithi062.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-05-15T16:33:51.607 INFO:teuthology.orchestra.run.smithi062.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-05-15T16:33:51.626 INFO:teuthology.orchestra.run.smithi171.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-05-15T16:33:52.062 INFO:teuthology.orchestra.run.smithi161.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2023-05-15T16:33:52.064 INFO:teuthology.orchestra.run.smithi161.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jinja2 all 3.0.3-1 [108 kB] 2023-05-15T16:33:52.067 INFO:teuthology.orchestra.run.smithi161.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2023-05-15T16:33:52.069 INFO:teuthology.orchestra.run.smithi161.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2023-05-15T16:33:52.069 INFO:teuthology.orchestra.run.smithi161.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2023-05-15T16:33:52.071 INFO:teuthology.orchestra.run.smithi161.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2023-05-15T16:33:52.072 INFO:teuthology.orchestra.run.smithi161.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2023-05-15T16:33:52.073 INFO:teuthology.orchestra.run.smithi161.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2023-05-15T16:33:52.078 INFO:teuthology.orchestra.run.smithi161.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-05-15T16:33:52.143 INFO:teuthology.orchestra.run.smithi161.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2023-05-15T16:33:52.215 INFO:teuthology.orchestra.run.smithi171.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-05-15T16:33:52.216 INFO:teuthology.orchestra.run.smithi171.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-05-15T16:33:52.220 INFO:teuthology.orchestra.run.smithi171.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-05-15T16:33:52.310 INFO:teuthology.orchestra.run.smithi161.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2023-05-15T16:33:52.371 INFO:teuthology.orchestra.run.smithi161.stdout:Get:66 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 18.0.0-3097-gef2746e0-1jammy [102 kB] 2023-05-15T16:33:52.373 INFO:teuthology.orchestra.run.smithi161.stdout:Get:67 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 18.0.0-3097-gef2746e0-1jammy [431 kB] 2023-05-15T16:33:52.522 INFO:teuthology.orchestra.run.smithi161.stdout:Get:68 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 18.0.0-3097-gef2746e0-1jammy [21.8 MB] 2023-05-15T16:33:52.810 INFO:teuthology.orchestra.run.smithi171.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-3097-gef2746e0-1jammy [3,596 B] 2023-05-15T16:33:52.810 INFO:teuthology.orchestra.run.smithi171.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-3097-gef2746e0-1jammy [806 kB] 2023-05-15T16:33:52.847 INFO:teuthology.orchestra.run.smithi171.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-3097-gef2746e0-1jammy [2,145 kB] 2023-05-15T16:33:53.024 INFO:teuthology.orchestra.run.smithi161.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2023-05-15T16:33:53.029 INFO:teuthology.orchestra.run.smithi161.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2023-05-15T16:33:53.030 INFO:teuthology.orchestra.run.smithi161.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2023-05-15T16:33:53.039 INFO:teuthology.orchestra.run.smithi171.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-3097-gef2746e0-1jammy [96.3 kB] 2023-05-15T16:33:53.041 INFO:teuthology.orchestra.run.smithi171.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-3097-gef2746e0-1jammy [120 kB] 2023-05-15T16:33:53.046 INFO:teuthology.orchestra.run.smithi171.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-3097-gef2746e0-1jammy [1,860 kB] 2023-05-15T16:33:53.153 INFO:teuthology.orchestra.run.smithi161.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2023-05-15T16:33:53.154 INFO:teuthology.orchestra.run.smithi161.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2023-05-15T16:33:53.156 INFO:teuthology.orchestra.run.smithi161.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2023-05-15T16:33:53.158 INFO:teuthology.orchestra.run.smithi161.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2023-05-15T16:33:53.160 INFO:teuthology.orchestra.run.smithi161.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2023-05-15T16:33:53.201 INFO:teuthology.orchestra.run.smithi171.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-3097-gef2746e0-1jammy [8,615 kB] 2023-05-15T16:33:53.223 INFO:teuthology.orchestra.run.smithi161.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2023-05-15T16:33:53.390 INFO:teuthology.orchestra.run.smithi161.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2023-05-15T16:33:53.509 INFO:teuthology.orchestra.run.smithi161.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2023-05-15T16:33:53.816 INFO:teuthology.orchestra.run.smithi161.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2023-05-15T16:33:53.862 INFO:teuthology.orchestra.run.smithi161.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2023-05-15T16:33:53.887 INFO:teuthology.orchestra.run.smithi161.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2023-05-15T16:33:53.896 INFO:teuthology.orchestra.run.smithi161.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2023-05-15T16:33:53.928 INFO:teuthology.orchestra.run.smithi171.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-3097-gef2746e0-1jammy [3,724 B] 2023-05-15T16:33:53.929 INFO:teuthology.orchestra.run.smithi171.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-3097-gef2746e0-1jammy [46.2 MB] 2023-05-15T16:33:53.945 INFO:teuthology.orchestra.run.smithi161.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2023-05-15T16:33:53.970 INFO:teuthology.orchestra.run.smithi161.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2023-05-15T16:33:53.972 INFO:teuthology.orchestra.run.smithi161.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2023-05-15T16:33:54.010 INFO:teuthology.orchestra.run.smithi161.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2023-05-15T16:33:54.028 INFO:teuthology.orchestra.run.smithi161.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-05-15T16:33:54.195 INFO:teuthology.orchestra.run.smithi161.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2023-05-15T16:33:54.440 INFO:teuthology.orchestra.run.smithi062.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-3097-gef2746e0-1jammy [237 kB] 2023-05-15T16:33:54.445 INFO:teuthology.orchestra.run.smithi062.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-3097-gef2746e0-1jammy [213 kB] 2023-05-15T16:33:54.449 INFO:teuthology.orchestra.run.smithi062.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-3097-gef2746e0-1jammy [23.8 kB] 2023-05-15T16:33:54.504 INFO:teuthology.orchestra.run.smithi062.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-3097-gef2746e0-1jammy [13.3 kB] 2023-05-15T16:33:54.504 INFO:teuthology.orchestra.run.smithi062.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-3097-gef2746e0-1jammy [27.7 kB] 2023-05-15T16:33:54.505 INFO:teuthology.orchestra.run.smithi062.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-3097-gef2746e0-1jammy [11.5 MB] 2023-05-15T16:33:54.589 INFO:teuthology.orchestra.run.smithi161.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2023-05-15T16:33:54.813 INFO:teuthology.orchestra.run.smithi161.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2023-05-15T16:33:54.816 INFO:teuthology.orchestra.run.smithi161.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2023-05-15T16:33:54.825 INFO:teuthology.orchestra.run.smithi161.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2023-05-15T16:33:55.154 INFO:teuthology.orchestra.run.smithi062.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-3097-gef2746e0-1jammy [82.1 kB] 2023-05-15T16:33:55.725 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 180 MB in 10s (17.9 MB/s) 2023-05-15T16:33:55.863 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyperclip. 2023-05-15T16:33:55.938 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130502 files and directories currently installed.) 2023-05-15T16:33:55.943 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-05-15T16:33:55.986 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-05-15T16:33:56.398 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-wcwidth. 2023-05-15T16:33:56.419 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-05-15T16:33:56.456 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-15T16:33:56.487 INFO:teuthology.orchestra.run.smithi171.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-3097-gef2746e0-1jammy [237 kB] 2023-05-15T16:33:56.489 INFO:teuthology.orchestra.run.smithi171.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-3097-gef2746e0-1jammy [213 kB] 2023-05-15T16:33:56.491 INFO:teuthology.orchestra.run.smithi171.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-3097-gef2746e0-1jammy [23.8 kB] 2023-05-15T16:33:56.492 INFO:teuthology.orchestra.run.smithi171.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-3097-gef2746e0-1jammy [13.3 kB] 2023-05-15T16:33:56.493 INFO:teuthology.orchestra.run.smithi171.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-3097-gef2746e0-1jammy [27.7 kB] 2023-05-15T16:33:56.493 INFO:teuthology.orchestra.run.smithi171.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-3097-gef2746e0-1jammy [11.5 MB] 2023-05-15T16:33:56.742 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cmd2. 2023-05-15T16:33:56.763 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-05-15T16:33:56.792 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-05-15T16:33:56.812 INFO:teuthology.orchestra.run.smithi161.stdout:Get:94 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 18.0.0-3097-gef2746e0-1jammy [6,821 kB] 2023-05-15T16:33:57.024 INFO:teuthology.orchestra.run.smithi171.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-3097-gef2746e0-1jammy [82.1 kB] 2023-05-15T16:33:57.070 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libfmt8:amd64. 2023-05-15T16:33:57.091 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-05-15T16:33:57.187 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-15T16:33:57.352 INFO:teuthology.orchestra.run.smithi161.stdout:Get:95 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 18.0.0-3097-gef2746e0-1jammy [225 kB] 2023-05-15T16:33:57.359 INFO:teuthology.orchestra.run.smithi161.stdout:Get:96 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 18.0.0-3097-gef2746e0-1jammy [114 kB] 2023-05-15T16:33:57.371 INFO:teuthology.orchestra.run.smithi161.stdout:Get:97 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 18.0.0-3097-gef2746e0-1jammy [1,462 kB] 2023-05-15T16:33:57.469 INFO:teuthology.orchestra.run.smithi161.stdout:Get:98 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 18.0.0-3097-gef2746e0-1jammy [9,865 kB] 2023-05-15T16:33:57.515 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-05-15T16:33:57.536 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-05-15T16:33:57.573 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-15T16:33:57.581 INFO:teuthology.orchestra.run.smithi171.stdout:Fetched 180 MB in 12s (15.3 MB/s) 2023-05-15T16:33:57.720 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pyperclip. 2023-05-15T16:33:57.787 INFO:teuthology.orchestra.run.smithi171.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 132939 files and directories currently installed.) 2023-05-15T16:33:57.791 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-05-15T16:33:57.836 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-05-15T16:33:57.902 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-05-15T16:33:57.923 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-05-15T16:33:58.085 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-15T16:33:58.138 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-wcwidth. 2023-05-15T16:33:58.150 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-05-15T16:33:58.159 INFO:teuthology.orchestra.run.smithi161.stdout:Get:99 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 18.0.0-3097-gef2746e0-1jammy [31.5 MB] 2023-05-15T16:33:58.188 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-15T16:33:58.413 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-05-15T16:33:58.434 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-05-15T16:33:58.472 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-15T16:33:58.533 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cmd2. 2023-05-15T16:33:58.545 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-05-15T16:33:58.583 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-05-15T16:33:58.860 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libfmt8:amd64. 2023-05-15T16:33:58.873 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-05-15T16:33:58.917 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-05-15T16:33:58.937 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-15T16:33:58.944 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-15T16:33:58.983 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-15T16:33:59.264 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-05-15T16:33:59.277 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-05-15T16:33:59.303 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-05-15T16:33:59.316 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-15T16:33:59.322 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-15T16:33:59.345 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-15T16:33:59.659 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-05-15T16:33:59.672 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-05-15T16:33:59.681 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-05-15T16:33:59.702 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-15T16:33:59.717 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-15T16:33:59.740 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-15T16:34:00.045 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-05-15T16:34:00.059 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-05-15T16:34:00.102 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-05-15T16:34:00.103 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-15T16:34:00.116 INFO:teuthology.orchestra.run.smithi161.stdout:Get:100 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 18.0.0-3097-gef2746e0-1jammy [3,596 B] 2023-05-15T16:34:00.116 INFO:teuthology.orchestra.run.smithi161.stdout:Get:101 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 18.0.0-3097-gef2746e0-1jammy [806 kB] 2023-05-15T16:34:00.122 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-05-15T16:34:00.131 INFO:teuthology.orchestra.run.smithi161.stdout:Get:102 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 18.0.0-3097-gef2746e0-1jammy [2,145 kB] 2023-05-15T16:34:00.160 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-15T16:34:00.201 INFO:teuthology.orchestra.run.smithi161.stdout:Get:103 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 18.0.0-3097-gef2746e0-1jammy [96.3 kB] 2023-05-15T16:34:00.203 INFO:teuthology.orchestra.run.smithi161.stdout:Get:104 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 18.0.0-3097-gef2746e0-1jammy [120 kB] 2023-05-15T16:34:00.206 INFO:teuthology.orchestra.run.smithi161.stdout:Get:105 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 18.0.0-3097-gef2746e0-1jammy [1,860 kB] 2023-05-15T16:34:00.304 INFO:teuthology.orchestra.run.smithi161.stdout:Get:106 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 18.0.0-3097-gef2746e0-1jammy [8,615 kB] 2023-05-15T16:34:00.438 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librados2. 2023-05-15T16:34:00.458 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../011-librados2_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:00.487 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librados2 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:00.507 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-05-15T16:34:00.520 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-15T16:34:00.573 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-15T16:34:00.733 INFO:teuthology.orchestra.run.smithi161.stdout:Get:107 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 18.0.0-3097-gef2746e0-1jammy [3,724 B] 2023-05-15T16:34:00.734 INFO:teuthology.orchestra.run.smithi161.stdout:Get:108 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 18.0.0-3097-gef2746e0-1jammy [46.2 MB] 2023-05-15T16:34:00.927 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-05-15T16:34:00.932 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librbd1. 2023-05-15T16:34:00.940 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-15T16:34:00.953 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../012-librbd1_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:00.985 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-15T16:34:00.990 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librbd1 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:01.305 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-05-15T16:34:01.318 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-15T16:34:01.363 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-15T16:34:01.429 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libcephfs2. 2023-05-15T16:34:01.447 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:01.485 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libcephfs2 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:01.683 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-05-15T16:34:01.696 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-05-15T16:34:01.741 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-15T16:34:01.754 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rados. 2023-05-15T16:34:01.766 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../014-python3-rados_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:01.796 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rados (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:02.003 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package librados2. 2023-05-15T16:34:02.015 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../011-librados2_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:02.044 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking librados2 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:02.098 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-05-15T16:34:02.119 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:02.157 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-ceph-argparse (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:02.435 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cephfs. 2023-05-15T16:34:02.455 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:02.493 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cephfs (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:02.655 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package librbd1. 2023-05-15T16:34:02.669 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../012-librbd1_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:02.713 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking librbd1 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:02.779 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-ceph-common. 2023-05-15T16:34:02.800 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:02.837 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-ceph-common (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:02.892 INFO:teuthology.orchestra.run.smithi161.stdout:Get:109 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 18.0.0-3097-gef2746e0-1jammy [237 kB] 2023-05-15T16:34:02.897 INFO:teuthology.orchestra.run.smithi161.stdout:Get:110 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 18.0.0-3097-gef2746e0-1jammy [213 kB] 2023-05-15T16:34:02.901 INFO:teuthology.orchestra.run.smithi161.stdout:Get:111 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 18.0.0-3097-gef2746e0-1jammy [23.8 kB] 2023-05-15T16:34:02.902 INFO:teuthology.orchestra.run.smithi161.stdout:Get:112 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 18.0.0-3097-gef2746e0-1jammy [13.3 kB] 2023-05-15T16:34:02.903 INFO:teuthology.orchestra.run.smithi161.stdout:Get:113 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 18.0.0-3097-gef2746e0-1jammy [27.7 kB] 2023-05-15T16:34:02.904 INFO:teuthology.orchestra.run.smithi161.stdout:Get:114 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 18.0.0-3097-gef2746e0-1jammy [11.5 MB] 2023-05-15T16:34:03.124 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-prettytable. 2023-05-15T16:34:03.133 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libcephfs2. 2023-05-15T16:34:03.136 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-05-15T16:34:03.146 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:03.165 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-05-15T16:34:03.192 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libcephfs2 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:03.215 INFO:teuthology.orchestra.run.smithi161.stdout:Get:115 https://2.chacra.ceph.com/r/ceph/wip-yuri3-testing-2023-05-10-0851-reef/ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 18.0.0-3097-gef2746e0-1jammy [82.1 kB] 2023-05-15T16:34:03.401 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rbd. 2023-05-15T16:34:03.413 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:03.427 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-rados. 2023-05-15T16:34:03.440 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../014-python3-rados_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:03.460 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rbd (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:03.477 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-rados (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:03.762 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 180 MB in 15s (11.7 MB/s) 2023-05-15T16:34:03.780 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-05-15T16:34:03.793 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:03.804 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-05-15T16:34:03.825 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-05-15T16:34:03.838 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-ceph-argparse (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:03.862 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-15T16:34:03.903 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyperclip. 2023-05-15T16:34:03.986 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 130502 files and directories currently installed.) 2023-05-15T16:34:03.991 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2023-05-15T16:34:04.034 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2023-05-15T16:34:04.082 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cephfs. 2023-05-15T16:34:04.095 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:04.141 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cephfs (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:04.190 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package librgw2. 2023-05-15T16:34:04.211 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../021-librgw2_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:04.265 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking librgw2 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:04.345 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-wcwidth. 2023-05-15T16:34:04.366 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2023-05-15T16:34:04.403 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-15T16:34:04.426 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-ceph-common. 2023-05-15T16:34:04.440 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:04.485 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-ceph-common (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:04.723 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cmd2. 2023-05-15T16:34:04.744 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2023-05-15T16:34:04.771 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-prettytable. 2023-05-15T16:34:04.781 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2023-05-15T16:34:04.785 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-05-15T16:34:04.821 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-05-15T16:34:04.834 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rgw. 2023-05-15T16:34:04.846 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:04.884 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rgw (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:05.057 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-rbd. 2023-05-15T16:34:05.070 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:05.115 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-rbd (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:05.142 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libfmt8:amd64. 2023-05-15T16:34:05.163 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../003-libfmt8_8.1.1+ds1-2_amd64.deb ... 2023-05-15T16:34:05.196 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liboath0:amd64. 2023-05-15T16:34:05.216 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-05-15T16:34:05.243 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-15T16:34:05.245 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-05-15T16:34:05.461 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-05-15T16:34:05.473 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-05-15T16:34:05.515 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libradosstriper1. 2023-05-15T16:34:05.518 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-15T16:34:05.536 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:05.554 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2023-05-15T16:34:05.574 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libradosstriper1 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:05.575 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../004-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2023-05-15T16:34:05.612 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-15T16:34:05.846 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package librgw2. 2023-05-15T16:34:05.859 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../021-librgw2_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:05.904 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking librgw2 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:05.957 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-05-15T16:34:05.978 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../005-libdouble-conversion3_3.1.7-4_amd64.deb ... 2023-05-15T16:34:06.015 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-15T16:34:06.018 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-common. 2023-05-15T16:34:06.039 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../025-ceph-common_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:06.085 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-common (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:06.343 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-05-15T16:34:06.357 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-rgw. 2023-05-15T16:34:06.364 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../006-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2023-05-15T16:34:06.370 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:06.401 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-15T16:34:06.406 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-rgw (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:06.751 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package liboath0:amd64. 2023-05-15T16:34:06.765 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-05-15T16:34:06.809 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-05-15T16:34:06.838 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-05-15T16:34:06.859 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../007-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-15T16:34:06.895 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-15T16:34:07.120 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libradosstriper1. 2023-05-15T16:34:07.134 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:07.179 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libradosstriper1 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:07.291 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-05-15T16:34:07.312 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../008-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-15T16:34:07.349 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-15T16:34:07.532 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-common. 2023-05-15T16:34:07.545 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../025-ceph-common_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:07.582 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-common (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:07.719 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-05-15T16:34:07.740 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../009-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2023-05-15T16:34:07.774 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-base. 2023-05-15T16:34:07.777 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-15T16:34:07.795 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../026-ceph-base_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:07.842 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-base (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:08.172 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2023-05-15T16:34:08.192 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../010-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2023-05-15T16:34:08.221 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-15T16:34:08.512 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-05-15T16:34:08.533 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-05-15T16:34:08.541 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librados2. 2023-05-15T16:34:08.562 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../011-librados2_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:08.570 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-05-15T16:34:08.599 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librados2 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:08.763 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-base. 2023-05-15T16:34:08.776 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../026-ceph-base_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:08.838 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-base (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:08.873 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cheroot. 2023-05-15T16:34:08.894 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-05-15T16:34:08.931 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-15T16:34:09.234 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-05-15T16:34:09.255 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-05-15T16:34:09.284 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-05-15T16:34:09.344 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librbd1. 2023-05-15T16:34:09.366 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../012-librbd1_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:09.402 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librbd1 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:09.596 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.text. 2023-05-15T16:34:09.616 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-05-15T16:34:09.654 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-05-15T16:34:09.658 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-05-15T16:34:09.672 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-05-15T16:34:09.726 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-05-15T16:34:09.838 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libcephfs2. 2023-05-15T16:34:09.858 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../013-libcephfs2_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:09.896 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libcephfs2 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:09.956 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-05-15T16:34:09.977 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-05-15T16:34:10.015 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-05-15T16:34:10.045 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cheroot. 2023-05-15T16:34:10.058 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-05-15T16:34:10.103 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-15T16:34:10.174 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rados. 2023-05-15T16:34:10.186 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../014-python3-rados_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:10.223 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rados (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:10.301 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-tempora. 2023-05-15T16:34:10.322 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-05-15T16:34:10.359 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-05-15T16:34:10.414 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-05-15T16:34:10.427 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-05-15T16:34:10.472 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-05-15T16:34:10.551 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-05-15T16:34:10.572 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../015-python3-ceph-argparse_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:10.609 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-ceph-argparse (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:10.637 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-portend. 2023-05-15T16:34:10.658 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-05-15T16:34:10.698 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-05-15T16:34:10.742 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jaraco.text. 2023-05-15T16:34:10.756 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-05-15T16:34:10.825 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-05-15T16:34:10.862 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cephfs. 2023-05-15T16:34:10.883 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../016-python3-cephfs_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:10.920 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cephfs (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:10.990 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-05-15T16:34:11.011 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-05-15T16:34:11.048 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-05-15T16:34:11.128 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-05-15T16:34:11.141 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-05-15T16:34:11.186 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-05-15T16:34:11.248 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-ceph-common. 2023-05-15T16:34:11.269 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../017-python3-ceph-common_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:11.306 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-ceph-common (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:11.351 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cherrypy3. 2023-05-15T16:34:11.372 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-05-15T16:34:11.409 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-05-15T16:34:11.472 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-tempora. 2023-05-15T16:34:11.485 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-05-15T16:34:11.522 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-05-15T16:34:11.601 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-prettytable. 2023-05-15T16:34:11.621 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../018-python3-prettytable_2.5.0-2_all.deb ... 2023-05-15T16:34:11.650 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2023-05-15T16:34:11.763 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-natsort. 2023-05-15T16:34:11.785 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-05-15T16:34:11.800 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-portend. 2023-05-15T16:34:11.814 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-05-15T16:34:11.821 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-05-15T16:34:11.842 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-05-15T16:34:11.936 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rbd. 2023-05-15T16:34:11.948 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../019-python3-rbd_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:11.986 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rbd (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:12.128 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-05-15T16:34:12.133 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-logutils. 2023-05-15T16:34:12.142 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-05-15T16:34:12.154 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-05-15T16:34:12.187 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-05-15T16:34:12.191 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-05-15T16:34:12.339 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-05-15T16:34:12.360 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../020-librdkafka1_1.8.0-1build1_amd64.deb ... 2023-05-15T16:34:12.397 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-15T16:34:12.452 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-markupsafe. 2023-05-15T16:34:12.465 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-05-15T16:34:12.472 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cherrypy3. 2023-05-15T16:34:12.486 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-05-15T16:34:12.494 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-05-15T16:34:12.531 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-05-15T16:34:12.733 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package librgw2. 2023-05-15T16:34:12.754 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../021-librgw2_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:12.791 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking librgw2 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:12.859 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-natsort. 2023-05-15T16:34:12.872 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-05-15T16:34:12.909 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-05-15T16:34:12.922 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-mako. 2023-05-15T16:34:12.943 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-05-15T16:34:12.980 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-15T16:34:13.269 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rgw. 2023-05-15T16:34:13.279 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-logutils. 2023-05-15T16:34:13.290 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../022-python3-rgw_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:13.292 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-05-15T16:34:13.325 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-simplegeneric. 2023-05-15T16:34:13.327 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rgw (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:13.340 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-05-15T16:34:13.346 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-05-15T16:34:13.375 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-05-15T16:34:13.655 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-singledispatch. 2023-05-15T16:34:13.663 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liboath0:amd64. 2023-05-15T16:34:13.676 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-05-15T16:34:13.684 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../023-liboath0_2.6.7-3build1_amd64.deb ... 2023-05-15T16:34:13.714 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-05-15T16:34:13.715 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-markupsafe. 2023-05-15T16:34:13.721 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2023-05-15T16:34:13.728 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-05-15T16:34:13.782 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-05-15T16:34:14.024 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webob. 2023-05-15T16:34:14.041 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libradosstriper1. 2023-05-15T16:34:14.045 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-05-15T16:34:14.062 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../024-libradosstriper1_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:14.083 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-05-15T16:34:14.151 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-mako. 2023-05-15T16:34:14.165 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-05-15T16:34:14.218 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-15T16:34:14.241 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libradosstriper1 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:14.436 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-waitress. 2023-05-15T16:34:14.456 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-05-15T16:34:14.497 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-15T16:34:14.610 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-common. 2023-05-15T16:34:14.621 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-simplegeneric. 2023-05-15T16:34:14.632 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../025-ceph-common_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:14.635 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-05-15T16:34:14.660 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-common (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:14.680 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-05-15T16:34:14.822 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-tempita. 2023-05-15T16:34:14.843 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-05-15T16:34:14.871 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-05-15T16:34:15.041 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-singledispatch. 2023-05-15T16:34:15.055 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-05-15T16:34:15.107 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-05-15T16:34:15.166 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-paste. 2023-05-15T16:34:15.187 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-05-15T16:34:15.224 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-05-15T16:34:15.477 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-webob. 2023-05-15T16:34:15.491 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-05-15T16:34:15.535 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-05-15T16:34:15.543 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-05-15T16:34:15.557 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-05-15T16:34:15.619 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-05-15T16:34:15.930 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pastedeploy. 2023-05-15T16:34:15.949 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-base. 2023-05-15T16:34:15.951 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-05-15T16:34:15.971 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../026-ceph-base_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:15.980 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-waitress. 2023-05-15T16:34:15.988 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-05-15T16:34:15.993 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-05-15T16:34:16.017 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-base (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:16.049 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-15T16:34:16.291 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-webtest. 2023-05-15T16:34:16.312 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-05-15T16:34:16.349 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-05-15T16:34:16.391 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-tempita. 2023-05-15T16:34:16.404 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-05-15T16:34:16.458 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-05-15T16:34:16.660 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pecan. 2023-05-15T16:34:16.681 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-05-15T16:34:16.719 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-05-15T16:34:16.761 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-paste. 2023-05-15T16:34:16.775 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-05-15T16:34:16.778 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.functools. 2023-05-15T16:34:16.799 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../027-python3-jaraco.functools_3.4.0-2_all.deb ... 2023-05-15T16:34:16.819 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-05-15T16:34:16.836 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2023-05-15T16:34:17.065 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-certifi. 2023-05-15T16:34:17.080 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cheroot. 2023-05-15T16:34:17.086 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-05-15T16:34:17.101 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../028-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2023-05-15T16:34:17.105 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-05-15T16:34:17.119 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-05-15T16:34:17.123 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-05-15T16:34:17.130 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-15T16:34:17.163 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-05-15T16:34:17.416 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pastedeploy. 2023-05-15T16:34:17.417 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.classes. 2023-05-15T16:34:17.417 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-idna. 2023-05-15T16:34:17.429 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../029-python3-jaraco.classes_3.2.1-3_all.deb ... 2023-05-15T16:34:17.430 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-05-15T16:34:17.438 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-05-15T16:34:17.458 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2023-05-15T16:34:17.476 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-idna (3.3-1) ... 2023-05-15T16:34:17.736 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.text. 2023-05-15T16:34:17.757 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../030-python3-jaraco.text_3.6.0-2_all.deb ... 2023-05-15T16:34:17.787 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-urllib3. 2023-05-15T16:34:17.794 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2023-05-15T16:34:17.808 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-05-15T16:34:17.845 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-05-15T16:34:18.097 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jaraco.collections. 2023-05-15T16:34:18.118 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../031-python3-jaraco.collections_3.4.0-2_all.deb ... 2023-05-15T16:34:18.130 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-05-15T16:34:18.155 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2023-05-15T16:34:18.165 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-requests. 2023-05-15T16:34:18.186 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2_all.deb ... 2023-05-15T16:34:18.223 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-requests (2.25.1+dfsg-2) ... 2023-05-15T16:34:18.433 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-tempora. 2023-05-15T16:34:18.454 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../032-python3-tempora_4.1.2-1_all.deb ... 2023-05-15T16:34:18.491 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-tempora (4.1.2-1) ... 2023-05-15T16:34:18.531 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-webtest. 2023-05-15T16:34:18.544 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-05-15T16:34:18.588 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-05-15T16:34:18.727 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-portend. 2023-05-15T16:34:18.739 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../033-python3-portend_3.0.0-1_all.deb ... 2023-05-15T16:34:18.768 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-portend (3.0.0-1) ... 2023-05-15T16:34:18.899 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pecan. 2023-05-15T16:34:18.913 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-05-15T16:34:18.957 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-05-15T16:34:19.054 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-zc.lockfile. 2023-05-15T16:34:19.075 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../034-python3-zc.lockfile_2.0-1_all.deb ... 2023-05-15T16:34:19.113 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2023-05-15T16:34:19.202 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-werkzeug. 2023-05-15T16:34:19.223 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-05-15T16:34:19.260 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-15T16:34:19.338 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-certifi. 2023-05-15T16:34:19.351 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-05-15T16:34:19.395 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-05-15T16:34:19.424 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cherrypy3. 2023-05-15T16:34:19.445 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../035-python3-cherrypy3_18.6.1-4_all.deb ... 2023-05-15T16:34:19.507 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2023-05-15T16:34:19.554 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-05-15T16:34:19.566 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:19.604 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-modules-core (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:19.715 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-idna. 2023-05-15T16:34:19.729 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-05-15T16:34:19.773 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-idna (3.3-1) ... 2023-05-15T16:34:19.861 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-natsort. 2023-05-15T16:34:19.881 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../036-python3-natsort_8.0.2-1_all.deb ... 2023-05-15T16:34:19.919 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-natsort (8.0.2-1) ... 2023-05-15T16:34:19.959 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-05-15T16:34:19.980 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:20.008 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:20.085 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-urllib3. 2023-05-15T16:34:20.099 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-05-15T16:34:20.143 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-05-15T16:34:20.213 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-logutils. 2023-05-15T16:34:20.234 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../037-python3-logutils_0.3.3-8_all.deb ... 2023-05-15T16:34:20.271 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-logutils (0.3.3-8) ... 2023-05-15T16:34:20.303 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-openssl. 2023-05-15T16:34:20.324 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-05-15T16:34:20.361 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-05-15T16:34:20.488 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-requests. 2023-05-15T16:34:20.502 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2_all.deb ... 2023-05-15T16:34:20.546 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-requests (2.25.1+dfsg-2) ... 2023-05-15T16:34:20.584 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-markupsafe. 2023-05-15T16:34:20.603 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../038-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2023-05-15T16:34:20.641 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2023-05-15T16:34:20.706 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr. 2023-05-15T16:34:20.727 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:20.764 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:20.815 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-werkzeug. 2023-05-15T16:34:20.829 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-05-15T16:34:20.865 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-15T16:34:20.902 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-mako. 2023-05-15T16:34:20.922 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../039-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2023-05-15T16:34:20.952 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-15T16:34:21.152 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-05-15T16:34:21.159 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mon. 2023-05-15T16:34:21.166 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:21.179 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:21.210 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-modules-core (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:21.217 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mon (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:21.263 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-simplegeneric. 2023-05-15T16:34:21.284 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../040-python3-simplegeneric_0.8.1-3_all.deb ... 2023-05-15T16:34:21.321 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-05-15T16:34:21.598 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-05-15T16:34:21.612 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:21.616 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-singledispatch. 2023-05-15T16:34:21.636 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../041-python3-singledispatch_3.4.0.3-3_all.deb ... 2023-05-15T16:34:21.656 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:21.674 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2023-05-15T16:34:21.962 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webob. 2023-05-15T16:34:21.981 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../042-python3-webob_1%3a1.8.6-1.1_all.deb ... 2023-05-15T16:34:21.984 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-openssl. 2023-05-15T16:34:21.998 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-05-15T16:34:22.018 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2023-05-15T16:34:22.042 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-05-15T16:34:22.195 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-osd. 2023-05-15T16:34:22.216 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:22.253 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-osd (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:22.321 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-waitress. 2023-05-15T16:34:22.337 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr. 2023-05-15T16:34:22.341 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../043-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2023-05-15T16:34:22.351 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:22.382 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-15T16:34:22.387 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:22.690 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-tempita. 2023-05-15T16:34:22.711 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../044-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2023-05-15T16:34:22.749 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2023-05-15T16:34:22.790 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mon. 2023-05-15T16:34:22.804 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:22.848 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mon (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:23.051 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-paste. 2023-05-15T16:34:23.072 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../045-python3-paste_3.5.0+dfsg1-1_all.deb ... 2023-05-15T16:34:23.109 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2023-05-15T16:34:23.471 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-05-15T16:34:23.491 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../046-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2023-05-15T16:34:23.529 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2023-05-15T16:34:23.727 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-osd. 2023-05-15T16:34:23.740 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:23.785 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-osd (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:23.807 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pastedeploy. 2023-05-15T16:34:23.827 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../047-python3-pastedeploy_2.1.1-1_all.deb ... 2023-05-15T16:34:23.865 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2023-05-15T16:34:24.107 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph. 2023-05-15T16:34:24.128 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../061-ceph_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:24.165 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:24.168 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-webtest. 2023-05-15T16:34:24.189 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../048-python3-webtest_2.0.35-1_all.deb ... 2023-05-15T16:34:24.243 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-webtest (2.0.35-1) ... 2023-05-15T16:34:24.534 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-fuse. 2023-05-15T16:34:24.554 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pecan. 2023-05-15T16:34:24.555 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:24.574 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../049-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2023-05-15T16:34:24.592 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-fuse (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:24.804 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2023-05-15T16:34:24.962 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mds. 2023-05-15T16:34:24.983 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:24.988 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph. 2023-05-15T16:34:25.002 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../061-ceph_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:25.037 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mds (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:25.038 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:25.167 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-certifi. 2023-05-15T16:34:25.187 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../050-python3-certifi_2020.6.20-1_all.deb ... 2023-05-15T16:34:25.225 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2023-05-15T16:34:25.333 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-fuse. 2023-05-15T16:34:25.346 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:25.373 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephadm. 2023-05-15T16:34:25.382 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-fuse (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:25.386 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../064-cephadm_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:25.415 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephadm (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:25.561 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-idna. 2023-05-15T16:34:25.582 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../051-python3-idna_3.3-1_all.deb ... 2023-05-15T16:34:25.619 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-idna (3.3-1) ... 2023-05-15T16:34:25.717 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-asyncssh. 2023-05-15T16:34:25.736 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mds. 2023-05-15T16:34:25.739 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-05-15T16:34:25.750 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:25.776 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-05-15T16:34:25.794 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mds (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:25.897 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-urllib3. 2023-05-15T16:34:25.918 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../052-python3-urllib3_1.26.5-1~exp1_all.deb ... 2023-05-15T16:34:25.955 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1) ... 2023-05-15T16:34:26.078 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-babel-localedata. 2023-05-15T16:34:26.099 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-05-15T16:34:26.137 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-15T16:34:26.139 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package cephadm. 2023-05-15T16:34:26.152 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../064-cephadm_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:26.197 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking cephadm (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:26.283 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-requests. 2023-05-15T16:34:26.304 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../053-python3-requests_2.25.1+dfsg-2_all.deb ... 2023-05-15T16:34:26.341 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-requests (2.25.1+dfsg-2) ... 2023-05-15T16:34:26.484 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-asyncssh. 2023-05-15T16:34:26.497 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-05-15T16:34:26.541 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-05-15T16:34:26.602 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-werkzeug. 2023-05-15T16:34:26.614 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../054-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2023-05-15T16:34:26.644 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-15T16:34:26.811 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python-babel-localedata. 2023-05-15T16:34:26.825 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-05-15T16:34:26.861 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-15T16:34:26.930 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-05-15T16:34:26.951 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../055-ceph-mgr-modules-core_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:26.988 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-modules-core (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:27.125 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-babel. 2023-05-15T16:34:27.147 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-05-15T16:34:27.191 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-05-15T16:34:27.427 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-05-15T16:34:27.447 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../056-libsqlite3-mod-ceph_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:27.485 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libsqlite3-mod-ceph (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:27.512 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-jinja2. 2023-05-15T16:34:27.532 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-05-15T16:34:27.569 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-05-15T16:34:27.796 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-openssl. 2023-05-15T16:34:27.816 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../057-python3-openssl_21.0.0-1_all.deb ... 2023-05-15T16:34:27.841 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-babel. 2023-05-15T16:34:27.853 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-05-15T16:34:27.854 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-openssl (21.0.0-1) ... 2023-05-15T16:34:27.891 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-05-15T16:34:27.922 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-05-15T16:34:27.944 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:27.981 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-cephadm (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:28.149 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr. 2023-05-15T16:34:28.169 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../058-ceph-mgr_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:28.207 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:28.317 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-bcrypt. 2023-05-15T16:34:28.338 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-05-15T16:34:28.369 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jinja2. 2023-05-15T16:34:28.382 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-05-15T16:34:28.405 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-05-15T16:34:28.419 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-05-15T16:34:28.610 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mon. 2023-05-15T16:34:28.630 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../059-ceph-mon_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:28.668 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mon (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:28.764 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-05-15T16:34:28.777 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:28.814 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-cephadm (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:28.895 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pluggy. 2023-05-15T16:34:28.916 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2023-05-15T16:34:28.945 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-05-15T16:34:29.143 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-bcrypt. 2023-05-15T16:34:29.156 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-05-15T16:34:29.201 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-05-15T16:34:29.231 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-py. 2023-05-15T16:34:29.252 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2023-05-15T16:34:29.289 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-py (1.10.0-1) ... 2023-05-15T16:34:29.471 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pluggy. 2023-05-15T16:34:29.484 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2023-05-15T16:34:29.520 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-05-15T16:34:29.605 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-osd. 2023-05-15T16:34:29.625 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../060-ceph-osd_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:29.663 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-osd (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:29.676 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-iniconfig. 2023-05-15T16:34:29.697 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2023-05-15T16:34:29.734 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-05-15T16:34:29.807 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-py. 2023-05-15T16:34:29.821 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2023-05-15T16:34:29.865 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-py (1.10.0-1) ... 2023-05-15T16:34:30.037 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-toml. 2023-05-15T16:34:30.058 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2023-05-15T16:34:30.095 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-05-15T16:34:30.194 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-iniconfig. 2023-05-15T16:34:30.207 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2023-05-15T16:34:30.260 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-05-15T16:34:30.406 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pytest. 2023-05-15T16:34:30.428 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-05-15T16:34:30.464 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-05-15T16:34:30.622 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-toml. 2023-05-15T16:34:30.635 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2023-05-15T16:34:30.688 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-05-15T16:34:30.810 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-repoze.lru. 2023-05-15T16:34:30.831 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2023-05-15T16:34:30.868 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-05-15T16:34:31.058 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pytest. 2023-05-15T16:34:31.071 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-05-15T16:34:31.124 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-05-15T16:34:31.170 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-routes. 2023-05-15T16:34:31.192 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-05-15T16:34:31.229 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-05-15T16:34:31.508 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph. 2023-05-15T16:34:31.511 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-repoze.lru. 2023-05-15T16:34:31.519 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../061-ceph_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:31.525 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2023-05-15T16:34:31.558 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:31.565 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-05-15T16:34:31.569 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-05-15T16:34:31.587 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:31.624 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-dashboard (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:31.872 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-routes. 2023-05-15T16:34:31.877 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-fuse. 2023-05-15T16:34:31.886 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-05-15T16:34:31.897 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../062-ceph-fuse_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:31.931 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-05-15T16:34:31.935 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-fuse (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:32.060 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-05-15T16:34:32.082 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-05-15T16:34:32.118 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-15T16:34:32.276 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-05-15T16:34:32.289 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:32.313 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mds. 2023-05-15T16:34:32.334 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-dashboard (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:32.334 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../063-ceph-mds_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:32.371 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mds (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:32.647 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-joblib. 2023-05-15T16:34:32.668 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-05-15T16:34:32.705 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-05-15T16:34:32.733 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephadm. 2023-05-15T16:34:32.737 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-05-15T16:34:32.745 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../064-cephadm_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:32.749 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-05-15T16:34:32.774 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephadm (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:32.787 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-15T16:34:33.017 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-05-15T16:34:33.038 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-05-15T16:34:33.075 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-05-15T16:34:33.085 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-asyncssh. 2023-05-15T16:34:33.106 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../065-python3-asyncssh_2.5.0-1_all.deb ... 2023-05-15T16:34:33.144 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2023-05-15T16:34:33.291 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-joblib. 2023-05-15T16:34:33.303 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-05-15T16:34:33.340 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-05-15T16:34:33.378 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-sklearn. 2023-05-15T16:34:33.391 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-05-15T16:34:33.428 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-15T16:34:33.438 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-babel-localedata. 2023-05-15T16:34:33.459 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../066-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2023-05-15T16:34:33.496 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-15T16:34:33.661 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-05-15T16:34:33.673 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-05-15T16:34:33.711 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-05-15T16:34:33.963 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-sklearn. 2023-05-15T16:34:33.976 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-05-15T16:34:34.014 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-15T16:34:34.204 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-05-15T16:34:34.226 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:34.271 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:34.609 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-babel. 2023-05-15T16:34:34.631 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../067-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2023-05-15T16:34:34.668 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2023-05-15T16:34:34.748 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-05-15T16:34:34.761 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:34.798 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:35.021 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-jinja2. 2023-05-15T16:34:35.041 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../068-python3-jinja2_3.0.3-1_all.deb ... 2023-05-15T16:34:35.187 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-jinja2 (3.0.3-1) ... 2023-05-15T16:34:35.190 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-cachetools. 2023-05-15T16:34:35.212 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2023-05-15T16:34:35.249 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-05-15T16:34:35.518 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyasn1. 2023-05-15T16:34:35.530 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2023-05-15T16:34:35.559 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-05-15T16:34:35.624 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-05-15T16:34:35.644 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../069-ceph-mgr-cephadm_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:35.682 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-cephadm (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:35.843 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cachetools. 2023-05-15T16:34:35.857 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2023-05-15T16:34:35.863 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-05-15T16:34:35.884 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-05-15T16:34:35.901 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-05-15T16:34:35.921 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-05-15T16:34:36.018 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-bcrypt. 2023-05-15T16:34:36.040 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../070-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2023-05-15T16:34:36.085 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2023-05-15T16:34:36.163 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pyasn1. 2023-05-15T16:34:36.177 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2023-05-15T16:34:36.213 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-05-15T16:34:36.224 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-rsa. 2023-05-15T16:34:36.246 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2023-05-15T16:34:36.282 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-rsa (4.8-1) ... 2023-05-15T16:34:36.346 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pluggy. 2023-05-15T16:34:36.358 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../071-python3-pluggy_0.13.0-7.1_all.deb ... 2023-05-15T16:34:36.387 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2023-05-15T16:34:36.508 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-05-15T16:34:36.522 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-05-15T16:34:36.566 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-05-15T16:34:36.603 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-google-auth. 2023-05-15T16:34:36.624 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2023-05-15T16:34:36.661 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-05-15T16:34:36.707 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-py. 2023-05-15T16:34:36.719 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../072-python3-py_1.10.0-1_all.deb ... 2023-05-15T16:34:36.757 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-py (1.10.0-1) ... 2023-05-15T16:34:36.844 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-rsa. 2023-05-15T16:34:36.858 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2023-05-15T16:34:36.911 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-rsa (4.8-1) ... 2023-05-15T16:34:36.980 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-05-15T16:34:37.002 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-05-15T16:34:37.047 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-15T16:34:37.085 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-iniconfig. 2023-05-15T16:34:37.106 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../073-python3-iniconfig_1.1.1-2_all.deb ... 2023-05-15T16:34:37.143 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2023-05-15T16:34:37.231 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-google-auth. 2023-05-15T16:34:37.245 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2023-05-15T16:34:37.289 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-05-15T16:34:37.358 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-websocket. 2023-05-15T16:34:37.380 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2023-05-15T16:34:37.416 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-05-15T16:34:37.446 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-toml. 2023-05-15T16:34:37.467 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../074-python3-toml_0.10.2-1_all.deb ... 2023-05-15T16:34:37.504 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-toml (0.10.2-1) ... 2023-05-15T16:34:37.609 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-05-15T16:34:37.623 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-05-15T16:34:37.668 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-15T16:34:37.703 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-kubernetes. 2023-05-15T16:34:37.724 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-05-15T16:34:37.761 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-15T16:34:37.816 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pytest. 2023-05-15T16:34:37.836 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../075-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2023-05-15T16:34:37.865 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2023-05-15T16:34:37.945 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-websocket. 2023-05-15T16:34:37.959 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2023-05-15T16:34:37.995 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-05-15T16:34:38.227 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-repoze.lru. 2023-05-15T16:34:38.248 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2023-05-15T16:34:38.285 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-05-15T16:34:38.298 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-kubernetes. 2023-05-15T16:34:38.312 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-05-15T16:34:38.350 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-05-15T16:34:38.388 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-15T16:34:38.389 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:38.467 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:38.747 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-routes. 2023-05-15T16:34:38.767 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2023-05-15T16:34:38.786 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libonig5:amd64. 2023-05-15T16:34:38.807 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2023-05-15T16:34:38.809 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-05-15T16:34:38.852 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-15T16:34:39.063 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-05-15T16:34:39.075 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:39.112 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:39.119 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-05-15T16:34:39.130 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:39.160 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-dashboard (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:39.172 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libjq1:amd64. 2023-05-15T16:34:39.194 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-05-15T16:34:39.238 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-15T16:34:39.414 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libonig5:amd64. 2023-05-15T16:34:39.427 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-05-15T16:34:39.474 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package jq. 2023-05-15T16:34:39.484 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-15T16:34:39.487 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-05-15T16:34:39.516 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-05-15T16:34:39.546 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2023-05-15T16:34:39.568 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2023-05-15T16:34:39.605 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-15T16:34:39.720 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package socat. 2023-05-15T16:34:39.731 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-05-15T16:34:39.768 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-05-15T16:34:39.843 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libjq1:amd64. 2023-05-15T16:34:39.856 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-05-15T16:34:39.892 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-15T16:34:40.055 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package xmlstarlet. 2023-05-15T16:34:40.077 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-05-15T16:34:40.117 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-joblib. 2023-05-15T16:34:40.121 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-05-15T16:34:40.138 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2023-05-15T16:34:40.162 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package jq. 2023-05-15T16:34:40.176 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-05-15T16:34:40.183 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2023-05-15T16:34:40.220 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-05-15T16:34:40.473 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package socat. 2023-05-15T16:34:40.487 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-05-15T16:34:40.492 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-test. 2023-05-15T16:34:40.505 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../098-ceph-test_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:40.531 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-05-15T16:34:40.542 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-test (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:40.595 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-threadpoolctl. 2023-05-15T16:34:40.616 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2023-05-15T16:34:40.653 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2023-05-15T16:34:40.818 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package xmlstarlet. 2023-05-15T16:34:40.832 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-05-15T16:34:40.876 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-05-15T16:34:40.964 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-sklearn. 2023-05-15T16:34:40.986 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2023-05-15T16:34:41.023 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-15T16:34:41.205 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-test. 2023-05-15T16:34:41.218 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../098-ceph-test_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:41.247 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-test (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:41.825 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-05-15T16:34:41.846 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:41.891 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-diskprediction-local (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:42.846 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ceph-volume. 2023-05-15T16:34:42.868 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../099-ceph-volume_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:42.886 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-cachetools. 2023-05-15T16:34:42.908 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2023-05-15T16:34:42.912 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ceph-volume (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:42.925 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-volume. 2023-05-15T16:34:42.939 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../099-ceph-volume_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:42.952 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2023-05-15T16:34:42.984 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-volume (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:43.242 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephfs-mirror. 2023-05-15T16:34:43.255 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyasn1. 2023-05-15T16:34:43.264 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../100-cephfs-mirror_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:43.277 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2023-05-15T16:34:43.308 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephfs-mirror (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:43.314 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package cephfs-mirror. 2023-05-15T16:34:43.322 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2023-05-15T16:34:43.326 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../100-cephfs-mirror_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:43.363 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking cephfs-mirror (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:43.619 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-colorama. 2023-05-15T16:34:43.641 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-colorama. 2023-05-15T16:34:43.642 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2023-05-15T16:34:43.654 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2023-05-15T16:34:43.675 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-05-15T16:34:43.686 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-05-15T16:34:43.691 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-05-15T16:34:43.697 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2023-05-15T16:34:43.742 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2023-05-15T16:34:44.054 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-rsa. 2023-05-15T16:34:44.075 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2023-05-15T16:34:44.120 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-rsa (4.8-1) ... 2023-05-15T16:34:44.194 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package cephfs-shell. 2023-05-15T16:34:44.207 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../102-cephfs-shell_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:44.230 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephfs-shell. 2023-05-15T16:34:44.243 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../102-cephfs-shell_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:44.252 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking cephfs-shell (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:44.271 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephfs-shell (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:44.407 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-google-auth. 2023-05-15T16:34:44.429 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2023-05-15T16:34:44.473 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2023-05-15T16:34:44.514 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package cephfs-top. 2023-05-15T16:34:44.527 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../103-cephfs-top_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:44.533 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package cephfs-top. 2023-05-15T16:34:44.546 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../103-cephfs-top_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:44.572 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking cephfs-top (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:44.583 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking cephfs-top (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:44.786 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-05-15T16:34:44.807 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2023-05-15T16:34:44.816 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libcephfs-dev. 2023-05-15T16:34:44.830 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../104-libcephfs-dev_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:44.835 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libcephfs-dev. 2023-05-15T16:34:44.852 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-15T16:34:44.857 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../104-libcephfs-dev_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:44.874 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libcephfs-dev (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:44.902 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libcephfs-dev (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:45.163 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-websocket. 2023-05-15T16:34:45.185 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2023-05-15T16:34:45.211 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package nvme-cli. 2023-05-15T16:34:45.224 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-05-15T16:34:45.229 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-websocket (1.2.3-1) ... 2023-05-15T16:34:45.269 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-05-15T16:34:45.297 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package nvme-cli. 2023-05-15T16:34:45.319 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-05-15T16:34:45.363 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-05-15T16:34:45.516 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-kubernetes. 2023-05-15T16:34:45.539 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2023-05-15T16:34:45.574 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-15T16:34:45.582 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-05-15T16:34:45.596 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-05-15T16:34:45.641 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-05-15T16:34:45.718 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-05-15T16:34:45.740 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-05-15T16:34:45.784 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-05-15T16:34:46.044 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pastescript. 2023-05-15T16:34:46.058 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2023-05-15T16:34:46.101 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-05-15T16:34:46.179 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pastescript. 2023-05-15T16:34:46.201 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2023-05-15T16:34:46.245 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-05-15T16:34:46.280 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-05-15T16:34:46.293 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:46.354 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-mgr-k8sevents (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:46.405 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-psutil. 2023-05-15T16:34:46.418 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-05-15T16:34:46.463 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-05-15T16:34:46.582 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-psutil. 2023-05-15T16:34:46.605 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-05-15T16:34:46.640 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-05-15T16:34:46.682 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libonig5:amd64. 2023-05-15T16:34:46.704 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2023-05-15T16:34:46.749 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-15T16:34:46.782 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pygments. 2023-05-15T16:34:46.796 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-05-15T16:34:46.832 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-05-15T16:34:46.985 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pygments. 2023-05-15T16:34:47.008 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-05-15T16:34:47.051 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-05-15T16:34:47.069 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libjq1:amd64. 2023-05-15T16:34:47.091 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2023-05-15T16:34:47.135 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-15T16:34:47.287 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pyinotify. 2023-05-15T16:34:47.300 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-05-15T16:34:47.328 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-05-15T16:34:47.388 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package jq. 2023-05-15T16:34:47.401 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2023-05-15T16:34:47.438 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2023-05-15T16:34:47.480 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-pyinotify. 2023-05-15T16:34:47.502 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-05-15T16:34:47.538 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-05-15T16:34:47.622 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-simplejson. 2023-05-15T16:34:47.635 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-05-15T16:34:47.665 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package socat. 2023-05-15T16:34:47.678 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2023-05-15T16:34:47.706 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-05-15T16:34:47.715 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2023-05-15T16:34:47.850 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package python3-simplejson. 2023-05-15T16:34:47.872 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-05-15T16:34:47.916 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-05-15T16:34:47.958 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-05-15T16:34:47.972 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-05-15T16:34:48.017 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-05-15T16:34:48.035 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package xmlstarlet. 2023-05-15T16:34:48.048 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2023-05-15T16:34:48.085 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2023-05-15T16:34:48.185 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-05-15T16:34:48.207 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-05-15T16:34:48.252 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-05-15T16:34:48.448 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-test. 2023-05-15T16:34:48.470 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../098-ceph-test_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:48.514 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-test (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:48.762 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package radosgw. 2023-05-15T16:34:48.775 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../113-radosgw_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:48.812 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking radosgw (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:48.964 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package radosgw. 2023-05-15T16:34:48.986 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../113-radosgw_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:49.030 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking radosgw (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:49.423 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package rbd-fuse. 2023-05-15T16:34:49.437 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:49.482 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking rbd-fuse (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:49.739 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-05-15T16:34:49.883 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package rbd-fuse. 2023-05-15T16:34:49.897 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:49.941 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking rbd-fuse (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:50.003 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-15T16:34:50.138 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-05-15T16:34:50.211 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-05-15T16:34:50.391 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-05-15T16:34:50.463 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-15T16:34:50.564 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-05-15T16:34:50.731 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ceph-volume. 2023-05-15T16:34:50.754 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../099-ceph-volume_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:50.836 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-05-15T16:34:50.843 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-05-15T16:34:51.001 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ceph-volume (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:51.193 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-05-15T16:34:51.331 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephfs-mirror. 2023-05-15T16:34:51.344 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../100-cephfs-mirror_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:51.381 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephfs-mirror (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:51.468 INFO:teuthology.orchestra.run.smithi171.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-05-15T16:34:51.543 INFO:teuthology.orchestra.run.smithi171.stdout:Could not execute systemctl: at /usr/bin/deb-systemd-invoke line 142. 2023-05-15T16:34:51.589 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up cephadm (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:51.701 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-colorama. 2023-05-15T16:34:51.701 INFO:teuthology.orchestra.run.smithi062.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-05-15T16:34:51.722 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../101-python3-colorama_0.4.4-1_all.deb ... 2023-05-15T16:34:51.767 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-colorama (0.4.4-1) ... 2023-05-15T16:34:52.020 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephfs-shell. 2023-05-15T16:34:52.024 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephadm (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:52.033 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../102-cephfs-shell_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:52.070 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephfs-shell (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:52.142 INFO:teuthology.orchestra.run.smithi171.stdout:Adding system user cephadm....done 2023-05-15T16:34:52.304 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-15T16:34:52.339 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package cephfs-top. 2023-05-15T16:34:52.352 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../103-cephfs-top_18.0.0-3097-gef2746e0-1jammy_all.deb ... 2023-05-15T16:34:52.389 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking cephfs-top (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:52.560 INFO:teuthology.orchestra.run.smithi062.stdout:Adding system user cephadm....done 2023-05-15T16:34:52.588 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-05-15T16:34:52.658 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libcephfs-dev. 2023-05-15T16:34:52.671 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../104-libcephfs-dev_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:52.705 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-15T16:34:52.708 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libcephfs-dev (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:52.856 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-05-15T16:34:52.982 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-05-15T16:34:53.040 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-05-15T16:34:53.047 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package nvme-cli. 2023-05-15T16:34:53.067 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../105-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2023-05-15T16:34:53.103 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2023-05-15T16:34:53.242 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-05-15T16:34:53.300 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-05-15T16:34:53.425 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-05-15T16:34:53.458 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python-asyncssh-doc. 2023-05-15T16:34:53.480 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../106-python-asyncssh-doc_2.5.0-1_all.deb ... 2023-05-15T16:34:53.518 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-05-15T16:34:53.524 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2023-05-15T16:34:53.635 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-py (1.10.0-1) ... 2023-05-15T16:34:53.676 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-05-15T16:34:53.954 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-05-15T16:34:53.961 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pastescript. 2023-05-15T16:34:53.983 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2023-05-15T16:34:53.986 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-05-15T16:34:54.053 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-05-15T16:34:54.112 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-py (1.10.0-1) ... 2023-05-15T16:34:54.323 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-05-15T16:34:54.373 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-psutil. 2023-05-15T16:34:54.394 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2023-05-15T16:34:54.439 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2023-05-15T16:34:54.447 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-05-15T16:34:54.590 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-05-15T16:34:54.784 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pygments. 2023-05-15T16:34:54.805 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../109-python3-pygments_2.11.2+dfsg-2_all.deb ... 2023-05-15T16:34:54.826 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-05-15T16:34:54.850 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2023-05-15T16:34:54.867 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-05-15T16:34:55.085 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-05-15T16:34:55.159 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-05-15T16:34:55.321 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-pyinotify. 2023-05-15T16:34:55.343 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../110-python3-pyinotify_0.9.6-1.3_all.deb ... 2023-05-15T16:34:55.345 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-05-15T16:34:55.388 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2023-05-15T16:34:55.410 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-05-15T16:34:55.612 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-05-15T16:34:55.690 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package python3-simplejson. 2023-05-15T16:34:55.704 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-05-15T16:34:55.712 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../111-python3-simplejson_3.17.6-1build1_amd64.deb ... 2023-05-15T16:34:55.757 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2023-05-15T16:34:55.864 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-05-15T16:34:55.971 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-ceph-argparse (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:56.140 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-05-15T16:34:56.239 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-15T16:34:56.242 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-05-15T16:34:56.256 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../112-qttranslations5-l10n_5.15.3-1_all.deb ... 2023-05-15T16:34:56.292 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2023-05-15T16:34:56.365 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-05-15T16:34:56.399 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-ceph-argparse (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:56.633 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-05-15T16:34:56.675 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-15T16:34:56.776 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-05-15T16:34:56.900 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-15T16:34:57.001 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-05-15T16:34:57.036 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-05-15T16:34:57.072 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package radosgw. 2023-05-15T16:34:57.094 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../113-radosgw_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:57.138 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking radosgw (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:57.287 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-15T16:34:57.369 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-15T16:34:57.404 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-05-15T16:34:57.504 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-05-15T16:34:57.756 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-15T16:34:57.772 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-05-15T16:34:57.882 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-05-15T16:34:57.891 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package rbd-fuse. 2023-05-15T16:34:57.913 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../114-rbd-fuse_18.0.0-3097-gef2746e0-1jammy_amd64.deb ... 2023-05-15T16:34:57.958 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking rbd-fuse (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:58.048 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-05-15T16:34:58.158 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-05-15T16:34:58.268 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2023-05-15T16:34:58.374 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-05-15T16:34:58.425 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-05-15T16:34:58.521 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2023-05-15T16:34:58.647 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2023-05-15T16:34:58.727 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-05-15T16:34:58.902 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2023-05-15T16:34:59.060 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-05-15T16:34:59.248 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2023-05-15T16:34:59.511 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-05-15T16:34:59.647 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-05-15T16:34:59.654 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-05-15T16:34:59.695 INFO:teuthology.orchestra.run.smithi161.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2023-05-15T16:34:59.798 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-15T16:34:59.798 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephadm (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:34:59.923 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-05-15T16:35:00.041 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-05-15T16:35:00.132 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-05-15T16:35:00.181 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-15T16:35:00.358 INFO:teuthology.orchestra.run.smithi161.stdout:Adding system user cephadm....done 2023-05-15T16:35:00.482 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-05-15T16:35:00.496 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2023-05-15T16:35:00.533 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-05-15T16:35:00.773 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2023-05-15T16:35:00.784 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-05-15T16:35:00.884 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-05-15T16:35:01.024 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2023-05-15T16:35:01.135 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-05-15T16:35:01.150 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2023-05-15T16:35:01.177 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-15T16:35:01.409 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-05-15T16:35:01.470 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-05-15T16:35:01.520 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-15T16:35:01.644 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2023-05-15T16:35:01.787 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-py (1.10.0-1) ... 2023-05-15T16:35:01.806 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-15T16:35:01.821 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-05-15T16:35:02.105 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2023-05-15T16:35:02.147 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-15T16:35:02.156 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-05-15T16:35:02.424 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-05-15T16:35:02.473 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cachetools (5.0.0-1) ... 2023-05-15T16:35:02.515 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-05-15T16:35:02.542 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-ceph-common (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:02.733 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-colorama (0.4.4-1) ... 2023-05-15T16:35:02.784 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-05-15T16:35:02.835 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-idna (3.3-1) ... 2023-05-15T16:35:02.909 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-ceph-common (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:03.001 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-openssl (21.0.0-1) ... 2023-05-15T16:35:03.186 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-15T16:35:03.202 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-idna (3.3-1) ... 2023-05-15T16:35:03.269 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2023-05-15T16:35:03.503 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2023-05-15T16:35:03.520 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-15T16:35:03.763 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2023-05-15T16:35:04.132 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-ceph-argparse (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:04.425 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-15T16:35:04.457 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2023-05-15T16:35:04.583 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2023-05-15T16:35:04.584 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-toml (0.10.2-1) ... 2023-05-15T16:35:04.734 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-15T16:35:04.859 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2023-05-15T16:35:04.868 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-toml (0.10.2-1) ... 2023-05-15T16:35:04.869 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-15T16:35:04.994 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-05-15T16:35:05.093 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-15T16:35:05.120 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-05-15T16:35:05.136 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-15T16:35:05.203 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2023-05-15T16:35:05.262 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-05-15T16:35:05.388 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-05-15T16:35:05.430 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-05-15T16:35:05.587 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2023-05-15T16:35:05.697 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-05-15T16:35:05.698 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-05-15T16:35:05.713 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-natsort (8.0.2-1) ... 2023-05-15T16:35:05.957 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-05-15T16:35:05.965 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-15T16:35:05.990 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2023-05-15T16:35:06.116 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-15T16:35:06.216 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-15T16:35:06.257 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2023-05-15T16:35:06.268 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-05-15T16:35:06.334 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-15T16:35:06.460 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-05-15T16:35:06.602 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-05-15T16:35:06.791 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-05-15T16:35:06.859 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2023-05-15T16:35:06.861 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-05-15T16:35:07.096 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-05-15T16:35:07.155 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-05-15T16:35:07.347 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-05-15T16:35:07.439 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-05-15T16:35:07.552 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2023-05-15T16:35:07.606 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-05-15T16:35:07.707 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-05-15T16:35:07.803 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2023-05-15T16:35:07.866 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-05-15T16:35:07.929 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2023-05-15T16:35:07.991 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-15T16:35:08.055 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2023-05-15T16:35:08.092 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-05-15T16:35:08.133 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-15T16:35:08.259 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-05-15T16:35:08.356 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2023-05-15T16:35:08.376 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-15T16:35:08.544 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-15T16:35:08.544 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-15T16:35:08.670 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-15T16:35:08.741 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-certifi (2020.6.20-1) ... 2023-05-15T16:35:08.845 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-05-15T16:35:08.954 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-05-15T16:35:08.992 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2023-05-15T16:35:09.164 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-05-15T16:35:09.255 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-05-15T16:35:09.352 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2023-05-15T16:35:09.448 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-05-15T16:35:09.523 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-05-15T16:35:09.662 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2023-05-15T16:35:09.799 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-05-15T16:35:09.963 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2023-05-15T16:35:10.051 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-15T16:35:10.116 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-05-15T16:35:10.201 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-05-15T16:35:10.314 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2023-05-15T16:35:10.351 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-15T16:35:10.477 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-05-15T16:35:10.574 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2023-05-15T16:35:10.611 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-05-15T16:35:10.700 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-ceph-common (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:10.870 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-05-15T16:35:10.887 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-portend (3.0.0-1) ... 2023-05-15T16:35:10.993 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-idna (3.3-1) ... 2023-05-15T16:35:11.163 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-portend (3.0.0-1) ... 2023-05-15T16:35:11.172 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-15T16:35:11.294 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2023-05-15T16:35:11.298 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-05-15T16:35:11.422 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-15T16:35:11.548 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-05-15T16:35:11.632 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-05-15T16:35:11.883 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-05-15T16:35:11.950 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-requests (2.25.1+dfsg-2) ... 2023-05-15T16:35:12.209 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-requests (2.25.1+dfsg-2) ... 2023-05-15T16:35:12.226 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-05-15T16:35:12.377 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-rsa (4.8-1) ... 2023-05-15T16:35:12.485 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-05-15T16:35:12.508 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-15T16:35:12.611 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rsa (4.8-1) ... 2023-05-15T16:35:12.642 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-toml (0.10.2-1) ... 2023-05-15T16:35:12.653 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-05-15T16:35:12.879 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-05-15T16:35:12.893 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2023-05-15T16:35:12.938 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-15T16:35:13.011 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2023-05-15T16:35:13.137 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-urllib3 (1.26.5-1~exp1) ... 2023-05-15T16:35:13.146 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-15T16:35:13.222 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-05-15T16:35:13.414 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-05-15T16:35:13.472 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2023-05-15T16:35:13.616 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-05-15T16:35:13.731 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2023-05-15T16:35:13.807 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-05-15T16:35:13.925 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-05-15T16:35:13.982 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-15T16:35:14.092 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libfmt8:amd64 (8.1.1+ds1-2) ... 2023-05-15T16:35:14.101 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-05-15T16:35:14.201 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2023-05-15T16:35:14.269 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-15T16:35:14.394 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up librados2 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:14.444 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-15T16:35:14.478 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2023-05-15T16:35:14.521 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up librgw2 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:14.570 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librados2 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:14.696 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librgw2 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:14.737 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-logutils (0.3.3-8) ... 2023-05-15T16:35:14.916 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libsqlite3-mod-ceph (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:14.949 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libsqlite3-mod-ceph (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:14.996 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-tempora (4.1.2-1) ... 2023-05-15T16:35:15.034 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libcephfs2 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:15.050 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libcephfs2 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:15.143 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libradosstriper1 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:15.160 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libradosstriper1 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:15.256 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-05-15T16:35:15.269 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-05-15T16:35:15.285 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-05-15T16:35:15.507 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-prettytable (2.5.0-2) ... 2023-05-15T16:35:15.554 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up librbd1 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:15.578 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up librbd1 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:15.655 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-modules-core (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:15.730 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-modules-core (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:15.775 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2023-05-15T16:35:15.781 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-fuse (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:15.856 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-fuse (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:15.909 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-websocket (1.2.3-1) ... 2023-05-15T16:35:16.000 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-15T16:35:16.001 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-15T16:35:16.061 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-15T16:35:16.061 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-15T16:35:16.194 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2023-05-15T16:35:16.320 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2023-05-15T16:35:16.574 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libcephfs-dev (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:16.604 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2023-05-15T16:35:16.700 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rados (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:16.740 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libcephfs-dev (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:16.843 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephfs-top (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:16.875 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-rados (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:16.905 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2023-05-15T16:35:16.969 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-15T16:35:17.001 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up cephfs-top (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:17.102 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-15T16:35:17.165 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2023-05-15T16:35:17.644 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2023-05-15T16:35:17.884 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2023-05-15T16:35:17.994 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2023-05-15T16:35:18.240 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rbd (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:18.356 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-rbd (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:18.366 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up rbd-fuse (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:18.379 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2023-05-15T16:35:18.482 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up rbd-fuse (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:18.500 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-rgw (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:18.583 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-rgw (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:18.626 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up python3-cephfs (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:18.647 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-portend (3.0.0-1) ... 2023-05-15T16:35:18.701 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cephfs (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:18.752 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephfs-shell (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:18.827 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up cephfs-shell (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:18.878 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-common (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:18.906 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2023-05-15T16:35:18.953 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-common (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:19.032 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-jinja2 (3.0.3-1) ... 2023-05-15T16:35:19.366 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2023-05-15T16:35:19.396 INFO:teuthology.orchestra.run.smithi062.stdout:Adding group ceph....done 2023-05-15T16:35:19.472 INFO:teuthology.orchestra.run.smithi171.stdout:Adding group ceph....done 2023-05-15T16:35:19.668 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-requests (2.25.1+dfsg-2) ... 2023-05-15T16:35:19.764 INFO:teuthology.orchestra.run.smithi062.stdout:Adding system user ceph....done 2023-05-15T16:35:19.899 INFO:teuthology.orchestra.run.smithi171.stdout:Adding system user ceph....done 2023-05-15T16:35:19.927 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2023-05-15T16:35:19.983 INFO:teuthology.orchestra.run.smithi062.stdout:Setting system user ceph properties....done 2023-05-15T16:35:19.995 INFO:teuthology.orchestra.run.smithi062.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-05-15T16:35:20.043 INFO:teuthology.orchestra.run.smithi171.stdout:Setting system user ceph properties....done 2023-05-15T16:35:20.053 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rsa (4.8-1) ... 2023-05-15T16:35:20.056 INFO:teuthology.orchestra.run.smithi171.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-05-15T16:35:20.146 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-05-15T16:35:20.190 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-05-15T16:35:20.329 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-webtest (2.0.35-1) ... 2023-05-15T16:35:20.520 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-05-15T16:35:20.597 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2023-05-15T16:35:20.605 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-05-15T16:35:20.857 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2023-05-15T16:35:21.088 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up cephfs-mirror (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:21.275 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-05-15T16:35:21.322 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-test (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:21.338 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up cephfs-mirror (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:21.449 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up radosgw (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:21.464 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-test (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:21.543 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2023-05-15T16:35:21.590 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up radosgw (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:21.720 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-15T16:35:21.720 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-15T16:35:21.827 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-15T16:35:21.827 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-15T16:35:21.870 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2023-05-15T16:35:22.255 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librados2 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:22.381 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librgw2 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:22.491 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-base (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:22.583 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libsqlite3-mod-ceph (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:22.685 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libcephfs2 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:22.794 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libradosstriper1 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:22.816 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-base (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:22.835 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-05-15T16:35:22.920 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-google-auth (1.5.1-3) ... 2023-05-15T16:35:23.157 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-05-15T16:35:23.213 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up librbd1 (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:23.339 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-modules-core (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:23.368 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mds (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:23.465 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-fuse (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:23.614 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-15T16:35:23.615 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-15T16:35:23.679 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-15T16:35:23.679 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-05-15T16:35:23.876 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mds (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:24.088 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-15T16:35:24.088 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-15T16:35:24.153 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:24.250 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libcephfs-dev (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:24.351 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rados (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:24.410 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-15T16:35:24.410 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-15T16:35:24.460 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephfs-top (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:24.569 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2023-05-15T16:35:24.761 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:24.977 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-osd (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:24.997 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-15T16:35:24.997 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-15T16:35:25.390 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-15T16:35:25.390 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-15T16:35:25.650 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-osd (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:25.790 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rbd (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:25.908 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up rbd-fuse (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:25.940 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-k8sevents (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:25.971 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-15T16:35:25.971 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-15T16:35:26.009 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-rgw (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:26.067 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:26.110 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up python3-cephfs (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:26.218 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mon (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:26.219 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephfs-shell (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:26.345 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-common (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:26.442 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-15T16:35:26.442 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-15T16:35:26.635 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-k8sevents (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:26.761 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:26.888 INFO:teuthology.orchestra.run.smithi161.stdout:Adding group ceph....done 2023-05-15T16:35:26.904 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mon (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:26.977 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-cephadm (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:27.103 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-15T16:35:27.103 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-15T16:35:27.128 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:27.254 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-mgr-dashboard (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:27.293 INFO:teuthology.orchestra.run.smithi161.stdout:Adding system user ceph....done 2023-05-15T16:35:27.397 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ceph-volume (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:27.478 INFO:teuthology.orchestra.run.smithi161.stdout:Setting system user ceph properties....done 2023-05-15T16:35:27.497 INFO:teuthology.orchestra.run.smithi161.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-05-15T16:35:27.499 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-15T16:35:27.632 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-05-15T16:35:27.772 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-cephadm (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:27.915 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:27.988 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-05-15T16:35:28.041 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-dashboard (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:28.183 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-volume (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:28.285 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-15T16:35:28.540 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up cephfs-mirror (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:28.633 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-15T16:35:28.692 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-test (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:28.792 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up radosgw (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:29.090 INFO:teuthology.orchestra.run.smithi062.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-15T16:35:29.092 DEBUG:teuthology.orchestra.run.smithi062:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-05-15T16:35:29.155 INFO:teuthology.orchestra.run.smithi062.stdout:Reading package lists... 2023-05-15T16:35:29.166 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-15T16:35:29.166 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-05-15T16:35:29.332 INFO:teuthology.orchestra.run.smithi062.stdout:Building dependency tree... 2023-05-15T16:35:29.333 INFO:teuthology.orchestra.run.smithi062.stdout:Reading state information... 2023-05-15T16:35:29.492 INFO:teuthology.orchestra.run.smithi062.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-05-15T16:35:29.492 INFO:teuthology.orchestra.run.smithi062.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-05-15T16:35:29.493 INFO:teuthology.orchestra.run.smithi062.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-05-15T16:35:29.493 INFO:teuthology.orchestra.run.smithi062.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-05-15T16:35:29.493 INFO:teuthology.orchestra.run.smithi062.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-05-15T16:35:29.493 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages were automatically installed and are no longer required: 2023-05-15T16:35:29.493 INFO:teuthology.orchestra.run.smithi062.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-15T16:35:29.493 INFO:teuthology.orchestra.run.smithi062.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-15T16:35:29.494 INFO:teuthology.orchestra.run.smithi062.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-15T16:35:29.495 INFO:teuthology.orchestra.run.smithi062.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-05-15T16:35:29.495 INFO:teuthology.orchestra.run.smithi062.stdout: python2.7-minimal 2023-05-15T16:35:29.495 INFO:teuthology.orchestra.run.smithi062.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-15T16:35:29.495 INFO:teuthology.orchestra.run.smithi062.stdout:The following additional packages will be installed: 2023-05-15T16:35:29.495 INFO:teuthology.orchestra.run.smithi062.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-05-15T16:35:29.495 INFO:teuthology.orchestra.run.smithi062.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-05-15T16:35:29.496 INFO:teuthology.orchestra.run.smithi062.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-05-15T16:35:29.496 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-05-15T16:35:29.496 INFO:teuthology.orchestra.run.smithi062.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-15T16:35:29.496 INFO:teuthology.orchestra.run.smithi062.stdout:Suggested packages: 2023-05-15T16:35:29.496 INFO:teuthology.orchestra.run.smithi062.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-05-15T16:35:29.497 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-05-15T16:35:29.497 INFO:teuthology.orchestra.run.smithi062.stdout: libengine-pkcs11-openssl 2023-05-15T16:35:29.532 INFO:teuthology.orchestra.run.smithi062.stdout:The following NEW packages will be installed: 2023-05-15T16:35:29.533 INFO:teuthology.orchestra.run.smithi062.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-05-15T16:35:29.534 INFO:teuthology.orchestra.run.smithi062.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-05-15T16:35:29.534 INFO:teuthology.orchestra.run.smithi062.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-05-15T16:35:29.534 INFO:teuthology.orchestra.run.smithi062.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-05-15T16:35:29.535 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-05-15T16:35:29.535 INFO:teuthology.orchestra.run.smithi062.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-05-15T16:35:29.535 INFO:teuthology.orchestra.run.smithi062.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-15T16:35:29.536 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-15T16:35:29.536 INFO:teuthology.orchestra.run.smithi062.stdout:The following packages will be upgraded: 2023-05-15T16:35:29.536 INFO:teuthology.orchestra.run.smithi062.stdout: libssl3 2023-05-15T16:35:29.718 INFO:teuthology.orchestra.run.smithi062.stdout:1 upgraded, 39 newly installed, 0 to remove and 144 not upgraded. 2023-05-15T16:35:29.719 INFO:teuthology.orchestra.run.smithi062.stdout:Need to get 54.6 MB of archives. 2023-05-15T16:35:29.719 INFO:teuthology.orchestra.run.smithi062.stdout:After this operation, 202 MB of additional disk space will be used. 2023-05-15T16:35:29.719 INFO:teuthology.orchestra.run.smithi062.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-05-15T16:35:29.903 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-base (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:29.995 INFO:teuthology.orchestra.run.smithi171.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-15T16:35:29.998 DEBUG:teuthology.orchestra.run.smithi171:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-05-15T16:35:30.070 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2023-05-15T16:35:30.201 INFO:teuthology.orchestra.run.smithi062.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.9 [1,902 kB] 2023-05-15T16:35:30.221 INFO:teuthology.orchestra.run.smithi171.stdout:Building dependency tree... 2023-05-15T16:35:30.222 INFO:teuthology.orchestra.run.smithi171.stdout:Reading state information... 2023-05-15T16:35:30.247 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-05-15T16:35:30.362 INFO:teuthology.orchestra.run.smithi171.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-05-15T16:35:30.362 INFO:teuthology.orchestra.run.smithi171.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-05-15T16:35:30.362 INFO:teuthology.orchestra.run.smithi171.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-05-15T16:35:30.362 INFO:teuthology.orchestra.run.smithi171.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-05-15T16:35:30.363 INFO:teuthology.orchestra.run.smithi171.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-05-15T16:35:30.363 INFO:teuthology.orchestra.run.smithi171.stdout:The following packages were automatically installed and are no longer required: 2023-05-15T16:35:30.363 INFO:teuthology.orchestra.run.smithi171.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-15T16:35:30.363 INFO:teuthology.orchestra.run.smithi171.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-15T16:35:30.363 INFO:teuthology.orchestra.run.smithi171.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-15T16:35:30.363 INFO:teuthology.orchestra.run.smithi171.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2023-05-15T16:35:30.363 INFO:teuthology.orchestra.run.smithi171.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2023-05-15T16:35:30.364 INFO:teuthology.orchestra.run.smithi171.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-15T16:35:30.364 INFO:teuthology.orchestra.run.smithi171.stdout:The following additional packages will be installed: 2023-05-15T16:35:30.364 INFO:teuthology.orchestra.run.smithi171.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-05-15T16:35:30.364 INFO:teuthology.orchestra.run.smithi171.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-05-15T16:35:30.364 INFO:teuthology.orchestra.run.smithi171.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-05-15T16:35:30.364 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-05-15T16:35:30.364 INFO:teuthology.orchestra.run.smithi171.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-15T16:35:30.365 INFO:teuthology.orchestra.run.smithi171.stdout:Suggested packages: 2023-05-15T16:35:30.365 INFO:teuthology.orchestra.run.smithi171.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-05-15T16:35:30.365 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-05-15T16:35:30.365 INFO:teuthology.orchestra.run.smithi171.stdout: libengine-pkcs11-openssl 2023-05-15T16:35:30.405 INFO:teuthology.orchestra.run.smithi171.stdout:The following NEW packages will be installed: 2023-05-15T16:35:30.406 INFO:teuthology.orchestra.run.smithi171.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-05-15T16:35:30.406 INFO:teuthology.orchestra.run.smithi171.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-05-15T16:35:30.406 INFO:teuthology.orchestra.run.smithi171.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-05-15T16:35:30.407 INFO:teuthology.orchestra.run.smithi171.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-05-15T16:35:30.407 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-05-15T16:35:30.407 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-05-15T16:35:30.407 INFO:teuthology.orchestra.run.smithi171.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-15T16:35:30.408 INFO:teuthology.orchestra.run.smithi171.stdout:The following packages will be upgraded: 2023-05-15T16:35:30.408 INFO:teuthology.orchestra.run.smithi171.stdout: libssl3 2023-05-15T16:35:30.478 INFO:teuthology.orchestra.run.smithi062.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-05-15T16:35:30.527 INFO:teuthology.orchestra.run.smithi062.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-05-15T16:35:30.533 INFO:teuthology.orchestra.run.smithi062.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-05-15T16:35:30.543 INFO:teuthology.orchestra.run.smithi062.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-05-15T16:35:30.547 INFO:teuthology.orchestra.run.smithi062.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-05-15T16:35:30.550 INFO:teuthology.orchestra.run.smithi062.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-05-15T16:35:30.555 INFO:teuthology.orchestra.run.smithi062.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-05-15T16:35:30.558 INFO:teuthology.orchestra.run.smithi062.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-05-15T16:35:30.558 INFO:teuthology.orchestra.run.smithi062.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-05-15T16:35:30.609 INFO:teuthology.orchestra.run.smithi171.stdout:1 upgraded, 39 newly installed, 0 to remove and 144 not upgraded. 2023-05-15T16:35:30.609 INFO:teuthology.orchestra.run.smithi171.stdout:Need to get 54.6 MB of archives. 2023-05-15T16:35:30.609 INFO:teuthology.orchestra.run.smithi171.stdout:After this operation, 202 MB of additional disk space will be used. 2023-05-15T16:35:30.610 INFO:teuthology.orchestra.run.smithi171.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-05-15T16:35:30.723 INFO:teuthology.orchestra.run.smithi062.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-05-15T16:35:30.730 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mds (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:30.951 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-15T16:35:30.951 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-05-15T16:35:31.035 INFO:teuthology.orchestra.run.smithi062.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-05-15T16:35:31.084 INFO:teuthology.orchestra.run.smithi171.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.9 [1,902 kB] 2023-05-15T16:35:31.482 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:31.694 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-15T16:35:31.694 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-05-15T16:35:32.199 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-osd (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:32.498 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-15T16:35:32.499 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-05-15T16:35:33.018 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-k8sevents (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:33.128 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-diskprediction-local (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:33.279 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mon (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:33.494 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-15T16:35:33.495 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-05-15T16:35:34.038 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-cephadm (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:34.190 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:34.457 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-mgr-dashboard (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:34.592 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ceph-volume (18.0.0-3097-gef2746e0-1jammy) ... 2023-05-15T16:35:34.694 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-15T16:35:35.195 INFO:teuthology.orchestra.run.smithi171.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-05-15T16:35:35.928 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-15T16:35:36.405 INFO:teuthology.orchestra.run.smithi161.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-15T16:35:36.407 DEBUG:teuthology.orchestra.run.smithi161:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2023-05-15T16:35:36.502 INFO:teuthology.orchestra.run.smithi161.stdout:Reading package lists... 2023-05-15T16:35:36.674 INFO:teuthology.orchestra.run.smithi161.stdout:Building dependency tree... 2023-05-15T16:35:36.675 INFO:teuthology.orchestra.run.smithi161.stdout:Reading state information... 2023-05-15T16:35:36.831 INFO:teuthology.orchestra.run.smithi161.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2023-05-15T16:35:36.832 INFO:teuthology.orchestra.run.smithi161.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-05-15T16:35:36.832 INFO:teuthology.orchestra.run.smithi161.stdout:util-linux is already the newest version (2.37.2-4ubuntu3). 2023-05-15T16:35:36.832 INFO:teuthology.orchestra.run.smithi161.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-05-15T16:35:36.832 INFO:teuthology.orchestra.run.smithi161.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-05-15T16:35:36.832 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages were automatically installed and are no longer required: 2023-05-15T16:35:36.832 INFO:teuthology.orchestra.run.smithi161.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2023-05-15T16:35:36.832 INFO:teuthology.orchestra.run.smithi161.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2023-05-15T16:35:36.833 INFO:teuthology.orchestra.run.smithi161.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2023-05-15T16:35:36.834 INFO:teuthology.orchestra.run.smithi161.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2023-05-15T16:35:36.834 INFO:teuthology.orchestra.run.smithi161.stdout: python2.7-minimal 2023-05-15T16:35:36.834 INFO:teuthology.orchestra.run.smithi161.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-15T16:35:36.834 INFO:teuthology.orchestra.run.smithi161.stdout:The following additional packages will be installed: 2023-05-15T16:35:36.834 INFO:teuthology.orchestra.run.smithi161.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2023-05-15T16:35:36.834 INFO:teuthology.orchestra.run.smithi161.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2023-05-15T16:35:36.834 INFO:teuthology.orchestra.run.smithi161.stdout: libqmi-proxy libssl3 libteamdctl0 modemmanager network-manager-pptp 2023-05-15T16:35:36.835 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2023-05-15T16:35:36.835 INFO:teuthology.orchestra.run.smithi161.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-15T16:35:36.835 INFO:teuthology.orchestra.run.smithi161.stdout:Suggested packages: 2023-05-15T16:35:36.835 INFO:teuthology.orchestra.run.smithi161.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2023-05-15T16:35:36.835 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial wpagui 2023-05-15T16:35:36.836 INFO:teuthology.orchestra.run.smithi161.stdout: libengine-pkcs11-openssl 2023-05-15T16:35:36.871 INFO:teuthology.orchestra.run.smithi161.stdout:The following NEW packages will be installed: 2023-05-15T16:35:36.871 INFO:teuthology.orchestra.run.smithi161.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2023-05-15T16:35:36.872 INFO:teuthology.orchestra.run.smithi161.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2023-05-15T16:35:36.872 INFO:teuthology.orchestra.run.smithi161.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2023-05-15T16:35:36.872 INFO:teuthology.orchestra.run.smithi161.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2023-05-15T16:35:36.873 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2023-05-15T16:35:36.873 INFO:teuthology.orchestra.run.smithi161.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2023-05-15T16:35:36.873 INFO:teuthology.orchestra.run.smithi161.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2023-05-15T16:35:36.873 INFO:teuthology.orchestra.run.smithi161.stdout:The following packages will be upgraded: 2023-05-15T16:35:36.874 INFO:teuthology.orchestra.run.smithi161.stdout: libssl3 2023-05-15T16:35:36.923 INFO:teuthology.orchestra.run.smithi161.stdout:1 upgraded, 39 newly installed, 0 to remove and 144 not upgraded. 2023-05-15T16:35:36.924 INFO:teuthology.orchestra.run.smithi161.stdout:Need to get 54.6 MB of archives. 2023-05-15T16:35:36.924 INFO:teuthology.orchestra.run.smithi161.stdout:After this operation, 202 MB of additional disk space will be used. 2023-05-15T16:35:36.924 INFO:teuthology.orchestra.run.smithi161.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2023-05-15T16:35:37.024 INFO:teuthology.orchestra.run.smithi161.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.9 [1,902 kB] 2023-05-15T16:35:37.086 INFO:teuthology.orchestra.run.smithi161.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2023-05-15T16:35:37.099 INFO:teuthology.orchestra.run.smithi161.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-05-15T16:35:37.100 INFO:teuthology.orchestra.run.smithi161.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-05-15T16:35:37.102 INFO:teuthology.orchestra.run.smithi161.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-05-15T16:35:37.104 INFO:teuthology.orchestra.run.smithi161.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-05-15T16:35:37.104 INFO:teuthology.orchestra.run.smithi161.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-05-15T16:35:37.106 INFO:teuthology.orchestra.run.smithi161.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-05-15T16:35:37.107 INFO:teuthology.orchestra.run.smithi161.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-05-15T16:35:37.143 INFO:teuthology.orchestra.run.smithi161.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-05-15T16:35:37.144 INFO:teuthology.orchestra.run.smithi161.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-05-15T16:35:37.195 INFO:teuthology.orchestra.run.smithi161.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-05-15T16:35:37.563 INFO:teuthology.orchestra.run.smithi161.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-05-15T16:35:37.617 INFO:teuthology.orchestra.run.smithi161.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-05-15T16:35:37.617 INFO:teuthology.orchestra.run.smithi161.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-05-15T16:35:37.621 INFO:teuthology.orchestra.run.smithi161.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-05-15T16:35:37.621 INFO:teuthology.orchestra.run.smithi161.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-05-15T16:35:37.627 INFO:teuthology.orchestra.run.smithi161.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.7-0ubuntu0.22.04.1 [141 kB] 2023-05-15T16:35:37.630 INFO:teuthology.orchestra.run.smithi161.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-05-15T16:35:37.638 INFO:teuthology.orchestra.run.smithi161.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-05-15T16:35:37.674 INFO:teuthology.orchestra.run.smithi161.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.9 [2,373 kB] 2023-05-15T16:35:37.839 INFO:teuthology.orchestra.run.smithi161.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-05-15T16:35:37.839 INFO:teuthology.orchestra.run.smithi161.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-05-15T16:35:37.860 INFO:teuthology.orchestra.run.smithi161.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-05-15T16:35:37.893 INFO:teuthology.orchestra.run.smithi161.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-05-15T16:35:37.897 INFO:teuthology.orchestra.run.smithi161.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-05-15T16:35:37.898 INFO:teuthology.orchestra.run.smithi161.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-05-15T16:35:37.899 INFO:teuthology.orchestra.run.smithi161.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-05-15T16:35:37.899 INFO:teuthology.orchestra.run.smithi161.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.7-0ubuntu0.22.04.1 [1,220 kB] 2023-05-15T16:35:37.912 INFO:teuthology.orchestra.run.smithi161.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-05-15T16:35:37.914 INFO:teuthology.orchestra.run.smithi161.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.7-0ubuntu0.22.04.1 [16.1 MB] 2023-05-15T16:35:38.160 INFO:teuthology.orchestra.run.smithi161.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-05-15T16:35:38.178 INFO:teuthology.orchestra.run.smithi161.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-05-15T16:35:38.178 INFO:teuthology.orchestra.run.smithi161.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-05-15T16:35:38.178 INFO:teuthology.orchestra.run.smithi161.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-05-15T16:35:38.197 INFO:teuthology.orchestra.run.smithi161.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-05-15T16:35:38.201 INFO:teuthology.orchestra.run.smithi161.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-05-15T16:35:38.300 INFO:teuthology.orchestra.run.smithi161.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-05-15T16:35:38.301 INFO:teuthology.orchestra.run.smithi161.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-05-15T16:35:38.702 INFO:teuthology.orchestra.run.smithi161.stdout:Preconfiguring packages ... 2023-05-15T16:35:38.871 INFO:teuthology.orchestra.run.smithi161.stdout:Fetched 54.6 MB in 1s (38.4 MB/s) 2023-05-15T16:35:39.044 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package flex. 2023-05-15T16:35:39.125 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137468 files and directories currently installed.) 2023-05-15T16:35:39.129 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-05-15T16:35:39.184 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking flex (2.6.4-8build2) ... 2023-05-15T16:35:39.574 INFO:teuthology.orchestra.run.smithi171.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2023-05-15T16:35:39.659 INFO:teuthology.orchestra.run.smithi171.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2023-05-15T16:35:39.839 INFO:teuthology.orchestra.run.smithi171.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 indent amd64 2.2.12-1build2 [90.8 kB] 2023-05-15T16:35:39.853 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-15T16:35:39.934 INFO:teuthology.orchestra.run.smithi171.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2023-05-15T16:35:39.955 INFO:teuthology.orchestra.run.smithi171.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbluetooth3 amd64 5.64-0ubuntu1 [86.9 kB] 2023-05-15T16:35:40.035 INFO:teuthology.orchestra.run.smithi171.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2023-05-15T16:35:40.040 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.9) over (3.0.2-0ubuntu1.7) ... 2023-05-15T16:35:40.086 INFO:teuthology.orchestra.run.smithi171.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2023-05-15T16:35:40.095 INFO:teuthology.orchestra.run.smithi171.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2023-05-15T16:35:40.270 INFO:teuthology.orchestra.run.smithi171.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2023-05-15T16:35:40.496 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-15T16:35:40.611 INFO:teuthology.orchestra.run.smithi171.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1 [24.0 MB] 2023-05-15T16:35:41.075 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package bison. 2023-05-15T16:35:41.163 INFO:teuthology.orchestra.run.smithi161.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137541 files and directories currently installed.) 2023-05-15T16:35:41.168 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-05-15T16:35:41.218 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-05-15T16:35:41.644 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-05-15T16:35:41.666 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-05-15T16:35:41.710 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-05-15T16:35:42.055 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package dump. 2023-05-15T16:35:42.077 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-05-15T16:35:42.122 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking dump (0.4b47-3) ... 2023-05-15T16:35:42.392 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package indent. 2023-05-15T16:35:42.404 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-05-15T16:35:42.442 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking indent (2.2.12-1build2) ... 2023-05-15T16:35:42.821 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-05-15T16:35:42.843 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-05-15T16:35:42.887 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-15T16:35:43.216 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-05-15T16:35:43.237 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-05-15T16:35:43.282 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-15T16:35:43.527 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-05-15T16:35:43.539 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-05-15T16:35:43.576 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-05-15T16:35:43.922 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libfl2:amd64. 2023-05-15T16:35:43.943 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-05-15T16:35:43.988 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-05-15T16:35:44.240 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-05-15T16:35:44.253 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-05-15T16:35:44.290 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-15T16:35:44.526 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libjson-perl. 2023-05-15T16:35:44.539 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-05-15T16:35:44.568 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-05-15T16:35:44.888 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libllvm14:amd64. 2023-05-15T16:35:44.909 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-05-15T16:35:44.954 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-15T16:35:46.674 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-05-15T16:35:46.695 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-15T16:35:46.740 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-15T16:35:47.009 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libmbim-proxy. 2023-05-15T16:35:47.022 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-15T16:35:47.059 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-15T16:35:47.345 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-05-15T16:35:47.367 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-15T16:35:47.429 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-15T16:35:47.821 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libndp0:amd64. 2023-05-15T16:35:47.844 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-05-15T16:35:47.898 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-15T16:35:48.218 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libnm0:amd64. 2023-05-15T16:35:48.240 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-05-15T16:35:48.284 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-15T16:35:48.596 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libpq5:amd64. 2023-05-15T16:35:48.617 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../16-libpq5_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-15T16:35:48.654 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-15T16:35:48.990 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-05-15T16:35:49.012 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-15T16:35:49.056 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-15T16:35:49.342 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libqmi-proxy. 2023-05-15T16:35:49.355 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-15T16:35:49.392 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-15T16:35:49.636 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-05-15T16:35:49.658 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-15T16:35:49.711 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-15T16:35:50.257 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-05-15T16:35:50.279 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-05-15T16:35:50.323 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-05-15T16:35:50.667 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package modemmanager. 2023-05-15T16:35:50.689 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-15T16:35:50.734 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-15T16:35:51.340 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package network-manager. 2023-05-15T16:35:51.362 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-05-15T16:35:51.415 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-05-15T16:35:52.048 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package ppp. 2023-05-15T16:35:52.070 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-05-15T16:35:52.386 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-05-15T16:35:52.704 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package pptp-linux. 2023-05-15T16:35:52.724 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-05-15T16:35:52.768 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-05-15T16:35:53.623 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package network-manager-pptp. 2023-05-15T16:35:53.645 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-05-15T16:35:53.697 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-05-15T16:35:54.000 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-client-common. 2023-05-15T16:35:54.022 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-05-15T16:35:54.067 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-client-common (238) ... 2023-05-15T16:35:54.379 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-client-14. 2023-05-15T16:35:54.401 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../27-postgresql-client-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-15T16:35:54.471 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-15T16:35:54.984 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-common. 2023-05-15T16:35:55.006 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-05-15T16:35:55.060 INFO:teuthology.orchestra.run.smithi161.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-05-15T16:35:55.090 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-common (238) ... 2023-05-15T16:35:55.558 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-14. 2023-05-15T16:35:55.580 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../29-postgresql-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-15T16:35:55.627 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-15T16:35:56.828 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql. 2023-05-15T16:35:56.851 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-05-15T16:35:56.894 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql (14+238) ... 2023-05-15T16:35:57.121 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-client. 2023-05-15T16:35:57.134 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-05-15T16:35:57.171 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-client (14+238) ... 2023-05-15T16:35:57.415 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package postgresql-contrib. 2023-05-15T16:35:57.428 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-05-15T16:35:57.465 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking postgresql-contrib (14+238) ... 2023-05-15T16:35:57.785 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package tcl8.6. 2023-05-15T16:35:57.807 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-05-15T16:35:57.851 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-15T16:35:58.154 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package tcl. 2023-05-15T16:35:58.176 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-05-15T16:35:58.225 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-05-15T16:35:58.703 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package wpasupplicant. 2023-05-15T16:35:58.728 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-05-15T16:35:58.834 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-15T16:35:59.197 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-05-15T16:35:59.219 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-05-15T16:35:59.263 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-05-15T16:35:59.650 INFO:teuthology.orchestra.run.smithi161.stdout:Selecting previously unselected package usb-modeswitch. 2023-05-15T16:35:59.672 INFO:teuthology.orchestra.run.smithi161.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-05-15T16:35:59.725 INFO:teuthology.orchestra.run.smithi161.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-15T16:36:00.000 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-client-common (238) ... 2023-05-15T16:36:00.222 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up flex (2.6.4-8build2) ... 2023-05-15T16:36:00.348 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-15T16:36:00.449 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-15T16:36:00.575 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-05-15T16:36:00.701 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-15T16:36:00.827 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-15T16:36:01.303 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-05-15T16:36:01.391 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-15T16:36:01.744 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-15T16:36:01.744 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-15T16:36:02.235 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-05-15T16:36:02.361 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-15T16:36:02.488 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-05-15T16:36:02.614 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-05-15T16:36:02.740 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-05-15T16:36:02.866 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-15T16:36:02.992 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-05-15T16:36:03.638 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-15T16:36:03.765 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up dump (0.4b47-3) ... 2023-05-15T16:36:03.858 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-05-15T16:36:03.925 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-15T16:36:04.034 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-15T16:36:04.143 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up tcl (8.6.11+1build2) ... 2023-05-15T16:36:04.269 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libjson-perl (4.04000-1) ... 2023-05-15T16:36:04.395 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-05-15T16:36:04.486 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-05-15T16:36:04.547 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up indent (2.2.12-1build2) ... 2023-05-15T16:36:04.673 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-15T16:36:04.849 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-15T16:36:04.975 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-15T16:36:05.084 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-05-15T16:36:05.386 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-client (14+238) ... 2023-05-15T16:36:05.512 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-05-15T16:36:06.003 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:36:06.003 INFO:teuthology.orchestra.run.smithi161.stdout:The following network interfaces were found in /etc/network/interfaces 2023-05-15T16:36:06.003 INFO:teuthology.orchestra.run.smithi161.stdout:which means they are currently configured by ifupdown: 2023-05-15T16:36:06.004 INFO:teuthology.orchestra.run.smithi161.stdout:- enp3s0f1 2023-05-15T16:36:06.004 INFO:teuthology.orchestra.run.smithi161.stdout:If you want to manage those interfaces with NetworkManager instead 2023-05-15T16:36:06.004 INFO:teuthology.orchestra.run.smithi161.stdout:remove their configuration from /etc/network/interfaces. 2023-05-15T16:36:06.004 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:36:06.121 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-05-15T16:36:06.447 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-05-15T16:36:06.806 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-05-15T16:36:07.306 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-15T16:36:07.441 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-15T16:36:07.575 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-05-15T16:36:07.701 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-common (238) ... 2023-05-15T16:36:08.637 INFO:teuthology.orchestra.run.smithi161.stdout:Adding user postgres to group ssl-cert 2023-05-15T16:36:08.831 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:36:08.831 INFO:teuthology.orchestra.run.smithi161.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-05-15T16:36:09.027 INFO:teuthology.orchestra.run.smithi161.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-05-15T16:36:09.027 INFO:teuthology.orchestra.run.smithi161.stdout:Removing obsolete dictionary files: 2023-05-15T16:36:09.595 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-05-15T16:36:10.003 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-15T16:36:10.303 INFO:teuthology.orchestra.run.smithi161.stdout:Creating new PostgreSQL cluster 14/main ... 2023-05-15T16:36:10.327 INFO:teuthology.orchestra.run.smithi161.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-05-15T16:36:10.370 INFO:teuthology.orchestra.run.smithi161.stdout:The files belonging to this database system will be owned by user "postgres". 2023-05-15T16:36:10.370 INFO:teuthology.orchestra.run.smithi161.stdout:This user must also own the server process. 2023-05-15T16:36:10.371 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:36:10.371 INFO:teuthology.orchestra.run.smithi161.stdout:The database cluster will be initialized with locale "en_US". 2023-05-15T16:36:10.371 INFO:teuthology.orchestra.run.smithi161.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-05-15T16:36:10.371 INFO:teuthology.orchestra.run.smithi161.stdout:The default text search configuration will be set to "english". 2023-05-15T16:36:10.371 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:36:10.371 INFO:teuthology.orchestra.run.smithi161.stdout:Data page checksums are disabled. 2023-05-15T16:36:10.372 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:36:10.372 INFO:teuthology.orchestra.run.smithi161.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-05-15T16:36:10.372 INFO:teuthology.orchestra.run.smithi161.stdout:creating subdirectories ... ok 2023-05-15T16:36:10.372 INFO:teuthology.orchestra.run.smithi161.stdout:selecting dynamic shared memory implementation ... posix 2023-05-15T16:36:10.385 INFO:teuthology.orchestra.run.smithi161.stdout:selecting default max_connections ... 100 2023-05-15T16:36:10.406 INFO:teuthology.orchestra.run.smithi161.stdout:selecting default shared_buffers ... 128MB 2023-05-15T16:36:10.413 INFO:teuthology.orchestra.run.smithi161.stdout:selecting default time zone ... Etc/UTC 2023-05-15T16:36:10.413 INFO:teuthology.orchestra.run.smithi161.stdout:creating configuration files ... ok 2023-05-15T16:36:10.528 INFO:teuthology.orchestra.run.smithi161.stdout:running bootstrap script ... ok 2023-05-15T16:36:11.150 INFO:teuthology.orchestra.run.smithi161.stdout:performing post-bootstrap initialization ... ok 2023-05-15T16:36:11.899 INFO:teuthology.orchestra.run.smithi161.stdout:syncing data to disk ... ok 2023-05-15T16:36:12.280 INFO:teuthology.orchestra.run.smithi161.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-05-15T16:36:15.077 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-15T16:36:15.178 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql-contrib (14+238) ... 2023-05-15T16:36:15.287 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up postgresql (14+238) ... 2023-05-15T16:36:15.414 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-15T16:36:15.540 INFO:teuthology.orchestra.run.smithi161.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-15T16:36:15.792 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-05-15T16:36:15.792 INFO:teuthology.orchestra.run.smithi161.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-05-15T16:36:16.375 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-05-15T16:36:16.669 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-15T16:36:16.821 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-15T16:36:17.863 INFO:teuthology.orchestra.run.smithi062.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-05-15T16:36:18.043 INFO:teuthology.orchestra.run.smithi062.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-05-15T16:36:18.049 INFO:teuthology.orchestra.run.smithi062.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-05-15T16:36:18.329 INFO:teuthology.orchestra.run.smithi062.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-05-15T16:36:18.329 INFO:teuthology.orchestra.run.smithi062.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-05-15T16:36:18.607 INFO:teuthology.orchestra.run.smithi062.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.7-0ubuntu0.22.04.1 [141 kB] 2023-05-15T16:36:18.651 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-05-15T16:36:18.674 INFO:teuthology.orchestra.run.smithi062.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-05-15T16:36:18.759 INFO:teuthology.orchestra.run.smithi161.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-05-15T16:36:19.031 INFO:teuthology.orchestra.run.smithi062.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-05-15T16:36:19.133 INFO:teuthology.orchestra.run.smithi062.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.9 [2,373 kB] 2023-05-15T16:36:19.395 INFO:teuthology.orchestra.run.smithi161.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-15T16:36:19.397 DEBUG:teuthology.parallel:result is None 2023-05-15T16:36:20.178 INFO:teuthology.orchestra.run.smithi062.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-05-15T16:36:20.262 INFO:teuthology.orchestra.run.smithi062.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-05-15T16:36:20.778 INFO:teuthology.orchestra.run.smithi062.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-05-15T16:36:21.144 INFO:teuthology.orchestra.run.smithi062.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-05-15T16:36:21.191 INFO:teuthology.orchestra.run.smithi062.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-05-15T16:36:21.193 INFO:teuthology.orchestra.run.smithi062.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-05-15T16:36:21.201 INFO:teuthology.orchestra.run.smithi062.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-05-15T16:36:21.206 INFO:teuthology.orchestra.run.smithi062.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.7-0ubuntu0.22.04.1 [1,220 kB] 2023-05-15T16:36:21.471 INFO:teuthology.orchestra.run.smithi062.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-05-15T16:36:21.487 INFO:teuthology.orchestra.run.smithi062.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.7-0ubuntu0.22.04.1 [16.1 MB] 2023-05-15T16:36:29.354 INFO:teuthology.orchestra.run.smithi062.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-05-15T16:36:29.519 INFO:teuthology.orchestra.run.smithi062.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-05-15T16:36:29.602 INFO:teuthology.orchestra.run.smithi062.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-05-15T16:36:29.602 INFO:teuthology.orchestra.run.smithi062.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-05-15T16:36:29.684 INFO:teuthology.orchestra.run.smithi062.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-05-15T16:36:29.692 INFO:teuthology.orchestra.run.smithi062.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-05-15T16:36:30.550 INFO:teuthology.orchestra.run.smithi062.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-05-15T16:36:30.560 INFO:teuthology.orchestra.run.smithi062.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-05-15T16:36:31.007 INFO:teuthology.orchestra.run.smithi062.stdout:Preconfiguring packages ... 2023-05-15T16:36:31.151 INFO:teuthology.orchestra.run.smithi062.stdout:Fetched 54.6 MB in 1min 1s (895 kB/s) 2023-05-15T16:36:31.273 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package flex. 2023-05-15T16:36:31.360 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137468 files and directories currently installed.) 2023-05-15T16:36:31.365 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-05-15T16:36:31.404 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking flex (2.6.4-8build2) ... 2023-05-15T16:36:31.964 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-15T16:36:32.143 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.9) over (3.0.2-0ubuntu1.7) ... 2023-05-15T16:36:32.542 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-15T16:36:33.085 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package bison. 2023-05-15T16:36:33.177 INFO:teuthology.orchestra.run.smithi062.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 137541 files and directories currently installed.) 2023-05-15T16:36:33.181 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-05-15T16:36:33.238 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-05-15T16:36:33.638 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-05-15T16:36:33.660 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-05-15T16:36:33.713 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-05-15T16:36:34.058 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package dump. 2023-05-15T16:36:34.080 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-05-15T16:36:34.124 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking dump (0.4b47-3) ... 2023-05-15T16:36:34.419 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package indent. 2023-05-15T16:36:34.433 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-05-15T16:36:34.477 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking indent (2.2.12-1build2) ... 2023-05-15T16:36:34.738 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-05-15T16:36:34.752 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-05-15T16:36:34.780 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-15T16:36:35.100 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-05-15T16:36:35.122 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-05-15T16:36:35.166 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-15T16:36:35.427 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-05-15T16:36:35.450 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-05-15T16:36:35.494 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-05-15T16:36:35.831 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libfl2:amd64. 2023-05-15T16:36:35.853 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-05-15T16:36:35.897 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-05-15T16:36:36.108 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-05-15T16:36:36.132 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-05-15T16:36:36.149 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-15T16:36:36.427 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libjson-perl. 2023-05-15T16:36:36.449 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-05-15T16:36:36.493 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-05-15T16:36:36.780 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libllvm14:amd64. 2023-05-15T16:36:36.802 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-05-15T16:36:36.846 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-15T16:36:38.582 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-05-15T16:36:38.604 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-15T16:36:38.649 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-15T16:36:38.927 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libmbim-proxy. 2023-05-15T16:36:38.948 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-15T16:36:38.993 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-15T16:36:39.295 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-05-15T16:36:39.317 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-15T16:36:39.354 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-15T16:36:39.690 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libndp0:amd64. 2023-05-15T16:36:39.712 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-05-15T16:36:39.756 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-15T16:36:40.084 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libnm0:amd64. 2023-05-15T16:36:40.106 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-05-15T16:36:40.150 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-15T16:36:40.487 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libpq5:amd64. 2023-05-15T16:36:40.509 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../16-libpq5_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-15T16:36:40.556 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-15T16:36:40.881 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-05-15T16:36:40.903 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-15T16:36:40.947 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-15T16:36:41.233 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libqmi-proxy. 2023-05-15T16:36:41.246 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-15T16:36:41.275 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-15T16:36:41.535 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-05-15T16:36:41.549 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-15T16:36:41.585 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-15T16:36:42.097 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-05-15T16:36:42.119 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-05-15T16:36:42.164 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-05-15T16:36:42.538 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package modemmanager. 2023-05-15T16:36:42.560 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-15T16:36:42.608 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-15T16:36:43.239 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package network-manager. 2023-05-15T16:36:43.261 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-05-15T16:36:43.314 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-05-15T16:36:43.929 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package ppp. 2023-05-15T16:36:43.951 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-05-15T16:36:44.274 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-05-15T16:36:44.592 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package pptp-linux. 2023-05-15T16:36:44.614 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-05-15T16:36:44.650 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-05-15T16:36:44.886 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package network-manager-pptp. 2023-05-15T16:36:44.899 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-05-15T16:36:44.936 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-05-15T16:36:45.239 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-client-common. 2023-05-15T16:36:45.261 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-05-15T16:36:45.305 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-client-common (238) ... 2023-05-15T16:36:45.617 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-client-14. 2023-05-15T16:36:45.639 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../27-postgresql-client-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-15T16:36:45.684 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-15T16:36:46.299 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-common. 2023-05-15T16:36:46.321 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-05-15T16:36:46.384 INFO:teuthology.orchestra.run.smithi062.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-05-15T16:36:46.406 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-common (238) ... 2023-05-15T16:36:47.165 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-14. 2023-05-15T16:36:47.188 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../29-postgresql-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-15T16:36:47.235 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-15T16:36:48.535 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql. 2023-05-15T16:36:48.549 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-05-15T16:36:48.593 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql (14+238) ... 2023-05-15T16:36:48.846 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-client. 2023-05-15T16:36:48.868 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-05-15T16:36:48.912 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-client (14+238) ... 2023-05-15T16:36:49.156 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package postgresql-contrib. 2023-05-15T16:36:49.179 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-05-15T16:36:49.223 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking postgresql-contrib (14+238) ... 2023-05-15T16:36:49.542 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package tcl8.6. 2023-05-15T16:36:49.556 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-05-15T16:36:49.600 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-15T16:36:49.853 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package tcl. 2023-05-15T16:36:49.876 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-05-15T16:36:49.924 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-05-15T16:36:50.240 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package wpasupplicant. 2023-05-15T16:36:50.263 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-05-15T16:36:50.306 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-15T16:36:50.685 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-05-15T16:36:50.699 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-05-15T16:36:50.744 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-05-15T16:36:51.131 INFO:teuthology.orchestra.run.smithi062.stdout:Selecting previously unselected package usb-modeswitch. 2023-05-15T16:36:51.154 INFO:teuthology.orchestra.run.smithi062.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-05-15T16:36:51.205 INFO:teuthology.orchestra.run.smithi062.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-15T16:36:51.491 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-client-common (238) ... 2023-05-15T16:36:51.695 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up flex (2.6.4-8build2) ... 2023-05-15T16:36:51.821 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-15T16:36:51.947 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-15T16:36:52.073 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-05-15T16:36:52.199 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-15T16:36:52.325 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-15T16:36:52.799 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-05-15T16:36:52.881 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-15T16:36:53.271 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-15T16:36:53.272 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-15T16:36:53.834 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-05-15T16:36:53.960 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-15T16:36:54.102 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-05-15T16:36:54.228 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-05-15T16:36:54.363 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-05-15T16:36:54.464 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-15T16:36:54.590 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-05-15T16:36:55.245 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-15T16:36:55.380 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up dump (0.4b47-3) ... 2023-05-15T16:36:55.458 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-05-15T16:36:55.523 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-15T16:36:55.741 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-15T16:36:55.884 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up tcl (8.6.11+1build2) ... 2023-05-15T16:36:56.010 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libjson-perl (4.04000-1) ... 2023-05-15T16:36:56.135 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-05-15T16:36:56.226 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-05-15T16:36:56.296 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up indent (2.2.12-1build2) ... 2023-05-15T16:36:56.430 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-15T16:36:56.582 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-15T16:36:56.707 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-15T16:36:56.833 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-05-15T16:36:57.001 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-client (14+238) ... 2023-05-15T16:36:57.128 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-05-15T16:36:57.646 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:36:57.646 INFO:teuthology.orchestra.run.smithi062.stdout:The following network interfaces were found in /etc/network/interfaces 2023-05-15T16:36:57.646 INFO:teuthology.orchestra.run.smithi062.stdout:which means they are currently configured by ifupdown: 2023-05-15T16:36:57.646 INFO:teuthology.orchestra.run.smithi062.stdout:- enp3s0f1 2023-05-15T16:36:57.646 INFO:teuthology.orchestra.run.smithi062.stdout:If you want to manage those interfaces with NetworkManager instead 2023-05-15T16:36:57.647 INFO:teuthology.orchestra.run.smithi062.stdout:remove their configuration from /etc/network/interfaces. 2023-05-15T16:36:57.647 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:36:57.778 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-05-15T16:36:58.121 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-05-15T16:36:58.483 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-05-15T16:36:59.080 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-15T16:36:59.224 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-15T16:36:59.350 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-05-15T16:36:59.475 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-common (238) ... 2023-05-15T16:37:00.333 INFO:teuthology.orchestra.run.smithi062.stdout:Adding user postgres to group ssl-cert 2023-05-15T16:37:00.513 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:37:00.513 INFO:teuthology.orchestra.run.smithi062.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-05-15T16:37:00.764 INFO:teuthology.orchestra.run.smithi062.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-05-15T16:37:00.764 INFO:teuthology.orchestra.run.smithi062.stdout:Removing obsolete dictionary files: 2023-05-15T16:37:01.401 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-05-15T16:37:01.786 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-15T16:37:02.133 INFO:teuthology.orchestra.run.smithi062.stdout:Creating new PostgreSQL cluster 14/main ... 2023-05-15T16:37:02.148 INFO:teuthology.orchestra.run.smithi062.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-05-15T16:37:02.198 INFO:teuthology.orchestra.run.smithi062.stdout:The files belonging to this database system will be owned by user "postgres". 2023-05-15T16:37:02.198 INFO:teuthology.orchestra.run.smithi062.stdout:This user must also own the server process. 2023-05-15T16:37:02.198 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:37:02.199 INFO:teuthology.orchestra.run.smithi062.stdout:The database cluster will be initialized with locale "en_US". 2023-05-15T16:37:02.199 INFO:teuthology.orchestra.run.smithi062.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-05-15T16:37:02.199 INFO:teuthology.orchestra.run.smithi062.stdout:The default text search configuration will be set to "english". 2023-05-15T16:37:02.199 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:37:02.199 INFO:teuthology.orchestra.run.smithi062.stdout:Data page checksums are disabled. 2023-05-15T16:37:02.199 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:37:02.199 INFO:teuthology.orchestra.run.smithi062.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-05-15T16:37:02.200 INFO:teuthology.orchestra.run.smithi062.stdout:creating subdirectories ... ok 2023-05-15T16:37:02.200 INFO:teuthology.orchestra.run.smithi062.stdout:selecting dynamic shared memory implementation ... posix 2023-05-15T16:37:02.216 INFO:teuthology.orchestra.run.smithi062.stdout:selecting default max_connections ... 100 2023-05-15T16:37:02.238 INFO:teuthology.orchestra.run.smithi062.stdout:selecting default shared_buffers ... 128MB 2023-05-15T16:37:02.248 INFO:teuthology.orchestra.run.smithi062.stdout:selecting default time zone ... Etc/UTC 2023-05-15T16:37:02.249 INFO:teuthology.orchestra.run.smithi062.stdout:creating configuration files ... ok 2023-05-15T16:37:02.368 INFO:teuthology.orchestra.run.smithi062.stdout:running bootstrap script ... ok 2023-05-15T16:37:03.121 INFO:teuthology.orchestra.run.smithi062.stdout:performing post-bootstrap initialization ... ok 2023-05-15T16:37:03.871 INFO:teuthology.orchestra.run.smithi062.stdout:syncing data to disk ... ok 2023-05-15T16:37:04.303 INFO:teuthology.orchestra.run.smithi062.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-05-15T16:37:07.118 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-15T16:37:07.244 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql-contrib (14+238) ... 2023-05-15T16:37:07.370 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up postgresql (14+238) ... 2023-05-15T16:37:07.504 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-15T16:37:07.614 INFO:teuthology.orchestra.run.smithi062.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-15T16:37:07.873 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-05-15T16:37:07.874 INFO:teuthology.orchestra.run.smithi062.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-05-15T16:37:08.524 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-05-15T16:37:08.835 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-15T16:37:08.987 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-15T16:37:10.365 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-05-15T16:37:10.465 INFO:teuthology.orchestra.run.smithi062.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-05-15T16:37:11.098 INFO:teuthology.orchestra.run.smithi062.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-15T16:37:11.100 DEBUG:teuthology.parallel:result is None 2023-05-15T16:37:46.366 INFO:teuthology.orchestra.run.smithi171.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2023-05-15T16:37:47.480 INFO:teuthology.orchestra.run.smithi171.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2023-05-15T16:37:47.508 INFO:teuthology.orchestra.run.smithi171.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.1 [263 kB] 2023-05-15T16:37:49.206 INFO:teuthology.orchestra.run.smithi171.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2023-05-15T16:37:49.258 INFO:teuthology.orchestra.run.smithi171.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2023-05-15T16:37:51.890 INFO:teuthology.orchestra.run.smithi171.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.7-0ubuntu0.22.04.1 [141 kB] 2023-05-15T16:37:52.516 INFO:teuthology.orchestra.run.smithi171.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2023-05-15T16:37:57.503 INFO:teuthology.orchestra.run.smithi171.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2023-05-15T16:37:57.532 INFO:teuthology.orchestra.run.smithi171.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.9 [2,373 kB] 2023-05-15T16:38:10.006 INFO:teuthology.orchestra.run.smithi171.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2023-05-15T16:38:10.088 INFO:teuthology.orchestra.run.smithi171.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.1 [1,094 kB] 2023-05-15T16:38:10.570 INFO:teuthology.orchestra.run.smithi171.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2023-05-15T16:38:10.710 INFO:teuthology.orchestra.run.smithi171.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2023-05-15T16:38:10.729 INFO:teuthology.orchestra.run.smithi171.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2023-05-15T16:38:10.730 INFO:teuthology.orchestra.run.smithi171.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2023-05-15T16:38:10.731 INFO:teuthology.orchestra.run.smithi171.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2023-05-15T16:38:10.733 INFO:teuthology.orchestra.run.smithi171.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.7-0ubuntu0.22.04.1 [1,220 kB] 2023-05-15T16:38:10.786 INFO:teuthology.orchestra.run.smithi171.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2023-05-15T16:38:10.794 INFO:teuthology.orchestra.run.smithi171.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.7-0ubuntu0.22.04.1 [16.1 MB] 2023-05-15T16:38:11.908 INFO:teuthology.orchestra.run.smithi171.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2023-05-15T16:38:12.072 INFO:teuthology.orchestra.run.smithi171.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2023-05-15T16:38:12.154 INFO:teuthology.orchestra.run.smithi171.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2023-05-15T16:38:12.155 INFO:teuthology.orchestra.run.smithi171.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2023-05-15T16:38:12.240 INFO:teuthology.orchestra.run.smithi171.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2023-05-15T16:38:12.250 INFO:teuthology.orchestra.run.smithi171.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2023-05-15T16:38:13.433 INFO:teuthology.orchestra.run.smithi171.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2023-05-15T16:38:13.447 INFO:teuthology.orchestra.run.smithi171.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2023-05-15T16:38:13.840 INFO:teuthology.orchestra.run.smithi171.stdout:Preconfiguring packages ... 2023-05-15T16:38:14.007 INFO:teuthology.orchestra.run.smithi171.stdout:Fetched 54.6 MB in 2min 43s (335 kB/s) 2023-05-15T16:38:14.147 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package flex. 2023-05-15T16:38:14.217 INFO:teuthology.orchestra.run.smithi171.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139905 files and directories currently installed.) 2023-05-15T16:38:14.221 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2023-05-15T16:38:14.262 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking flex (2.6.4-8build2) ... 2023-05-15T16:38:14.780 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-15T16:38:14.918 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.9) over (3.0.2-0ubuntu1.7) ... 2023-05-15T16:38:15.298 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-15T16:38:15.802 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package bison. 2023-05-15T16:38:15.875 INFO:teuthology.orchestra.run.smithi171.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 139978 files and directories currently installed.) 2023-05-15T16:38:15.879 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2023-05-15T16:38:15.920 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2023-05-15T16:38:16.313 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package liblzo2-2:amd64. 2023-05-15T16:38:16.326 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2023-05-15T16:38:16.363 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2023-05-15T16:38:16.674 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package dump. 2023-05-15T16:38:16.687 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2023-05-15T16:38:16.725 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking dump (0.4b47-3) ... 2023-05-15T16:38:17.011 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package indent. 2023-05-15T16:38:17.025 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../03-indent_2.2.12-1build2_amd64.deb ... 2023-05-15T16:38:17.062 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking indent (2.2.12-1build2) ... 2023-05-15T16:38:17.322 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libaio-dev:amd64. 2023-05-15T16:38:17.336 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2023-05-15T16:38:17.381 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-15T16:38:17.642 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libbluetooth3:amd64. 2023-05-15T16:38:17.656 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1_amd64.deb ... 2023-05-15T16:38:17.692 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-15T16:38:17.954 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libelf-dev:amd64. 2023-05-15T16:38:17.968 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2023-05-15T16:38:18.012 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2023-05-15T16:38:18.348 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libfl2:amd64. 2023-05-15T16:38:18.363 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2023-05-15T16:38:18.407 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2023-05-15T16:38:18.626 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libfl-dev:amd64. 2023-05-15T16:38:18.640 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2023-05-15T16:38:18.675 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-15T16:38:18.903 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libjson-perl. 2023-05-15T16:38:18.917 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2023-05-15T16:38:18.962 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libjson-perl (4.04000-1) ... 2023-05-15T16:38:19.281 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libllvm14:amd64. 2023-05-15T16:38:19.295 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1_amd64.deb ... 2023-05-15T16:38:19.340 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-15T16:38:20.709 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2023-05-15T16:38:20.723 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-15T16:38:20.759 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-15T16:38:21.011 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libmbim-proxy. 2023-05-15T16:38:21.025 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2023-05-15T16:38:21.069 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-15T16:38:21.389 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libmm-glib0:amd64. 2023-05-15T16:38:21.402 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-15T16:38:21.447 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-15T16:38:21.775 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libndp0:amd64. 2023-05-15T16:38:21.789 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2023-05-15T16:38:21.832 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-15T16:38:22.135 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libnm0:amd64. 2023-05-15T16:38:22.150 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2023-05-15T16:38:22.194 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-15T16:38:22.521 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libpq5:amd64. 2023-05-15T16:38:22.536 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../16-libpq5_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-15T16:38:22.580 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-15T16:38:22.932 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2023-05-15T16:38:22.946 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-15T16:38:22.990 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-15T16:38:23.285 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libqmi-proxy. 2023-05-15T16:38:23.298 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2023-05-15T16:38:23.343 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-15T16:38:23.545 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libssl-dev:amd64. 2023-05-15T16:38:23.559 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.9_amd64.deb ... 2023-05-15T16:38:23.595 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-15T16:38:24.091 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libteamdctl0:amd64. 2023-05-15T16:38:24.104 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2023-05-15T16:38:24.149 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2023-05-15T16:38:24.510 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package modemmanager. 2023-05-15T16:38:24.524 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.1_amd64.deb ... 2023-05-15T16:38:24.568 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-15T16:38:25.208 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package network-manager. 2023-05-15T16:38:25.222 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2023-05-15T16:38:25.273 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2023-05-15T16:38:25.889 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ppp. 2023-05-15T16:38:25.904 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2023-05-15T16:38:26.261 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2023-05-15T16:38:26.568 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package pptp-linux. 2023-05-15T16:38:26.581 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2023-05-15T16:38:26.610 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2023-05-15T16:38:26.846 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package network-manager-pptp. 2023-05-15T16:38:26.859 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2023-05-15T16:38:26.896 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2023-05-15T16:38:27.199 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package postgresql-client-common. 2023-05-15T16:38:27.212 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2023-05-15T16:38:27.249 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking postgresql-client-common (238) ... 2023-05-15T16:38:27.552 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package postgresql-client-14. 2023-05-15T16:38:27.565 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../27-postgresql-client-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-15T16:38:27.602 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-15T16:38:28.132 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package postgresql-common. 2023-05-15T16:38:28.144 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2023-05-15T16:38:28.199 INFO:teuthology.orchestra.run.smithi171.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2023-05-15T16:38:28.230 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking postgresql-common (238) ... 2023-05-15T16:38:28.689 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package postgresql-14. 2023-05-15T16:38:28.702 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../29-postgresql-14_14.7-0ubuntu0.22.04.1_amd64.deb ... 2023-05-15T16:38:28.742 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-15T16:38:29.984 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package postgresql. 2023-05-15T16:38:29.997 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2023-05-15T16:38:30.025 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking postgresql (14+238) ... 2023-05-15T16:38:30.235 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package postgresql-client. 2023-05-15T16:38:30.248 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2023-05-15T16:38:30.286 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking postgresql-client (14+238) ... 2023-05-15T16:38:30.513 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package postgresql-contrib. 2023-05-15T16:38:30.526 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2023-05-15T16:38:30.563 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking postgresql-contrib (14+238) ... 2023-05-15T16:38:30.882 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package tcl8.6. 2023-05-15T16:38:30.895 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2023-05-15T16:38:30.932 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-15T16:38:31.184 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package tcl. 2023-05-15T16:38:31.198 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2023-05-15T16:38:31.239 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking tcl (8.6.11+1build2) ... 2023-05-15T16:38:31.564 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package wpasupplicant. 2023-05-15T16:38:31.579 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2023-05-15T16:38:31.623 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-15T16:38:31.969 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package usb-modeswitch-data. 2023-05-15T16:38:31.983 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2023-05-15T16:38:32.011 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2023-05-15T16:38:32.374 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package usb-modeswitch. 2023-05-15T16:38:32.387 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2023-05-15T16:38:32.440 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-15T16:38:32.722 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up postgresql-client-common (238) ... 2023-05-15T16:38:32.931 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up flex (2.6.4-8build2) ... 2023-05-15T16:38:33.058 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2023-05-15T16:38:33.184 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libpq5:amd64 (14.7-0ubuntu0.22.04.1) ... 2023-05-15T16:38:33.327 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2023-05-15T16:38:33.453 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2023-05-15T16:38:33.571 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up postgresql-client-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-15T16:38:34.470 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2023-05-15T16:38:34.561 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2023-05-15T16:38:34.962 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-15T16:38:34.962 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2023-05-15T16:38:35.682 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2023-05-15T16:38:35.808 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.9) ... 2023-05-15T16:38:35.934 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2023-05-15T16:38:36.060 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2023-05-15T16:38:36.186 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2023-05-15T16:38:36.288 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2023-05-15T16:38:36.406 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2023-05-15T16:38:37.162 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1) ... 2023-05-15T16:38:37.272 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up dump (0.4b47-3) ... 2023-05-15T16:38:37.400 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2023-05-15T16:38:37.466 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.1) ... 2023-05-15T16:38:37.592 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1) ... 2023-05-15T16:38:37.718 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up tcl (8.6.11+1build2) ... 2023-05-15T16:38:37.845 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libjson-perl (4.04000-1) ... 2023-05-15T16:38:37.971 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2023-05-15T16:38:38.060 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2023-05-15T16:38:38.131 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up indent (2.2.12-1build2) ... 2023-05-15T16:38:38.249 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2023-05-15T16:38:38.401 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2023-05-15T16:38:38.527 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2023-05-15T16:38:38.653 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2023-05-15T16:38:38.821 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up postgresql-client (14+238) ... 2023-05-15T16:38:38.956 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2023-05-15T16:38:39.570 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:39.570 INFO:teuthology.orchestra.run.smithi171.stdout:The following network interfaces were found in /etc/network/interfaces 2023-05-15T16:38:39.570 INFO:teuthology.orchestra.run.smithi171.stdout:which means they are currently configured by ifupdown: 2023-05-15T16:38:39.571 INFO:teuthology.orchestra.run.smithi171.stdout:- enp3s0f1 2023-05-15T16:38:39.571 INFO:teuthology.orchestra.run.smithi171.stdout:If you want to manage those interfaces with NetworkManager instead 2023-05-15T16:38:39.571 INFO:teuthology.orchestra.run.smithi171.stdout:remove their configuration from /etc/network/interfaces. 2023-05-15T16:38:39.571 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:39.699 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2023-05-15T16:38:40.105 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2023-05-15T16:38:40.537 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2023-05-15T16:38:41.267 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2023-05-15T16:38:41.436 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2023-05-15T16:38:41.546 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2023-05-15T16:38:41.680 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up postgresql-common (238) ... 2023-05-15T16:38:42.607 INFO:teuthology.orchestra.run.smithi171.stdout:Adding user postgres to group ssl-cert 2023-05-15T16:38:42.855 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:42.855 INFO:teuthology.orchestra.run.smithi171.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2023-05-15T16:38:43.085 INFO:teuthology.orchestra.run.smithi171.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2023-05-15T16:38:43.086 INFO:teuthology.orchestra.run.smithi171.stdout:Removing obsolete dictionary files: 2023-05-15T16:38:43.828 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2023-05-15T16:38:44.317 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up postgresql-14 (14.7-0ubuntu0.22.04.1) ... 2023-05-15T16:38:44.651 INFO:teuthology.orchestra.run.smithi171.stdout:Creating new PostgreSQL cluster 14/main ... 2023-05-15T16:38:44.670 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2023-05-15T16:38:44.727 INFO:teuthology.orchestra.run.smithi171.stdout:The files belonging to this database system will be owned by user "postgres". 2023-05-15T16:38:44.728 INFO:teuthology.orchestra.run.smithi171.stdout:This user must also own the server process. 2023-05-15T16:38:44.728 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:44.728 INFO:teuthology.orchestra.run.smithi171.stdout:The database cluster will be initialized with locale "en_US". 2023-05-15T16:38:44.728 INFO:teuthology.orchestra.run.smithi171.stdout:The default database encoding has accordingly been set to "LATIN1". 2023-05-15T16:38:44.728 INFO:teuthology.orchestra.run.smithi171.stdout:The default text search configuration will be set to "english". 2023-05-15T16:38:44.728 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:44.729 INFO:teuthology.orchestra.run.smithi171.stdout:Data page checksums are disabled. 2023-05-15T16:38:44.729 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:44.729 INFO:teuthology.orchestra.run.smithi171.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2023-05-15T16:38:44.729 INFO:teuthology.orchestra.run.smithi171.stdout:creating subdirectories ... ok 2023-05-15T16:38:44.730 INFO:teuthology.orchestra.run.smithi171.stdout:selecting dynamic shared memory implementation ... posix 2023-05-15T16:38:44.750 INFO:teuthology.orchestra.run.smithi171.stdout:selecting default max_connections ... 100 2023-05-15T16:38:44.781 INFO:teuthology.orchestra.run.smithi171.stdout:selecting default shared_buffers ... 128MB 2023-05-15T16:38:44.794 INFO:teuthology.orchestra.run.smithi171.stdout:selecting default time zone ... Etc/UTC 2023-05-15T16:38:44.795 INFO:teuthology.orchestra.run.smithi171.stdout:creating configuration files ... ok 2023-05-15T16:38:44.966 INFO:teuthology.orchestra.run.smithi171.stdout:running bootstrap script ... ok 2023-05-15T16:38:45.595 INFO:teuthology.orchestra.run.smithi171.stdout:performing post-bootstrap initialization ... ok 2023-05-15T16:38:46.150 INFO:teuthology.orchestra.run.smithi171.stdout:syncing data to disk ... ok 2023-05-15T16:38:46.661 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2023-05-15T16:38:49.686 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2023-05-15T16:38:49.795 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up postgresql-contrib (14+238) ... 2023-05-15T16:38:49.930 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up postgresql (14+238) ... 2023-05-15T16:38:50.056 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2023-05-15T16:38:50.182 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.1) ... 2023-05-15T16:38:50.436 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2023-05-15T16:38:50.437 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2023-05-15T16:38:51.244 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2023-05-15T16:38:51.546 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-15T16:38:51.698 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-15T16:38:53.028 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-05-15T16:38:53.113 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-05-15T16:38:53.752 INFO:teuthology.orchestra.run.smithi171.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-05-15T16:38:53.757 DEBUG:teuthology.parallel:result is None 2023-05-15T16:38:53.758 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ef2746e02c24971e8f0b792fa43f63ba4ae04ec2 2023-05-15T16:38:53.900 DEBUG:teuthology.orchestra.run.smithi062:> dpkg-query -W -f '${Version}' ceph 2023-05-15T16:38:53.923 INFO:teuthology.orchestra.run.smithi062.stdout:18.0.0-3097-gef2746e0-1jammy 2023-05-15T16:38:53.925 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3097-gef2746e0-1jammy 2023-05-15T16:38:53.925 INFO:teuthology.task.install:The correct ceph version 18.0.0-3097-gef2746e0-1jammy is installed. 2023-05-15T16:38:53.926 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ef2746e02c24971e8f0b792fa43f63ba4ae04ec2 2023-05-15T16:38:54.068 DEBUG:teuthology.orchestra.run.smithi161:> dpkg-query -W -f '${Version}' ceph 2023-05-15T16:38:54.088 INFO:teuthology.orchestra.run.smithi161.stdout:18.0.0-3097-gef2746e0-1jammy 2023-05-15T16:38:54.088 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3097-gef2746e0-1jammy 2023-05-15T16:38:54.088 INFO:teuthology.task.install:The correct ceph version 18.0.0-3097-gef2746e0-1jammy is installed. 2023-05-15T16:38:54.089 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=ef2746e02c24971e8f0b792fa43f63ba4ae04ec2 2023-05-15T16:38:54.224 DEBUG:teuthology.orchestra.run.smithi171:> dpkg-query -W -f '${Version}' ceph 2023-05-15T16:38:54.246 INFO:teuthology.orchestra.run.smithi171.stdout:18.0.0-3097-gef2746e0-1jammy 2023-05-15T16:38:54.248 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-3097-gef2746e0-1jammy 2023-05-15T16:38:54.248 INFO:teuthology.task.install:The correct ceph version 18.0.0-3097-gef2746e0-1jammy is installed. 2023-05-15T16:38:54.249 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-05-15T16:38:54.249 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:38:54.250 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-15T16:38:54.264 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-05-15T16:38:54.265 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-15T16:38:54.278 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2023-05-15T16:38:54.278 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-05-15T16:38:54.305 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-05-15T16:38:54.306 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:38:54.306 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/daemon-helper 2023-05-15T16:38:54.320 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-15T16:38:54.373 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-05-15T16:38:54.374 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/daemon-helper 2023-05-15T16:38:54.388 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-15T16:38:54.444 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2023-05-15T16:38:54.444 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/daemon-helper 2023-05-15T16:38:54.462 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-05-15T16:38:54.520 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-05-15T16:38:54.520 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:38:54.521 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-15T16:38:54.534 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-15T16:38:54.590 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-05-15T16:38:54.591 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-15T16:38:54.604 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-15T16:38:54.660 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2023-05-15T16:38:54.661 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/adjust-ulimits 2023-05-15T16:38:54.679 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-05-15T16:38:54.744 INFO:teuthology.run_tasks:Running task ceph... 2023-05-15T16:38:54.823 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-05-15T16:38:54.824 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 777 /var/log/ceph 2023-05-15T16:38:54.827 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 777 /var/log/ceph 2023-05-15T16:38:54.829 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 777 /var/log/ceph 2023-05-15T16:38:54.847 INFO:tasks.ceph:Disabling ceph logrotate... 2023-05-15T16:38:54.848 DEBUG:teuthology.orchestra.run.smithi062:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-15T16:38:54.884 DEBUG:teuthology.orchestra.run.smithi161:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-15T16:38:54.886 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/logrotate.d/ceph 2023-05-15T16:38:54.908 INFO:tasks.ceph:Creating extra log directories... 2023-05-15T16:38:54.909 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-15T16:38:54.940 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-15T16:38:54.942 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-05-15T16:38:54.980 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-05-15T16:38:54.980 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-05-15T16:38:54.981 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-05-15T16:38:54.981 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:38:54.981 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-15T16:38:54.998 DEBUG:teuthology.orchestra.run.smithi062:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-15T16:38:55.075 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-05-15T16:38:55.075 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-15T16:38:55.125 DEBUG:teuthology.orchestra.run.smithi161:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-15T16:38:55.200 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2023-05-15T16:38:55.201 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-05-15T16:38:55.209 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-05-15T16:38:55.299 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-05-15T16:38:55.300 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-05-15T16:38:55.300 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-05-15_15:47:06-fs-wip-yuri3-testing-2023-05-10-0851-reef-distro-default-smithi/7274453', 'branch': 'wip-yuri3-testing-2023-05-10-0851-reef', 'description': 'fs/fscrypt/{begin/{0-install 1-ceph 2-logrotate} bluestore-bitmap clusters/1-mds-1-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/v1 mount overrides/{distro/testing/k-testing}} overrides/{ignorelist_health ignorelist_health_more ignorelist_wrongly_marked_down pg-warn} tasks/fscrypt-common}', 'email': None, 'first_in_suite': False, 'job_id': '7274453', 'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-05-15_15:47:06-fs-wip-yuri3-testing-2023-05-10-0851-reef-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri3-testing-2023-05-10-0851-reef'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'ef2746e02c24971e8f0b792fa43f63ba4ae04ec2'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'ef2746e02c24971e8f0b792fa43f63ba4ae04ec2'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri3-testing-2023-05-10-0851-reef', 'sha1': 'ef2746e02c24971e8f0b792fa43f63ba4ae04ec2'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 73, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'], ['client.0']], 'seed': 8519, 'sha1': 'ef2746e02c24971e8f0b792fa43f63ba4ae04ec2', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'fs', 'suite_branch': 'wip-yuri3-testing-2023-05-10-0851-reef', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'ef2746e02c24971e8f0b792fa43f63ba4ae04ec2', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi062.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBHXRpeZMN8p3yI2XrS46rkwxnMPF0O7pbTzDubjX0sDfqTswOfNe9Cy+29EDysF2dy5KQl1LNZlBFWxdSKuTGM=', 'smithi161.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCmHBCpsyyp78dEI35jIobg8lTuM1zHQFEN9NbCk5dJLPnJvqK6+rzSeVnqJqzj3rn6MEEz8cQkuDvGTfu3Qe+8=', 'smithi171.front.sepia.ceph.com': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIMP/2RsqyWhdbDFdhSNw+U48Y65s9x2EExzkCG9TAJdC'}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'ef2746e02c24971e8f0b792fa43f63ba4ae04ec2'}}, {'ceph': None}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_fscrypt']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '69caab8ec6f44c61c991ae693e8e7b8cd859a896', 'timestamp': '2023-05-15_15:47:06', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.23459'} 2023-05-15T16:38:55.301 DEBUG:teuthology.orchestra.run.smithi062:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-15T16:38:55.304 DEBUG:teuthology.orchestra.run.smithi161:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-15T16:38:55.306 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-05-15T16:38:55.342 DEBUG:teuthology.orchestra.run.smithi062:> sudo install -d -m0777 -- /var/run/ceph 2023-05-15T16:38:55.351 DEBUG:teuthology.orchestra.run.smithi161:> sudo install -d -m0777 -- /var/run/ceph 2023-05-15T16:38:55.354 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/run/ceph 2023-05-15T16:38:55.401 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:38:55.401 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/scratch_devs of=/dev/stdout 2023-05-15T16:38:55.410 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-15T16:38:55.411 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_1 2023-05-15T16:38:55.459 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-15T16:38:55.459 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-15T16:38:55.459 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 881 Links: 1 2023-05-15T16:38:55.459 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-15T16:38:55.460 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2023-05-15 16:28:51.146335594 +0000 2023-05-15T16:38:55.460 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2023-05-15 16:28:50.782338846 +0000 2023-05-15T16:38:55.460 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2023-05-15 16:28:50.782338846 +0000 2023-05-15T16:38:55.460 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2023-05-15T16:38:55.460 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-15T16:38:55.513 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2023-05-15T16:38:55.514 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2023-05-15T16:38:55.514 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000500007 s, 1.0 MB/s 2023-05-15T16:38:55.515 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-15T16:38:55.564 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_2 2023-05-15T16:38:55.615 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-15T16:38:55.615 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-15T16:38:55.615 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 899 Links: 1 2023-05-15T16:38:55.615 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-15T16:38:55.616 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2023-05-15 16:28:51.746330236 +0000 2023-05-15T16:38:55.616 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2023-05-15 16:28:51.358333702 +0000 2023-05-15T16:38:55.616 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2023-05-15 16:28:51.358333702 +0000 2023-05-15T16:38:55.616 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2023-05-15T16:38:55.617 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-15T16:38:55.670 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2023-05-15T16:38:55.671 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2023-05-15T16:38:55.671 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000444189 s, 1.2 MB/s 2023-05-15T16:38:55.672 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-15T16:38:55.719 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_3 2023-05-15T16:38:55.770 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-15T16:38:55.770 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-15T16:38:55.770 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 918 Links: 1 2023-05-15T16:38:55.770 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-15T16:38:55.770 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2023-05-15 16:28:51.994328021 +0000 2023-05-15T16:38:55.771 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2023-05-15 16:28:51.990328057 +0000 2023-05-15T16:38:55.771 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2023-05-15 16:28:51.990328057 +0000 2023-05-15T16:38:55.771 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2023-05-15T16:38:55.771 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-15T16:38:55.825 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2023-05-15T16:38:55.826 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2023-05-15T16:38:55.826 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.00044642 s, 1.1 MB/s 2023-05-15T16:38:55.827 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-15T16:38:55.876 DEBUG:teuthology.orchestra.run.smithi062:> stat /dev/vg_nvme/lv_4 2023-05-15T16:38:55.922 INFO:teuthology.orchestra.run.smithi062.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-15T16:38:55.923 INFO:teuthology.orchestra.run.smithi062.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-15T16:38:55.923 INFO:teuthology.orchestra.run.smithi062.stdout:Device: 5h/5d Inode: 935 Links: 1 2023-05-15T16:38:55.923 INFO:teuthology.orchestra.run.smithi062.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-15T16:38:55.924 INFO:teuthology.orchestra.run.smithi062.stdout:Access: 2023-05-15 16:28:52.974319267 +0000 2023-05-15T16:38:55.924 INFO:teuthology.orchestra.run.smithi062.stdout:Modify: 2023-05-15 16:28:52.598322626 +0000 2023-05-15T16:38:55.924 INFO:teuthology.orchestra.run.smithi062.stdout:Change: 2023-05-15 16:28:52.598322626 +0000 2023-05-15T16:38:55.924 INFO:teuthology.orchestra.run.smithi062.stdout: Birth: - 2023-05-15T16:38:55.924 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-15T16:38:55.977 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records in 2023-05-15T16:38:55.978 INFO:teuthology.orchestra.run.smithi062.stderr:1+0 records out 2023-05-15T16:38:55.978 INFO:teuthology.orchestra.run.smithi062.stderr:512 bytes copied, 0.000507773 s, 1.0 MB/s 2023-05-15T16:38:55.979 DEBUG:teuthology.orchestra.run.smithi062:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-15T16:38:56.028 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-15T16:38:56.028 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-05-15T16:38:56.029 DEBUG:teuthology.orchestra.run.smithi161:> dd if=/scratch_devs of=/dev/stdout 2023-05-15T16:38:56.035 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-05-15T16:38:56.035 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_1 2023-05-15T16:38:56.081 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-05-15T16:38:56.081 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-15T16:38:56.081 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 887 Links: 1 2023-05-15T16:38:56.081 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-15T16:38:56.082 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-05-15 16:28:50.914278954 +0000 2023-05-15T16:38:56.082 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-05-15 16:28:50.534284513 +0000 2023-05-15T16:38:56.082 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-05-15 16:28:50.534284513 +0000 2023-05-15T16:38:56.082 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2023-05-15T16:38:56.082 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-05-15T16:38:56.135 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-05-15T16:38:56.135 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-05-15T16:38:56.135 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000493923 s, 1.0 MB/s 2023-05-15T16:38:56.136 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-05-15T16:38:56.185 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_2 2023-05-15T16:38:56.233 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-05-15T16:38:56.233 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-15T16:38:56.233 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 903 Links: 1 2023-05-15T16:38:56.233 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-15T16:38:56.233 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-05-15 16:28:51.510270244 +0000 2023-05-15T16:38:56.234 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-05-15 16:28:51.138275679 +0000 2023-05-15T16:38:56.234 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-05-15 16:28:51.138275679 +0000 2023-05-15T16:38:56.234 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2023-05-15T16:38:56.234 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-05-15T16:38:56.287 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-05-15T16:38:56.288 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-05-15T16:38:56.288 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.00051694 s, 990 kB/s 2023-05-15T16:38:56.289 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-05-15T16:38:56.338 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_3 2023-05-15T16:38:56.384 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-05-15T16:38:56.384 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-15T16:38:56.385 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 921 Links: 1 2023-05-15T16:38:56.385 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-15T16:38:56.385 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-05-15 16:28:52.090261770 +0000 2023-05-15T16:38:56.385 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-05-15 16:28:51.734266971 +0000 2023-05-15T16:38:56.385 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-05-15 16:28:51.734266971 +0000 2023-05-15T16:38:56.385 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2023-05-15T16:38:56.386 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-05-15T16:38:56.439 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-05-15T16:38:56.439 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-05-15T16:38:56.439 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000536251 s, 955 kB/s 2023-05-15T16:38:56.440 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-05-15T16:38:56.490 DEBUG:teuthology.orchestra.run.smithi161:> stat /dev/vg_nvme/lv_4 2023-05-15T16:38:56.536 INFO:teuthology.orchestra.run.smithi161.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-05-15T16:38:56.536 INFO:teuthology.orchestra.run.smithi161.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-05-15T16:38:56.537 INFO:teuthology.orchestra.run.smithi161.stdout:Device: 5h/5d Inode: 938 Links: 1 2023-05-15T16:38:56.537 INFO:teuthology.orchestra.run.smithi161.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-05-15T16:38:56.537 INFO:teuthology.orchestra.run.smithi161.stdout:Access: 2023-05-15 16:28:52.734252372 +0000 2023-05-15T16:38:56.537 INFO:teuthology.orchestra.run.smithi161.stdout:Modify: 2023-05-15 16:28:52.354257918 +0000 2023-05-15T16:38:56.537 INFO:teuthology.orchestra.run.smithi161.stdout:Change: 2023-05-15 16:28:52.354257918 +0000 2023-05-15T16:38:56.538 INFO:teuthology.orchestra.run.smithi161.stdout: Birth: - 2023-05-15T16:38:56.538 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-05-15T16:38:56.591 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records in 2023-05-15T16:38:56.591 INFO:teuthology.orchestra.run.smithi161.stderr:1+0 records out 2023-05-15T16:38:56.591 INFO:teuthology.orchestra.run.smithi161.stderr:512 bytes copied, 0.000536056 s, 955 kB/s 2023-05-15T16:38:56.592 DEBUG:teuthology.orchestra.run.smithi161:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-05-15T16:38:56.642 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-15T16:38:56.642 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-15T16:38:56.642 INFO:tasks.ceph:Generating config... 2023-05-15T16:38:56.644 INFO:tasks.ceph:[client] client mount timeout = 600 2023-05-15T16:38:56.644 INFO:tasks.ceph:[client] debug client = 20 2023-05-15T16:38:56.645 INFO:tasks.ceph:[client] debug ms = 1 2023-05-15T16:38:56.645 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-05-15T16:38:56.645 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-05-15T16:38:56.645 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2023-05-15T16:38:56.645 INFO:tasks.ceph:[mds] debug mds = 20 2023-05-15T16:38:56.646 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-05-15T16:38:56.646 INFO:tasks.ceph:[mds] debug ms = 1 2023-05-15T16:38:56.646 INFO:tasks.ceph:[mds] mds debug frag = True 2023-05-15T16:38:56.646 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-05-15T16:38:56.646 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-05-15T16:38:56.646 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-05-15T16:38:56.647 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-05-15T16:38:56.647 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-05-15T16:38:56.647 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-05-15T16:38:56.647 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-05-15T16:38:56.647 INFO:tasks.ceph:[mgr] debug ms = 1 2023-05-15T16:38:56.648 INFO:tasks.ceph:[mon] debug mon = 20 2023-05-15T16:38:56.648 INFO:tasks.ceph:[mon] debug ms = 1 2023-05-15T16:38:56.648 INFO:tasks.ceph:[mon] debug paxos = 20 2023-05-15T16:38:56.648 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-05-15T16:38:56.648 INFO:tasks.ceph:[osd] bdev async discard = True 2023-05-15T16:38:56.649 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-05-15T16:38:56.649 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-05-15T16:38:56.649 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-05-15T16:38:56.649 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-05-15T16:38:56.649 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-05-15T16:38:56.650 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-05-15T16:38:56.650 INFO:tasks.ceph:[osd] debug ms = 1 2023-05-15T16:38:56.650 INFO:tasks.ceph:[osd] debug osd = 20 2023-05-15T16:38:56.650 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-05-15T16:38:56.650 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-05-15T16:38:56.651 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-05-15T16:38:56.651 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-05-15T16:38:56.651 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-05-15T16:38:56.651 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-05-15T16:38:56.651 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-05-15T16:38:56.652 INFO:tasks.ceph:Setting up mon.a... 2023-05-15T16:38:56.652 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-05-15T16:38:56.687 INFO:teuthology.orchestra.run.smithi062.stdout:creating /etc/ceph/ceph.keyring 2023-05-15T16:38:56.815 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-05-15T16:38:56.895 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-15T16:38:56.950 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.62'), ('mon.b', '172.21.15.161'), ('mon.c', '[v2:172.21.15.161:3301,v1:172.21.15.161:6790]')] 2023-05-15T16:38:56.951 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.62,172.21.15.161,[v2:172.21.15.161:3301,v1:172.21.15.161:6790]', 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-05-15T16:38:56.952 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:38:56.952 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-05-15T16:38:56.999 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.62 --add b 172.21.15.161 --addv c '[v2:172.21.15.161:3301,v1:172.21.15.161:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-05-15T16:38:57.085 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-05-15T16:38:57.085 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: generated fsid fed834dd-24d2-40f4-8361-7c8c5a9484de 2023-05-15T16:38:57.086 INFO:teuthology.orchestra.run.smithi062.stdout:setting min_mon_release = pacific 2023-05-15T16:38:57.086 INFO:teuthology.orchestra.run.smithi062.stdout:epoch 0 2023-05-15T16:38:57.086 INFO:teuthology.orchestra.run.smithi062.stdout:fsid fed834dd-24d2-40f4-8361-7c8c5a9484de 2023-05-15T16:38:57.086 INFO:teuthology.orchestra.run.smithi062.stdout:last_changed 2023-05-15T16:38:57.083297+0000 2023-05-15T16:38:57.086 INFO:teuthology.orchestra.run.smithi062.stdout:created 2023-05-15T16:38:57.083297+0000 2023-05-15T16:38:57.086 INFO:teuthology.orchestra.run.smithi062.stdout:min_mon_release 16 (pacific) 2023-05-15T16:38:57.086 INFO:teuthology.orchestra.run.smithi062.stdout:election_strategy: 1 2023-05-15T16:38:57.087 INFO:teuthology.orchestra.run.smithi062.stdout:0: [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] mon.a 2023-05-15T16:38:57.087 INFO:teuthology.orchestra.run.smithi062.stdout:1: [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] mon.b 2023-05-15T16:38:57.087 INFO:teuthology.orchestra.run.smithi062.stdout:2: [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] mon.c 2023-05-15T16:38:57.087 INFO:teuthology.orchestra.run.smithi062.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-05-15T16:38:57.088 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-05-15T16:38:57.135 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID fed834dd-24d2-40f4-8361-7c8c5a9484de... 2023-05-15T16:38:57.138 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-15T16:38:57.179 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-15T16:38:57.182 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-05-15T16:38:57.209 INFO:teuthology.orchestra.run.smithi062.stdout:[global] 2023-05-15T16:38:57.209 INFO:teuthology.orchestra.run.smithi062.stdout: chdir = "" 2023-05-15T16:38:57.209 INFO:teuthology.orchestra.run.smithi062.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-15T16:38:57.209 INFO:teuthology.orchestra.run.smithi062.stdout: auth supported = cephx 2023-05-15T16:38:57.209 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.210 INFO:teuthology.orchestra.run.smithi062.stdout: filestore xattr use omap = true 2023-05-15T16:38:57.210 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.210 INFO:teuthology.orchestra.run.smithi062.stdout: mon clock drift allowed = 1.000 2023-05-15T16:38:57.210 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.210 INFO:teuthology.orchestra.run.smithi062.stdout: osd crush chooseleaf type = 0 2023-05-15T16:38:57.210 INFO:teuthology.orchestra.run.smithi062.stdout: auth debug = true 2023-05-15T16:38:57.210 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.211 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on old message = true 2023-05-15T16:38:57.211 INFO:teuthology.orchestra.run.smithi062.stdout: ms die on bug = true 2023-05-15T16:38:57.211 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.211 INFO:teuthology.orchestra.run.smithi062.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-15T16:38:57.211 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn max object skew = 0 2023-05-15T16:38:57.211 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.211 INFO:teuthology.orchestra.run.smithi062.stdout: # disable pg_autoscaler by default for new pools 2023-05-15T16:38:57.211 INFO:teuthology.orchestra.run.smithi062.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-15T16:38:57.212 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.212 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default size = 2 2023-05-15T16:38:57.212 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.212 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow primary affinity = true 2023-05-15T16:38:57.212 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd allow pg remap = true 2023-05-15T16:38:57.212 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on legacy crush tunables = false 2023-05-15T16:38:57.212 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on crush straw calc version zero = false 2023-05-15T16:38:57.213 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on no sortbitwise = false 2023-05-15T16:38:57.213 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on osd down out interval zero = false 2023-05-15T16:38:57.213 INFO:teuthology.orchestra.run.smithi062.stdout: mon warn on too few osds = false 2023-05-15T16:38:57.213 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-15T16:38:57.213 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-15T16:38:57.213 INFO:teuthology.orchestra.run.smithi062.stdout: mon_allow_pool_size_one = true 2023-05-15T16:38:57.213 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.213 INFO:teuthology.orchestra.run.smithi062.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-15T16:38:57.214 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.214 INFO:teuthology.orchestra.run.smithi062.stdout: osd default data pool replay window = 5 2023-05-15T16:38:57.214 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.214 INFO:teuthology.orchestra.run.smithi062.stdout: mon allow pool delete = true 2023-05-15T16:38:57.214 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.215 INFO:teuthology.orchestra.run.smithi062.stdout: mon cluster log file level = debug 2023-05-15T16:38:57.215 INFO:teuthology.orchestra.run.smithi062.stdout: debug asserts on shutdown = true 2023-05-15T16:38:57.215 INFO:teuthology.orchestra.run.smithi062.stdout: mon health detail to clog = false 2023-05-15T16:38:57.215 INFO:teuthology.orchestra.run.smithi062.stdout: mon host = "172.21.15.62,172.21.15.161,[v2:172.21.15.161:3301,v1:172.21.15.161:6790]" 2023-05-15T16:38:57.215 INFO:teuthology.orchestra.run.smithi062.stdout: mon pg warn min per osd = 0 2023-05-15T16:38:57.215 INFO:teuthology.orchestra.run.smithi062.stdout: fsid = fed834dd-24d2-40f4-8361-7c8c5a9484de 2023-05-15T16:38:57.216 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.216 INFO:teuthology.orchestra.run.smithi062.stdout:[osd] 2023-05-15T16:38:57.216 INFO:teuthology.orchestra.run.smithi062.stdout: osd journal size = 100 2023-05-15T16:38:57.216 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.216 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub load threshold = 5.0 2023-05-15T16:38:57.216 INFO:teuthology.orchestra.run.smithi062.stdout: osd scrub max interval = 600 2023-05-15T16:38:57.216 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.217 INFO:teuthology.orchestra.run.smithi062.stdout: osd recover clone overlap = true 2023-05-15T16:38:57.217 INFO:teuthology.orchestra.run.smithi062.stdout: osd recovery max chunk = 1048576 2023-05-15T16:38:57.217 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.217 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug shutdown = true 2023-05-15T16:38:57.217 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug op order = true 2023-05-15T16:38:57.217 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug verify stray on activate = true 2023-05-15T16:38:57.217 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.218 INFO:teuthology.orchestra.run.smithi062.stdout: osd open classes on start = true 2023-05-15T16:38:57.218 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug pg log writeout = true 2023-05-15T16:38:57.218 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.218 INFO:teuthology.orchestra.run.smithi062.stdout: osd deep scrub update digest min age = 30 2023-05-15T16:38:57.218 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.218 INFO:teuthology.orchestra.run.smithi062.stdout: osd map max advance = 10 2023-05-15T16:38:57.218 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.219 INFO:teuthology.orchestra.run.smithi062.stdout: journal zero on create = true 2023-05-15T16:38:57.219 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.219 INFO:teuthology.orchestra.run.smithi062.stdout: filestore ondisk finisher threads = 3 2023-05-15T16:38:57.219 INFO:teuthology.orchestra.run.smithi062.stdout: filestore apply finisher threads = 3 2023-05-15T16:38:57.219 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.219 INFO:teuthology.orchestra.run.smithi062.stdout: bdev debug aio = true 2023-05-15T16:38:57.219 INFO:teuthology.orchestra.run.smithi062.stdout: osd debug misdirected ops = true 2023-05-15T16:38:57.219 INFO:teuthology.orchestra.run.smithi062.stdout: bdev async discard = True 2023-05-15T16:38:57.220 INFO:teuthology.orchestra.run.smithi062.stdout: bdev enable discard = True 2023-05-15T16:38:57.220 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore allocator = bitmap 2023-05-15T16:38:57.220 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore block size = 96636764160 2023-05-15T16:38:57.220 INFO:teuthology.orchestra.run.smithi062.stdout: bluestore fsck on mount = True 2023-05-15T16:38:57.220 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluefs = 1/20 2023-05-15T16:38:57.220 INFO:teuthology.orchestra.run.smithi062.stdout: debug bluestore = 1/20 2023-05-15T16:38:57.220 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2023-05-15T16:38:57.221 INFO:teuthology.orchestra.run.smithi062.stdout: debug osd = 20 2023-05-15T16:38:57.221 INFO:teuthology.orchestra.run.smithi062.stdout: debug rocksdb = 4/10 2023-05-15T16:38:57.221 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd backfillfull_ratio = 0.85 2023-05-15T16:38:57.221 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd full ratio = 0.9 2023-05-15T16:38:57.221 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd nearfull ratio = 0.8 2023-05-15T16:38:57.221 INFO:teuthology.orchestra.run.smithi062.stdout: osd failsafe full ratio = 0.95 2023-05-15T16:38:57.221 INFO:teuthology.orchestra.run.smithi062.stdout: osd objectstore = bluestore 2023-05-15T16:38:57.221 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2023-05-15T16:38:57.222 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.222 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr] 2023-05-15T16:38:57.222 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2023-05-15T16:38:57.222 INFO:teuthology.orchestra.run.smithi062.stdout: debug mgr = 20 2023-05-15T16:38:57.222 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2023-05-15T16:38:57.222 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2023-05-15T16:38:57.222 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2023-05-15T16:38:57.223 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2023-05-15T16:38:57.223 INFO:teuthology.orchestra.run.smithi062.stdout: mgr/telemetry/nag = false 2023-05-15T16:38:57.223 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.223 INFO:teuthology.orchestra.run.smithi062.stdout:[mon] 2023-05-15T16:38:57.223 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2023-05-15T16:38:57.223 INFO:teuthology.orchestra.run.smithi062.stdout: debug mon = 20 2023-05-15T16:38:57.223 INFO:teuthology.orchestra.run.smithi062.stdout: debug paxos = 20 2023-05-15T16:38:57.223 INFO:teuthology.orchestra.run.smithi062.stdout: debug auth = 20 2023-05-15T16:38:57.224 INFO:teuthology.orchestra.run.smithi062.stdout: mon data avail warn = 5 2023-05-15T16:38:57.224 INFO:teuthology.orchestra.run.smithi062.stdout: mon mgr mkfs grace = 240 2023-05-15T16:38:57.224 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min pgs per osd = 4 2023-05-15T16:38:57.224 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd reporter subtree level = osd 2023-05-15T16:38:57.224 INFO:teuthology.orchestra.run.smithi062.stdout: mon osd prime pg temp = true 2023-05-15T16:38:57.224 INFO:teuthology.orchestra.run.smithi062.stdout: mon reweight min bytes per osd = 10 2023-05-15T16:38:57.224 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.224 INFO:teuthology.orchestra.run.smithi062.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-15T16:38:57.225 INFO:teuthology.orchestra.run.smithi062.stdout: auth mon ticket ttl = 660 # 11m 2023-05-15T16:38:57.225 INFO:teuthology.orchestra.run.smithi062.stdout: auth service ticket ttl = 240 # 4m 2023-05-15T16:38:57.225 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.225 INFO:teuthology.orchestra.run.smithi062.stdout: # don't complain about insecure global_id in the test suite 2023-05-15T16:38:57.225 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-15T16:38:57.225 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-15T16:38:57.225 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.226 INFO:teuthology.orchestra.run.smithi062.stdout: # 1m isn't quite enough 2023-05-15T16:38:57.226 INFO:teuthology.orchestra.run.smithi062.stdout: mon_down_mkfs_grace = 2m 2023-05-15T16:38:57.226 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.226 INFO:teuthology.orchestra.run.smithi062.stdout: mon_warn_on_filestore_osds = false 2023-05-15T16:38:57.226 INFO:teuthology.orchestra.run.smithi062.stdout: mon op complaint time = 120 2023-05-15T16:38:57.226 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:38:57.226 INFO:teuthology.orchestra.run.smithi062.stdout:[client] 2023-05-15T16:38:57.226 INFO:teuthology.orchestra.run.smithi062.stdout: rgw cache enabled = true 2023-05-15T16:38:57.227 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable ops log = true 2023-05-15T16:38:57.227 INFO:teuthology.orchestra.run.smithi062.stdout: rgw enable usage log = true 2023-05-15T16:38:57.227 INFO:teuthology.orchestra.run.smithi062.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-15T16:38:57.227 INFO:teuthology.orchestra.run.smithi062.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-15T16:38:57.227 INFO:teuthology.orchestra.run.smithi062.stdout: client mount timeout = 600 2023-05-15T16:38:57.227 INFO:teuthology.orchestra.run.smithi062.stdout: debug client = 20 2023-05-15T16:38:57.227 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2023-05-15T16:38:57.227 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 900 2023-05-15T16:38:57.228 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 900 2023-05-15T16:38:57.228 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.a] 2023-05-15T16:38:57.228 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.b] 2023-05-15T16:38:57.228 INFO:teuthology.orchestra.run.smithi062.stdout:[mon.c] 2023-05-15T16:38:57.228 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2023-05-15T16:38:57.228 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.c] 2023-05-15T16:38:57.228 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2023-05-15T16:38:57.229 INFO:teuthology.orchestra.run.smithi062.stdout:[mds] 2023-05-15T16:38:57.229 INFO:teuthology.orchestra.run.smithi062.stdout: debug mds = 20 2023-05-15T16:38:57.229 INFO:teuthology.orchestra.run.smithi062.stdout: debug mds balancer = 20 2023-05-15T16:38:57.230 INFO:teuthology.orchestra.run.smithi062.stdout: debug ms = 1 2023-05-15T16:38:57.230 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug frag = True 2023-05-15T16:38:57.230 INFO:teuthology.orchestra.run.smithi062.stdout: mds debug scatterstat = True 2023-05-15T16:38:57.230 INFO:teuthology.orchestra.run.smithi062.stdout: mds op complaint time = 180 2023-05-15T16:38:57.230 INFO:teuthology.orchestra.run.smithi062.stdout: mds verify scatter = True 2023-05-15T16:38:57.230 INFO:teuthology.orchestra.run.smithi062.stdout: osd op complaint time = 180 2023-05-15T16:38:57.230 INFO:teuthology.orchestra.run.smithi062.stdout: rados mon op timeout = 900 2023-05-15T16:38:57.230 INFO:teuthology.orchestra.run.smithi062.stdout: rados osd op timeout = 900 2023-05-15T16:38:57.231 INFO:teuthology.orchestra.run.smithi171.stdout:[global] 2023-05-15T16:38:57.232 INFO:teuthology.orchestra.run.smithi171.stdout: chdir = "" 2023-05-15T16:38:57.232 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-15T16:38:57.232 INFO:teuthology.orchestra.run.smithi171.stdout: auth supported = cephx 2023-05-15T16:38:57.232 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.232 INFO:teuthology.orchestra.run.smithi171.stdout: filestore xattr use omap = true 2023-05-15T16:38:57.232 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.232 INFO:teuthology.orchestra.run.smithi171.stdout: mon clock drift allowed = 1.000 2023-05-15T16:38:57.232 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.233 INFO:teuthology.orchestra.run.smithi171.stdout: osd crush chooseleaf type = 0 2023-05-15T16:38:57.233 INFO:teuthology.orchestra.run.smithi171.stdout: auth debug = true 2023-05-15T16:38:57.233 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.233 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on old message = true 2023-05-15T16:38:57.233 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on bug = true 2023-05-15T16:38:57.233 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.233 INFO:teuthology.orchestra.run.smithi171.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-15T16:38:57.234 INFO:teuthology.orchestra.run.smithi171.stdout: mon pg warn max object skew = 0 2023-05-15T16:38:57.234 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.234 INFO:teuthology.orchestra.run.smithi171.stdout: # disable pg_autoscaler by default for new pools 2023-05-15T16:38:57.234 INFO:teuthology.orchestra.run.smithi171.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-15T16:38:57.234 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.234 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default size = 2 2023-05-15T16:38:57.234 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.234 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow primary affinity = true 2023-05-15T16:38:57.235 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow pg remap = true 2023-05-15T16:38:57.235 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on legacy crush tunables = false 2023-05-15T16:38:57.235 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on crush straw calc version zero = false 2023-05-15T16:38:57.235 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on no sortbitwise = false 2023-05-15T16:38:57.235 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on osd down out interval zero = false 2023-05-15T16:38:57.235 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on too few osds = false 2023-05-15T16:38:57.235 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-15T16:38:57.235 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-15T16:38:57.236 INFO:teuthology.orchestra.run.smithi171.stdout: mon_allow_pool_size_one = true 2023-05-15T16:38:57.236 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.236 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-15T16:38:57.236 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.236 INFO:teuthology.orchestra.run.smithi171.stdout: osd default data pool replay window = 5 2023-05-15T16:38:57.236 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.236 INFO:teuthology.orchestra.run.smithi171.stdout: mon allow pool delete = true 2023-05-15T16:38:57.237 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.237 INFO:teuthology.orchestra.run.smithi171.stdout: mon cluster log file level = debug 2023-05-15T16:38:57.237 INFO:teuthology.orchestra.run.smithi171.stdout: debug asserts on shutdown = true 2023-05-15T16:38:57.237 INFO:teuthology.orchestra.run.smithi171.stdout: mon health detail to clog = false 2023-05-15T16:38:57.237 INFO:teuthology.orchestra.run.smithi171.stdout: mon host = "172.21.15.62,172.21.15.161,[v2:172.21.15.161:3301,v1:172.21.15.161:6790]" 2023-05-15T16:38:57.237 INFO:teuthology.orchestra.run.smithi171.stdout: mon pg warn min per osd = 0 2023-05-15T16:38:57.237 INFO:teuthology.orchestra.run.smithi171.stdout: fsid = fed834dd-24d2-40f4-8361-7c8c5a9484de 2023-05-15T16:38:57.237 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.238 INFO:teuthology.orchestra.run.smithi171.stdout:[osd] 2023-05-15T16:38:57.238 INFO:teuthology.orchestra.run.smithi171.stdout: osd journal size = 100 2023-05-15T16:38:57.238 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.238 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub load threshold = 5.0 2023-05-15T16:38:57.238 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub max interval = 600 2023-05-15T16:38:57.238 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.238 INFO:teuthology.orchestra.run.smithi171.stdout: osd recover clone overlap = true 2023-05-15T16:38:57.238 INFO:teuthology.orchestra.run.smithi171.stdout: osd recovery max chunk = 1048576 2023-05-15T16:38:57.239 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.239 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug shutdown = true 2023-05-15T16:38:57.239 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug op order = true 2023-05-15T16:38:57.239 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify stray on activate = true 2023-05-15T16:38:57.239 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.239 INFO:teuthology.orchestra.run.smithi171.stdout: osd open classes on start = true 2023-05-15T16:38:57.239 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug pg log writeout = true 2023-05-15T16:38:57.240 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.240 INFO:teuthology.orchestra.run.smithi171.stdout: osd deep scrub update digest min age = 30 2023-05-15T16:38:57.240 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.240 INFO:teuthology.orchestra.run.smithi171.stdout: osd map max advance = 10 2023-05-15T16:38:57.240 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.240 INFO:teuthology.orchestra.run.smithi171.stdout: journal zero on create = true 2023-05-15T16:38:57.240 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.240 INFO:teuthology.orchestra.run.smithi171.stdout: filestore ondisk finisher threads = 3 2023-05-15T16:38:57.241 INFO:teuthology.orchestra.run.smithi171.stdout: filestore apply finisher threads = 3 2023-05-15T16:38:57.241 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.241 INFO:teuthology.orchestra.run.smithi171.stdout: bdev debug aio = true 2023-05-15T16:38:57.241 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug misdirected ops = true 2023-05-15T16:38:57.241 INFO:teuthology.orchestra.run.smithi171.stdout: bdev async discard = True 2023-05-15T16:38:57.241 INFO:teuthology.orchestra.run.smithi171.stdout: bdev enable discard = True 2023-05-15T16:38:57.241 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore allocator = bitmap 2023-05-15T16:38:57.241 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore block size = 96636764160 2023-05-15T16:38:57.242 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore fsck on mount = True 2023-05-15T16:38:57.242 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluefs = 1/20 2023-05-15T16:38:57.242 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluestore = 1/20 2023-05-15T16:38:57.242 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2023-05-15T16:38:57.242 INFO:teuthology.orchestra.run.smithi171.stdout: debug osd = 20 2023-05-15T16:38:57.242 INFO:teuthology.orchestra.run.smithi171.stdout: debug rocksdb = 4/10 2023-05-15T16:38:57.242 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd backfillfull_ratio = 0.85 2023-05-15T16:38:57.242 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd full ratio = 0.9 2023-05-15T16:38:57.243 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd nearfull ratio = 0.8 2023-05-15T16:38:57.243 INFO:teuthology.orchestra.run.smithi171.stdout: osd failsafe full ratio = 0.95 2023-05-15T16:38:57.243 INFO:teuthology.orchestra.run.smithi171.stdout: osd objectstore = bluestore 2023-05-15T16:38:57.243 INFO:teuthology.orchestra.run.smithi171.stdout: osd op complaint time = 180 2023-05-15T16:38:57.243 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.243 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr] 2023-05-15T16:38:57.243 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2023-05-15T16:38:57.244 INFO:teuthology.orchestra.run.smithi171.stdout: debug mgr = 20 2023-05-15T16:38:57.244 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2023-05-15T16:38:57.244 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2023-05-15T16:38:57.244 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2023-05-15T16:38:57.244 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2023-05-15T16:38:57.244 INFO:teuthology.orchestra.run.smithi171.stdout: mgr/telemetry/nag = false 2023-05-15T16:38:57.244 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.244 INFO:teuthology.orchestra.run.smithi171.stdout:[mon] 2023-05-15T16:38:57.245 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2023-05-15T16:38:57.245 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2023-05-15T16:38:57.245 INFO:teuthology.orchestra.run.smithi171.stdout: debug paxos = 20 2023-05-15T16:38:57.245 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2023-05-15T16:38:57.245 INFO:teuthology.orchestra.run.smithi171.stdout: mon data avail warn = 5 2023-05-15T16:38:57.245 INFO:teuthology.orchestra.run.smithi171.stdout: mon mgr mkfs grace = 240 2023-05-15T16:38:57.245 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2023-05-15T16:38:57.245 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd reporter subtree level = osd 2023-05-15T16:38:57.246 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd prime pg temp = true 2023-05-15T16:38:57.246 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2023-05-15T16:38:57.246 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.246 INFO:teuthology.orchestra.run.smithi171.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-15T16:38:57.246 INFO:teuthology.orchestra.run.smithi171.stdout: auth mon ticket ttl = 660 # 11m 2023-05-15T16:38:57.246 INFO:teuthology.orchestra.run.smithi171.stdout: auth service ticket ttl = 240 # 4m 2023-05-15T16:38:57.246 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.246 INFO:teuthology.orchestra.run.smithi171.stdout: # don't complain about insecure global_id in the test suite 2023-05-15T16:38:57.247 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-15T16:38:57.247 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-15T16:38:57.247 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.247 INFO:teuthology.orchestra.run.smithi171.stdout: # 1m isn't quite enough 2023-05-15T16:38:57.247 INFO:teuthology.orchestra.run.smithi171.stdout: mon_down_mkfs_grace = 2m 2023-05-15T16:38:57.247 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.247 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_filestore_osds = false 2023-05-15T16:38:57.248 INFO:teuthology.orchestra.run.smithi171.stdout: mon op complaint time = 120 2023-05-15T16:38:57.248 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:38:57.248 INFO:teuthology.orchestra.run.smithi171.stdout:[client] 2023-05-15T16:38:57.248 INFO:teuthology.orchestra.run.smithi171.stdout: rgw cache enabled = true 2023-05-15T16:38:57.249 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable ops log = true 2023-05-15T16:38:57.249 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable usage log = true 2023-05-15T16:38:57.249 INFO:teuthology.orchestra.run.smithi171.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-15T16:38:57.249 INFO:teuthology.orchestra.run.smithi171.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-15T16:38:57.249 INFO:teuthology.orchestra.run.smithi171.stdout: client mount timeout = 600 2023-05-15T16:38:57.249 INFO:teuthology.orchestra.run.smithi171.stdout: debug client = 20 2023-05-15T16:38:57.249 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2023-05-15T16:38:57.250 INFO:teuthology.orchestra.run.smithi171.stdout: rados mon op timeout = 900 2023-05-15T16:38:57.250 INFO:teuthology.orchestra.run.smithi171.stdout: rados osd op timeout = 900 2023-05-15T16:38:57.250 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.a] 2023-05-15T16:38:57.250 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.b] 2023-05-15T16:38:57.250 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.c] 2023-05-15T16:38:57.250 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.a] 2023-05-15T16:38:57.250 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.c] 2023-05-15T16:38:57.250 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.b] 2023-05-15T16:38:57.251 INFO:teuthology.orchestra.run.smithi171.stdout:[mds] 2023-05-15T16:38:57.251 INFO:teuthology.orchestra.run.smithi171.stdout: debug mds = 20 2023-05-15T16:38:57.251 INFO:teuthology.orchestra.run.smithi171.stdout: debug mds balancer = 20 2023-05-15T16:38:57.251 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2023-05-15T16:38:57.251 INFO:teuthology.orchestra.run.smithi171.stdout: mds debug frag = True 2023-05-15T16:38:57.251 INFO:teuthology.orchestra.run.smithi171.stdout: mds debug scatterstat = True 2023-05-15T16:38:57.251 INFO:teuthology.orchestra.run.smithi171.stdout: mds op complaint time = 180 2023-05-15T16:38:57.252 INFO:teuthology.orchestra.run.smithi171.stdout: mds verify scatter = True 2023-05-15T16:38:57.252 INFO:teuthology.orchestra.run.smithi171.stdout: osd op complaint time = 180 2023-05-15T16:38:57.252 INFO:teuthology.orchestra.run.smithi171.stdout: rados mon op timeout = 900 2023-05-15T16:38:57.252 INFO:teuthology.orchestra.run.smithi171.stdout: rados osd op timeout = 900 2023-05-15T16:38:57.253 INFO:teuthology.orchestra.run.smithi161.stdout:[global] 2023-05-15T16:38:57.254 INFO:teuthology.orchestra.run.smithi161.stdout: chdir = "" 2023-05-15T16:38:57.254 INFO:teuthology.orchestra.run.smithi161.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-05-15T16:38:57.254 INFO:teuthology.orchestra.run.smithi161.stdout: auth supported = cephx 2023-05-15T16:38:57.254 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.254 INFO:teuthology.orchestra.run.smithi161.stdout: filestore xattr use omap = true 2023-05-15T16:38:57.254 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.255 INFO:teuthology.orchestra.run.smithi161.stdout: mon clock drift allowed = 1.000 2023-05-15T16:38:57.255 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.255 INFO:teuthology.orchestra.run.smithi161.stdout: osd crush chooseleaf type = 0 2023-05-15T16:38:57.255 INFO:teuthology.orchestra.run.smithi161.stdout: auth debug = true 2023-05-15T16:38:57.255 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.255 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on old message = true 2023-05-15T16:38:57.255 INFO:teuthology.orchestra.run.smithi161.stdout: ms die on bug = true 2023-05-15T16:38:57.256 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.256 INFO:teuthology.orchestra.run.smithi161.stdout: mon max pg per osd = 10000 # >= luminous 2023-05-15T16:38:57.256 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn max object skew = 0 2023-05-15T16:38:57.256 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.256 INFO:teuthology.orchestra.run.smithi161.stdout: # disable pg_autoscaler by default for new pools 2023-05-15T16:38:57.256 INFO:teuthology.orchestra.run.smithi161.stdout: osd_pool_default_pg_autoscale_mode = off 2023-05-15T16:38:57.256 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.256 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default size = 2 2023-05-15T16:38:57.257 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.257 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow primary affinity = true 2023-05-15T16:38:57.257 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd allow pg remap = true 2023-05-15T16:38:57.257 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on legacy crush tunables = false 2023-05-15T16:38:57.257 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on crush straw calc version zero = false 2023-05-15T16:38:57.257 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on no sortbitwise = false 2023-05-15T16:38:57.257 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on osd down out interval zero = false 2023-05-15T16:38:57.258 INFO:teuthology.orchestra.run.smithi161.stdout: mon warn on too few osds = false 2023-05-15T16:38:57.258 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-05-15T16:38:57.258 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_pool_no_redundancy = false 2023-05-15T16:38:57.258 INFO:teuthology.orchestra.run.smithi161.stdout: mon_allow_pool_size_one = true 2023-05-15T16:38:57.258 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.258 INFO:teuthology.orchestra.run.smithi161.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-05-15T16:38:57.258 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.259 INFO:teuthology.orchestra.run.smithi161.stdout: osd default data pool replay window = 5 2023-05-15T16:38:57.259 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.259 INFO:teuthology.orchestra.run.smithi161.stdout: mon allow pool delete = true 2023-05-15T16:38:57.259 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.259 INFO:teuthology.orchestra.run.smithi161.stdout: mon cluster log file level = debug 2023-05-15T16:38:57.259 INFO:teuthology.orchestra.run.smithi161.stdout: debug asserts on shutdown = true 2023-05-15T16:38:57.259 INFO:teuthology.orchestra.run.smithi161.stdout: mon health detail to clog = false 2023-05-15T16:38:57.259 INFO:teuthology.orchestra.run.smithi161.stdout: mon host = "172.21.15.62,172.21.15.161,[v2:172.21.15.161:3301,v1:172.21.15.161:6790]" 2023-05-15T16:38:57.260 INFO:teuthology.orchestra.run.smithi161.stdout: mon pg warn min per osd = 0 2023-05-15T16:38:57.260 INFO:teuthology.orchestra.run.smithi161.stdout: fsid = fed834dd-24d2-40f4-8361-7c8c5a9484de 2023-05-15T16:38:57.260 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.260 INFO:teuthology.orchestra.run.smithi161.stdout:[osd] 2023-05-15T16:38:57.260 INFO:teuthology.orchestra.run.smithi161.stdout: osd journal size = 100 2023-05-15T16:38:57.260 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.260 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub load threshold = 5.0 2023-05-15T16:38:57.260 INFO:teuthology.orchestra.run.smithi161.stdout: osd scrub max interval = 600 2023-05-15T16:38:57.261 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.261 INFO:teuthology.orchestra.run.smithi161.stdout: osd recover clone overlap = true 2023-05-15T16:38:57.261 INFO:teuthology.orchestra.run.smithi161.stdout: osd recovery max chunk = 1048576 2023-05-15T16:38:57.261 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.261 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug shutdown = true 2023-05-15T16:38:57.261 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug op order = true 2023-05-15T16:38:57.261 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug verify stray on activate = true 2023-05-15T16:38:57.262 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.262 INFO:teuthology.orchestra.run.smithi161.stdout: osd open classes on start = true 2023-05-15T16:38:57.262 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug pg log writeout = true 2023-05-15T16:38:57.262 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.262 INFO:teuthology.orchestra.run.smithi161.stdout: osd deep scrub update digest min age = 30 2023-05-15T16:38:57.262 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.262 INFO:teuthology.orchestra.run.smithi161.stdout: osd map max advance = 10 2023-05-15T16:38:57.262 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.263 INFO:teuthology.orchestra.run.smithi161.stdout: journal zero on create = true 2023-05-15T16:38:57.263 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.263 INFO:teuthology.orchestra.run.smithi161.stdout: filestore ondisk finisher threads = 3 2023-05-15T16:38:57.263 INFO:teuthology.orchestra.run.smithi161.stdout: filestore apply finisher threads = 3 2023-05-15T16:38:57.263 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.263 INFO:teuthology.orchestra.run.smithi161.stdout: bdev debug aio = true 2023-05-15T16:38:57.263 INFO:teuthology.orchestra.run.smithi161.stdout: osd debug misdirected ops = true 2023-05-15T16:38:57.263 INFO:teuthology.orchestra.run.smithi161.stdout: bdev async discard = True 2023-05-15T16:38:57.264 INFO:teuthology.orchestra.run.smithi161.stdout: bdev enable discard = True 2023-05-15T16:38:57.264 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore allocator = bitmap 2023-05-15T16:38:57.264 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore block size = 96636764160 2023-05-15T16:38:57.264 INFO:teuthology.orchestra.run.smithi161.stdout: bluestore fsck on mount = True 2023-05-15T16:38:57.264 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluefs = 1/20 2023-05-15T16:38:57.264 INFO:teuthology.orchestra.run.smithi161.stdout: debug bluestore = 1/20 2023-05-15T16:38:57.264 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-05-15T16:38:57.265 INFO:teuthology.orchestra.run.smithi161.stdout: debug osd = 20 2023-05-15T16:38:57.265 INFO:teuthology.orchestra.run.smithi161.stdout: debug rocksdb = 4/10 2023-05-15T16:38:57.265 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd backfillfull_ratio = 0.85 2023-05-15T16:38:57.265 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd full ratio = 0.9 2023-05-15T16:38:57.265 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd nearfull ratio = 0.8 2023-05-15T16:38:57.265 INFO:teuthology.orchestra.run.smithi161.stdout: osd failsafe full ratio = 0.95 2023-05-15T16:38:57.265 INFO:teuthology.orchestra.run.smithi161.stdout: osd objectstore = bluestore 2023-05-15T16:38:57.265 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2023-05-15T16:38:57.266 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.266 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr] 2023-05-15T16:38:57.266 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-05-15T16:38:57.266 INFO:teuthology.orchestra.run.smithi161.stdout: debug mgr = 20 2023-05-15T16:38:57.266 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2023-05-15T16:38:57.266 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2023-05-15T16:38:57.266 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2023-05-15T16:38:57.266 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2023-05-15T16:38:57.267 INFO:teuthology.orchestra.run.smithi161.stdout: mgr/telemetry/nag = false 2023-05-15T16:38:57.267 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.267 INFO:teuthology.orchestra.run.smithi161.stdout:[mon] 2023-05-15T16:38:57.267 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-05-15T16:38:57.267 INFO:teuthology.orchestra.run.smithi161.stdout: debug mon = 20 2023-05-15T16:38:57.267 INFO:teuthology.orchestra.run.smithi161.stdout: debug paxos = 20 2023-05-15T16:38:57.268 INFO:teuthology.orchestra.run.smithi161.stdout: debug auth = 20 2023-05-15T16:38:57.268 INFO:teuthology.orchestra.run.smithi161.stdout: mon data avail warn = 5 2023-05-15T16:38:57.268 INFO:teuthology.orchestra.run.smithi161.stdout: mon mgr mkfs grace = 240 2023-05-15T16:38:57.268 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min pgs per osd = 4 2023-05-15T16:38:57.268 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd reporter subtree level = osd 2023-05-15T16:38:57.268 INFO:teuthology.orchestra.run.smithi161.stdout: mon osd prime pg temp = true 2023-05-15T16:38:57.268 INFO:teuthology.orchestra.run.smithi161.stdout: mon reweight min bytes per osd = 10 2023-05-15T16:38:57.269 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.269 INFO:teuthology.orchestra.run.smithi161.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-05-15T16:38:57.269 INFO:teuthology.orchestra.run.smithi161.stdout: auth mon ticket ttl = 660 # 11m 2023-05-15T16:38:57.269 INFO:teuthology.orchestra.run.smithi161.stdout: auth service ticket ttl = 240 # 4m 2023-05-15T16:38:57.269 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.269 INFO:teuthology.orchestra.run.smithi161.stdout: # don't complain about insecure global_id in the test suite 2023-05-15T16:38:57.269 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-05-15T16:38:57.270 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-05-15T16:38:57.270 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.270 INFO:teuthology.orchestra.run.smithi161.stdout: # 1m isn't quite enough 2023-05-15T16:38:57.270 INFO:teuthology.orchestra.run.smithi161.stdout: mon_down_mkfs_grace = 2m 2023-05-15T16:38:57.270 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.270 INFO:teuthology.orchestra.run.smithi161.stdout: mon_warn_on_filestore_osds = false 2023-05-15T16:38:57.270 INFO:teuthology.orchestra.run.smithi161.stdout: mon op complaint time = 120 2023-05-15T16:38:57.271 INFO:teuthology.orchestra.run.smithi161.stdout: 2023-05-15T16:38:57.271 INFO:teuthology.orchestra.run.smithi161.stdout:[client] 2023-05-15T16:38:57.271 INFO:teuthology.orchestra.run.smithi161.stdout: rgw cache enabled = true 2023-05-15T16:38:57.271 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable ops log = true 2023-05-15T16:38:57.271 INFO:teuthology.orchestra.run.smithi161.stdout: rgw enable usage log = true 2023-05-15T16:38:57.271 INFO:teuthology.orchestra.run.smithi161.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-05-15T16:38:57.271 INFO:teuthology.orchestra.run.smithi161.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-05-15T16:38:57.272 INFO:teuthology.orchestra.run.smithi161.stdout: client mount timeout = 600 2023-05-15T16:38:57.272 INFO:teuthology.orchestra.run.smithi161.stdout: debug client = 20 2023-05-15T16:38:57.272 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-05-15T16:38:57.272 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2023-05-15T16:38:57.272 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2023-05-15T16:38:57.273 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.a] 2023-05-15T16:38:57.273 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.b] 2023-05-15T16:38:57.273 INFO:teuthology.orchestra.run.smithi161.stdout:[mon.c] 2023-05-15T16:38:57.273 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2023-05-15T16:38:57.273 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2023-05-15T16:38:57.273 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2023-05-15T16:38:57.273 INFO:teuthology.orchestra.run.smithi161.stdout:[mds] 2023-05-15T16:38:57.274 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds = 20 2023-05-15T16:38:57.274 INFO:teuthology.orchestra.run.smithi161.stdout: debug mds balancer = 20 2023-05-15T16:38:57.274 INFO:teuthology.orchestra.run.smithi161.stdout: debug ms = 1 2023-05-15T16:38:57.274 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug frag = True 2023-05-15T16:38:57.274 INFO:teuthology.orchestra.run.smithi161.stdout: mds debug scatterstat = True 2023-05-15T16:38:57.274 INFO:teuthology.orchestra.run.smithi161.stdout: mds op complaint time = 180 2023-05-15T16:38:57.274 INFO:teuthology.orchestra.run.smithi161.stdout: mds verify scatter = True 2023-05-15T16:38:57.275 INFO:teuthology.orchestra.run.smithi161.stdout: osd op complaint time = 180 2023-05-15T16:38:57.275 INFO:teuthology.orchestra.run.smithi161.stdout: rados mon op timeout = 900 2023-05-15T16:38:57.275 INFO:teuthology.orchestra.run.smithi161.stdout: rados osd op timeout = 900 2023-05-15T16:38:57.276 INFO:tasks.ceph:Creating admin key on mon.a... 2023-05-15T16:38:57.276 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-05-15T16:38:57.347 INFO:tasks.ceph:Copying monmap to all nodes... 2023-05-15T16:38:57.347 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:38:57.348 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-05-15T16:38:57.353 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:38:57.354 DEBUG:teuthology.orchestra.run.smithi062:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-05-15T16:38:57.402 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi062.front.sepia.ceph.com 2023-05-15T16:38:57.403 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:38:57.403 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-15T16:38:57.404 DEBUG:teuthology.orchestra.run.smithi062:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-15T16:38:57.467 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:38:57.468 DEBUG:teuthology.orchestra.run.smithi062:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-15T16:38:57.515 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi161.front.sepia.ceph.com 2023-05-15T16:38:57.516 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-05-15T16:38:57.516 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-15T16:38:57.516 DEBUG:teuthology.orchestra.run.smithi161:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-15T16:38:57.540 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-05-15T16:38:57.540 DEBUG:teuthology.orchestra.run.smithi161:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-15T16:38:57.589 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi171.front.sepia.ceph.com 2023-05-15T16:38:57.590 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2023-05-15T16:38:57.590 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.keyring 2023-05-15T16:38:57.591 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-05-15T16:38:57.624 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2023-05-15T16:38:57.625 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-05-15T16:38:57.674 INFO:tasks.ceph:Setting up mon nodes... 2023-05-15T16:38:57.674 INFO:tasks.ceph:Setting up mgr nodes... 2023-05-15T16:38:57.675 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-05-15T16:38:57.721 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-05-15T16:38:57.724 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-05-15T16:38:57.769 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-05-15T16:38:57.782 INFO:tasks.ceph:Setting up mds nodes... 2023-05-15T16:38:57.783 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-05-15T16:38:57.828 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-05-15T16:38:57.831 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-05-15T16:38:57.885 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-05-15T16:38:57.968 INFO:teuthology.orchestra.run.smithi062.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-05-15T16:38:57.970 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-05-15T16:38:58.026 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-05-15T16:38:58.070 INFO:teuthology.orchestra.run.smithi161.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-05-15T16:38:58.073 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-05-15T16:38:58.129 INFO:tasks.ceph_client:Setting up client nodes... 2023-05-15T16:38:58.130 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-05-15T16:38:58.176 INFO:teuthology.orchestra.run.smithi171.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-05-15T16:38:58.202 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-05-15T16:38:58.202 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi062.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi161.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-05-15T16:38:58.203 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-05-15T16:38:58.217 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-15T16:38:58.217 INFO:tasks.ceph:role: osd.0 2023-05-15T16:38:58.218 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com 2023-05-15T16:38:58.218 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-15T16:38:58.278 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-15T16:38:58.279 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-15T16:38:58.279 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-15T16:38:58.279 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-15T16:38:58.279 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-15T16:38:58.279 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2023-05-15T16:38:58.280 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-15T16:38:58.280 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-15T16:38:58.280 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-15T16:38:58.280 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-15T16:38:58.737 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2023-05-15T16:38:58.739 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2023-05-15T16:38:58.740 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-05-15T16:38:58.845 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-05-15T16:38:58.856 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-15T16:38:58.857 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2023-05-15T16:38:58.857 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-05-15T16:38:58.915 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-15T16:38:58.915 INFO:tasks.ceph:role: osd.1 2023-05-15T16:38:58.916 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com 2023-05-15T16:38:58.916 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-15T16:38:58.979 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-15T16:38:58.979 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-15T16:38:58.980 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-15T16:38:58.980 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-15T16:38:58.980 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-15T16:38:58.980 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2023-05-15T16:38:58.981 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-15T16:38:58.981 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-15T16:38:58.981 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-15T16:38:58.981 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-15T16:38:59.442 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2023-05-15T16:38:59.445 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2023-05-15T16:38:59.446 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-05-15T16:38:59.569 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-05-15T16:38:59.580 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2023-05-15T16:38:59.580 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-15T16:38:59.581 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-05-15T16:38:59.633 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-15T16:38:59.633 INFO:tasks.ceph:role: osd.2 2023-05-15T16:38:59.633 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com 2023-05-15T16:38:59.634 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-15T16:38:59.694 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-15T16:38:59.694 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-15T16:38:59.694 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-15T16:38:59.695 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-15T16:38:59.695 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-15T16:38:59.695 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2023-05-15T16:38:59.695 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-15T16:38:59.696 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-15T16:38:59.696 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-15T16:38:59.696 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-15T16:39:00.168 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2023-05-15T16:39:00.170 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2023-05-15T16:39:00.170 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-05-15T16:39:00.300 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-05-15T16:39:00.312 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-15T16:39:00.312 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2023-05-15T16:39:00.313 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-05-15T16:39:00.366 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-05-15T16:39:00.367 INFO:tasks.ceph:role: osd.3 2023-05-15T16:39:00.367 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com 2023-05-15T16:39:00.367 DEBUG:teuthology.orchestra.run.smithi062:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-15T16:39:00.430 INFO:teuthology.orchestra.run.smithi062.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-15T16:39:00.430 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-15T16:39:00.430 INFO:teuthology.orchestra.run.smithi062.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-15T16:39:00.430 INFO:teuthology.orchestra.run.smithi062.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-15T16:39:00.431 INFO:teuthology.orchestra.run.smithi062.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-15T16:39:00.431 INFO:teuthology.orchestra.run.smithi062.stdout: = sunit=0 swidth=0 blks 2023-05-15T16:39:00.431 INFO:teuthology.orchestra.run.smithi062.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-15T16:39:00.431 INFO:teuthology.orchestra.run.smithi062.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-15T16:39:00.431 INFO:teuthology.orchestra.run.smithi062.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-15T16:39:00.431 INFO:teuthology.orchestra.run.smithi062.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-15T16:39:00.872 INFO:teuthology.orchestra.run.smithi062.stdout:Discarding blocks...Done. 2023-05-15T16:39:00.873 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi062.front.sepia.ceph.com -o noatime 2023-05-15T16:39:00.874 DEBUG:teuthology.orchestra.run.smithi062:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-05-15T16:39:00.968 DEBUG:teuthology.orchestra.run.smithi062:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-05-15T16:39:00.978 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-15T16:39:00.978 INFO:teuthology.orchestra.run.smithi062.stderr:sudo: /sbin/restorecon: command not found 2023-05-15T16:39:00.979 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-15T16:39:01.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:01.076+0000 7fb402bd8640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-05-15T16:39:01.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:01.080+0000 7fb402bd8640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-05-15T16:39:01.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:01.080+0000 7fb402bd8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-15T16:39:01.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:01.080+0000 7fb402bd8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-15T16:39:01.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:01.080+0000 7fb402bd8640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-05-15T16:39:01.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:01.084+0000 7fb402bd8640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-05-15T16:39:04.102 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-05-15T16:39:04.117 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-15T16:39:04.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:04.192+0000 7f0209e4c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-05-15T16:39:04.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:04.192+0000 7f0209e4c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-05-15T16:39:04.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:04.192+0000 7f0209e4c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-15T16:39:04.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:04.192+0000 7f0209e4c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-15T16:39:04.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:04.192+0000 7f0209e4c640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-05-15T16:39:04.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:04.192+0000 7f0209e4c640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-05-15T16:39:07.214 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-05-15T16:39:07.271 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-15T16:39:07.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:07.352+0000 7f3d21c8e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-05-15T16:39:07.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:07.352+0000 7f3d21c8e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-05-15T16:39:07.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:07.352+0000 7f3d21c8e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-15T16:39:07.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:07.352+0000 7f3d21c8e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-15T16:39:07.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:07.352+0000 7f3d21c8e640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-05-15T16:39:07.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:07.352+0000 7f3d21c8e640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-05-15T16:39:10.365 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-05-15T16:39:10.419 DEBUG:teuthology.orchestra.run.smithi062:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-15T16:39:10.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:10.496+0000 7f73fd429640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-05-15T16:39:10.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:10.496+0000 7f73fd429640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-05-15T16:39:10.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:10.496+0000 7f73fd429640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-15T16:39:10.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:10.496+0000 7f73fd429640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-15T16:39:10.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:10.496+0000 7f73fd429640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-05-15T16:39:10.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:10.500+0000 7f73fd429640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-05-15T16:39:13.520 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-05-15T16:39:13.575 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-05-15T16:39:13.590 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-15T16:39:13.591 INFO:tasks.ceph:role: osd.4 2023-05-15T16:39:13.591 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com 2023-05-15T16:39:13.592 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-05-15T16:39:13.652 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-05-15T16:39:13.653 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-15T16:39:13.653 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-15T16:39:13.654 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-15T16:39:13.654 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-15T16:39:13.654 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-05-15T16:39:13.654 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-15T16:39:13.655 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-15T16:39:13.655 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-15T16:39:13.655 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-15T16:39:14.098 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-05-15T16:39:14.100 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-05-15T16:39:14.101 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-05-15T16:39:14.194 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-05-15T16:39:14.248 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-15T16:39:14.248 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2023-05-15T16:39:14.249 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-05-15T16:39:14.308 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-15T16:39:14.309 INFO:tasks.ceph:role: osd.5 2023-05-15T16:39:14.309 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com 2023-05-15T16:39:14.309 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-05-15T16:39:14.376 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-05-15T16:39:14.376 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-15T16:39:14.377 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-15T16:39:14.377 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-15T16:39:14.377 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-15T16:39:14.378 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-05-15T16:39:14.378 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-15T16:39:14.378 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-15T16:39:14.378 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-15T16:39:14.378 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-15T16:39:14.849 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-05-15T16:39:14.905 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-05-15T16:39:14.905 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-05-15T16:39:15.009 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-05-15T16:39:15.021 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-15T16:39:15.022 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2023-05-15T16:39:15.022 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-05-15T16:39:15.075 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-15T16:39:15.075 INFO:tasks.ceph:role: osd.6 2023-05-15T16:39:15.076 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com 2023-05-15T16:39:15.076 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-05-15T16:39:15.135 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-05-15T16:39:15.135 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-15T16:39:15.135 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-15T16:39:15.136 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-15T16:39:15.136 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-15T16:39:15.136 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-05-15T16:39:15.136 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-15T16:39:15.136 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-15T16:39:15.136 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-15T16:39:15.136 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-15T16:39:15.620 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-05-15T16:39:15.622 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-05-15T16:39:15.623 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-05-15T16:39:15.778 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-05-15T16:39:15.789 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2023-05-15T16:39:15.789 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-15T16:39:15.790 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-05-15T16:39:15.843 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-05-15T16:39:15.843 INFO:tasks.ceph:role: osd.7 2023-05-15T16:39:15.844 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com 2023-05-15T16:39:15.844 DEBUG:teuthology.orchestra.run.smithi161:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-05-15T16:39:15.903 INFO:teuthology.orchestra.run.smithi161.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-05-15T16:39:15.903 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 attr=2, projid32bit=1 2023-05-15T16:39:15.903 INFO:teuthology.orchestra.run.smithi161.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-05-15T16:39:15.904 INFO:teuthology.orchestra.run.smithi161.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-05-15T16:39:15.904 INFO:teuthology.orchestra.run.smithi161.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-05-15T16:39:15.904 INFO:teuthology.orchestra.run.smithi161.stdout: = sunit=0 swidth=0 blks 2023-05-15T16:39:15.904 INFO:teuthology.orchestra.run.smithi161.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-05-15T16:39:15.904 INFO:teuthology.orchestra.run.smithi161.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-05-15T16:39:15.904 INFO:teuthology.orchestra.run.smithi161.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-05-15T16:39:15.904 INFO:teuthology.orchestra.run.smithi161.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-05-15T16:39:16.331 INFO:teuthology.orchestra.run.smithi161.stdout:Discarding blocks...Done. 2023-05-15T16:39:16.333 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi161.front.sepia.ceph.com -o noatime 2023-05-15T16:39:16.333 DEBUG:teuthology.orchestra.run.smithi161:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-05-15T16:39:16.433 DEBUG:teuthology.orchestra.run.smithi161:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-05-15T16:39:16.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-15T16:39:16.445 INFO:teuthology.orchestra.run.smithi161.stderr:sudo: /sbin/restorecon: command not found 2023-05-15T16:39:16.445 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-15T16:39:16.559 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:16.554+0000 7f8f061d3640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-05-15T16:39:16.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:16.562+0000 7f8f061d3640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-05-15T16:39:16.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:16.562+0000 7f8f061d3640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-15T16:39:16.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:16.562+0000 7f8f061d3640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-15T16:39:16.566 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:16.562+0000 7f8f061d3640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-05-15T16:39:16.567 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:16.562+0000 7f8f061d3640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-05-15T16:39:19.579 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-05-15T16:39:19.592 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-15T16:39:19.676 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:19.674+0000 7f58c9fd9640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-05-15T16:39:19.677 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:19.674+0000 7f58c9fd9640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-05-15T16:39:19.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:19.674+0000 7f58c9fd9640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-15T16:39:19.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:19.674+0000 7f58c9fd9640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-15T16:39:19.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:19.674+0000 7f58c9fd9640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-05-15T16:39:19.678 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:19.674+0000 7f58c9fd9640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-05-15T16:39:22.672 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-05-15T16:39:22.728 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-15T16:39:22.812 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:22.810+0000 7f712a735640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-05-15T16:39:22.813 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:22.810+0000 7f712a735640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-05-15T16:39:22.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:22.810+0000 7f712a735640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-15T16:39:22.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:22.810+0000 7f712a735640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-15T16:39:22.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:22.810+0000 7f712a735640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-05-15T16:39:22.814 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:22.810+0000 7f712a735640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-05-15T16:39:25.303 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:39:25.306 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:39:25.308 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:39:25.828 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-05-15T16:39:25.841 DEBUG:teuthology.orchestra.run.smithi161:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-05-15T16:39:25.924 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:25.922+0000 7fbd13d23640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-05-15T16:39:25.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:25.922+0000 7fbd13d23640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-05-15T16:39:25.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:25.922+0000 7fbd13d23640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-15T16:39:25.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:25.922+0000 7fbd13d23640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-15T16:39:25.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:25.922+0000 7fbd13d23640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-05-15T16:39:25.925 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:25.922+0000 7fbd13d23640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-05-15T16:39:28.929 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-05-15T16:39:28.985 INFO:tasks.ceph:Reading keys from all nodes... 2023-05-15T16:39:28.986 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:39:28.987 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-05-15T16:39:29.005 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:39:29.005 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-05-15T16:39:29.058 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:39:29.058 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-05-15T16:39:29.115 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:39:29.115 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-05-15T16:39:29.170 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:39:29.170 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-05-15T16:39:29.226 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:39:29.226 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-05-15T16:39:29.282 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:39:29.283 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-05-15T16:39:29.337 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-05-15T16:39:29.337 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-05-15T16:39:29.351 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-05-15T16:39:29.351 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-05-15T16:39:29.404 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-05-15T16:39:29.404 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-05-15T16:39:29.459 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-05-15T16:39:29.460 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-05-15T16:39:29.516 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-05-15T16:39:29.516 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-05-15T16:39:29.573 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-05-15T16:39:29.573 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-05-15T16:39:29.628 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2023-05-15T16:39:29.629 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-05-15T16:39:29.639 INFO:tasks.ceph:Adding keys to all mons... 2023-05-15T16:39:29.639 DEBUG:teuthology.orchestra.run.smithi062:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-15T16:39:29.643 DEBUG:teuthology.orchestra.run.smithi161:> sudo tee -a /etc/ceph/ceph.keyring 2023-05-15T16:39:29.674 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.y] 2023-05-15T16:39:29.674 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAhYGJked/bKhAA0XJWcKW75rnJK7YRKHY1Mw== 2023-05-15T16:39:29.674 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.a] 2023-05-15T16:39:29.674 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAhYGJk2/I+MRAAcO6R1pDb3VfbSdorPDtNgw== 2023-05-15T16:39:29.674 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.c] 2023-05-15T16:39:29.675 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAhYGJkqF6TORAAfJq5SNyhPikDQPsWiWFFbQ== 2023-05-15T16:39:29.675 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.0] 2023-05-15T16:39:29.675 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAlYGJkRUDlBBAAGlRXjba9zx4V+IwgEwN5CQ== 2023-05-15T16:39:29.675 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.1] 2023-05-15T16:39:29.675 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAoYGJkPxe/CxAAuq6TPlGzKC6pHeAtNDyZiQ== 2023-05-15T16:39:29.675 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.2] 2023-05-15T16:39:29.675 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQArYGJkU5U7FRAAhXTl1/yw7QGzySVGVLEffg== 2023-05-15T16:39:29.676 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.3] 2023-05-15T16:39:29.676 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAuYGJkAKf4HRAAQRcpmVL4TCswScbw+xle4Q== 2023-05-15T16:39:29.676 INFO:teuthology.orchestra.run.smithi062.stdout:[mgr.x] 2023-05-15T16:39:29.676 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAhYGJkqJ/YLRAAmu7z8uKQqCLeSfVR3RLqfA== 2023-05-15T16:39:29.676 INFO:teuthology.orchestra.run.smithi062.stdout:[mds.b] 2023-05-15T16:39:29.676 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAiYGJkNewoBBAAI36Q4uePTK+cPkKnlS14EA== 2023-05-15T16:39:29.676 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.4] 2023-05-15T16:39:29.677 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQA0YGJkyT1QIRAAjwyKqwRQ31wvmrAxTJ5UEg== 2023-05-15T16:39:29.677 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.5] 2023-05-15T16:39:29.677 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQA3YGJk7XxNKBAAtQ44ZzLNV3PZl8ox2yWICQ== 2023-05-15T16:39:29.677 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.6] 2023-05-15T16:39:29.677 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQA6YGJk1FdkMBAAsgJepb0ixJFYbuX5jcAHYg== 2023-05-15T16:39:29.677 INFO:teuthology.orchestra.run.smithi062.stdout:[osd.7] 2023-05-15T16:39:29.677 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQA9YGJk+8cNNxAAMeiWy45Ha8RhQIhfEoXu+A== 2023-05-15T16:39:29.677 INFO:teuthology.orchestra.run.smithi062.stdout:[client.0] 2023-05-15T16:39:29.678 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAiYGJksBNpChAASLhAE8Y4f8Ce2qdh2v00gw== 2023-05-15T16:39:29.681 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.y] 2023-05-15T16:39:29.681 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAhYGJked/bKhAA0XJWcKW75rnJK7YRKHY1Mw== 2023-05-15T16:39:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.a] 2023-05-15T16:39:29.682 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAhYGJk2/I+MRAAcO6R1pDb3VfbSdorPDtNgw== 2023-05-15T16:39:29.682 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.c] 2023-05-15T16:39:29.683 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAhYGJkqF6TORAAfJq5SNyhPikDQPsWiWFFbQ== 2023-05-15T16:39:29.683 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.0] 2023-05-15T16:39:29.683 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAlYGJkRUDlBBAAGlRXjba9zx4V+IwgEwN5CQ== 2023-05-15T16:39:29.683 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.1] 2023-05-15T16:39:29.684 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAoYGJkPxe/CxAAuq6TPlGzKC6pHeAtNDyZiQ== 2023-05-15T16:39:29.684 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.2] 2023-05-15T16:39:29.684 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQArYGJkU5U7FRAAhXTl1/yw7QGzySVGVLEffg== 2023-05-15T16:39:29.684 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.3] 2023-05-15T16:39:29.685 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAuYGJkAKf4HRAAQRcpmVL4TCswScbw+xle4Q== 2023-05-15T16:39:29.685 INFO:teuthology.orchestra.run.smithi161.stdout:[mgr.x] 2023-05-15T16:39:29.685 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAhYGJkqJ/YLRAAmu7z8uKQqCLeSfVR3RLqfA== 2023-05-15T16:39:29.686 INFO:teuthology.orchestra.run.smithi161.stdout:[mds.b] 2023-05-15T16:39:29.686 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAiYGJkNewoBBAAI36Q4uePTK+cPkKnlS14EA== 2023-05-15T16:39:29.686 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.4] 2023-05-15T16:39:29.687 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQA0YGJkyT1QIRAAjwyKqwRQ31wvmrAxTJ5UEg== 2023-05-15T16:39:29.687 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.5] 2023-05-15T16:39:29.687 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQA3YGJk7XxNKBAAtQ44ZzLNV3PZl8ox2yWICQ== 2023-05-15T16:39:29.687 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.6] 2023-05-15T16:39:29.688 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQA6YGJk1FdkMBAAsgJepb0ixJFYbuX5jcAHYg== 2023-05-15T16:39:29.688 INFO:teuthology.orchestra.run.smithi161.stdout:[osd.7] 2023-05-15T16:39:29.688 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQA9YGJk+8cNNxAAMeiWy45Ha8RhQIhfEoXu+A== 2023-05-15T16:39:29.688 INFO:teuthology.orchestra.run.smithi161.stdout:[client.0] 2023-05-15T16:39:29.689 INFO:teuthology.orchestra.run.smithi161.stdout: key = AQAiYGJksBNpChAASLhAE8Y4f8Ce2qdh2v00gw== 2023-05-15T16:39:29.691 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-15T16:39:29.724 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-15T16:39:29.775 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-15T16:39:29.811 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-15T16:39:29.866 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-15T16:39:29.869 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-15T16:39:29.952 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-15T16:39:29.956 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-15T16:39:30.037 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-15T16:39:30.043 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-15T16:39:30.125 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-15T16:39:30.130 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-15T16:39:30.211 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-15T16:39:30.215 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-15T16:39:30.294 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-15T16:39:30.297 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-05-15T16:39:30.375 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-15T16:39:30.379 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-05-15T16:39:30.460 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-15T16:39:30.464 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-15T16:39:30.542 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-15T16:39:30.545 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-15T16:39:30.626 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-15T16:39:30.633 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-15T16:39:30.707 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-15T16:39:30.716 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-05-15T16:39:30.795 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-15T16:39:30.803 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-05-15T16:39:30.882 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-05-15T16:39:30.882 DEBUG:teuthology.orchestra.run.smithi062:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-05-15T16:39:30.901 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-15T16:39:31.003 DEBUG:teuthology.orchestra.run.smithi062:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-05-15T16:39:31.015 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-05-15T16:39:31.030 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-15T16:39:31.126 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-05-15T16:39:31.137 DEBUG:teuthology.orchestra.run.smithi161:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-05-15T16:39:31.194 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-05-15T16:39:31.290 DEBUG:teuthology.orchestra.run.smithi161:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-05-15T16:39:31.302 DEBUG:teuthology.orchestra.run.smithi062:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-15T16:39:31.306 DEBUG:teuthology.orchestra.run.smithi161:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-05-15T16:39:31.347 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-05-15T16:39:31.348 INFO:tasks.ceph.mon.a:Restarting daemon 2023-05-15T16:39:31.349 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-05-15T16:39:31.355 INFO:tasks.ceph.mon.a:Started 2023-05-15T16:39:31.356 INFO:tasks.ceph.mon.b:Restarting daemon 2023-05-15T16:39:31.356 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-05-15T16:39:31.397 INFO:tasks.ceph.mon.b:Started 2023-05-15T16:39:31.398 INFO:tasks.ceph.mon.c:Restarting daemon 2023-05-15T16:39:31.399 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-05-15T16:39:31.402 INFO:tasks.ceph.mon.c:Started 2023-05-15T16:39:31.402 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-05-15T16:39:31.402 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-05-15T16:39:31.403 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-05-15T16:39:31.405 INFO:tasks.ceph.mgr.y:Started 2023-05-15T16:39:31.406 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-05-15T16:39:31.406 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-05-15T16:39:31.408 INFO:tasks.ceph.mgr.x:Started 2023-05-15T16:39:31.409 INFO:tasks.ceph:Setting crush tunables to default 2023-05-15T16:39:31.409 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd crush tunables default 2023-05-15T16:39:31.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.520+0000 7f973bdec640 1 Processor -- start 2023-05-15T16:39:31.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.520+0000 7f973bdec640 1 -- start start 2023-05-15T16:39:31.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.520+0000 7f973bdec640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 0x7f97341474e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:31.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.520+0000 7f973bdec640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 0x7f9734140aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:31.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.520+0000 7f973bdec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f9734149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:31.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.520+0000 7f973bdec640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f973406b750 con 0x7f97340ba0b0 2023-05-15T16:39:31.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.520+0000 7f973bdec640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97340b8e40 con 0x7f97340b3980 2023-05-15T16:39:31.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.520+0000 7f973bdec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97340b8510 con 0x7f9734140fe0 2023-05-15T16:39:31.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.520+0000 7f9739b88640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 0x7f97341474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:31.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.520+0000 7f9739b88640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 0x7f97341474e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:33674/0 (socket says 172.21.15.62:33674) 2023-05-15T16:39:31.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.520+0000 7f9739b88640 1 -- 172.21.15.62:0/1423725269 learned_addr learned my addr 172.21.15.62:0/1423725269 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:31.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.524+0000 7f9739387640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 0x7f9734140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:31.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.520+0000 7f973a389640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f9734149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:31.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.524+0000 7f9739b88640 1 -- 172.21.15.62:0/1423725269 >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 msgr2=0x7f97341474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-15T16:39:31.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.524+0000 7f9739b88640 1 -- 172.21.15.62:0/1423725269 >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 msgr2=0x7f97341474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-15T16:39:31.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.524+0000 7f9739b88640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 0x7f97341474e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-15T16:39:31.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.524+0000 7f9739b88640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 0x7f97341474e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-15T16:39:31.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.524+0000 7f973a389640 1 -- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 msgr2=0x7f9734149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-05-15T16:39:31.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.524+0000 7f9739387640 1 -- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 msgr2=0x7f9734140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-15T16:39:31.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.524+0000 7f973a389640 1 -- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 msgr2=0x7f9734149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-15T16:39:31.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.524+0000 7f9739387640 1 -- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 msgr2=0x7f9734140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-15T16:39:31.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.524+0000 7f9739387640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 0x7f9734140aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-15T16:39:31.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.524+0000 7f973a389640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f9734149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-15T16:39:31.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.524+0000 7f9739387640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 0x7f9734140aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-15T16:39:31.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.524+0000 7f973a389640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f9734149fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-05-15T16:39:31.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.728+0000 7f9739b88640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 0x7f97341474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:31.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.728+0000 7f973a389640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f9734149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:31.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.728+0000 7f9739387640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 0x7f9734140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:31.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.728+0000 7f9739b88640 1 -- 172.21.15.62:0/1423725269 >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 msgr2=0x7f97341474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-15T16:39:31.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.728+0000 7f9739b88640 1 -- 172.21.15.62:0/1423725269 >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 msgr2=0x7f97341474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-15T16:39:31.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.728+0000 7f9739b88640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 0x7f97341474e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-15T16:39:31.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.728+0000 7f9739b88640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 0x7f97341474e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-15T16:39:31.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.728+0000 7f973a389640 1 -- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 msgr2=0x7f9734149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-15T16:39:31.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.728+0000 7f973a389640 1 -- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 msgr2=0x7f9734149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-15T16:39:31.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.728+0000 7f973a389640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f9734149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-15T16:39:31.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.728+0000 7f9739387640 1 -- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 msgr2=0x7f9734140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-05-15T16:39:31.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.728+0000 7f9739387640 1 -- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 msgr2=0x7f9734140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-15T16:39:31.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.728+0000 7f9739387640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 0x7f9734140aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-15T16:39:31.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.728+0000 7f973a389640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f9734149fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-15T16:39:31.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:31.728+0000 7f9739387640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 0x7f9734140aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-05-15T16:39:32.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.132+0000 7f9739b88640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 0x7f97341474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:32.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.132+0000 7f973a389640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f9734149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:32.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.132+0000 7f9739387640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 0x7f9734140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:32.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.132+0000 7f9739b88640 1 -- 172.21.15.62:0/1423725269 >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 msgr2=0x7f97341474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-15T16:39:32.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.132+0000 7f9739b88640 1 -- 172.21.15.62:0/1423725269 >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 msgr2=0x7f97341474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-15T16:39:32.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.132+0000 7f9739b88640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 0x7f97341474e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-15T16:39:32.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.132+0000 7f9739b88640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 0x7f97341474e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-05-15T16:39:32.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.132+0000 7f973a389640 1 -- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 msgr2=0x7f9734149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-15T16:39:32.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.132+0000 7f973a389640 1 -- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 msgr2=0x7f9734149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-15T16:39:32.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.132+0000 7f973a389640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f9734149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-15T16:39:32.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.132+0000 7f973a389640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f9734149fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-05-15T16:39:32.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.132+0000 7f9739387640 1 -- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 msgr2=0x7f9734140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-05-15T16:39:32.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.132+0000 7f9739387640 1 -- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 msgr2=0x7f9734140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-15T16:39:32.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.132+0000 7f9739387640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 0x7f9734140aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-15T16:39:32.138 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.132+0000 7f9739387640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 0x7f9734140aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-05-15T16:39:32.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.936+0000 7f9739b88640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 0x7f97341474e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:32.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.936+0000 7f973a389640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f9734149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:32.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.936+0000 7f9739387640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 0x7f9734140aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:32.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.936+0000 7f9739b88640 1 -- 172.21.15.62:0/1423725269 >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 msgr2=0x7f97341474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-05-15T16:39:32.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.936+0000 7f9739b88640 1 -- 172.21.15.62:0/1423725269 >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 msgr2=0x7f97341474e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-15T16:39:32.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.936+0000 7f9739b88640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 0x7f97341474e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-15T16:39:32.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.936+0000 7f9739b88640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 0x7f97341474e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-05-15T16:39:32.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.936+0000 7f973a389640 1 -- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 msgr2=0x7f9734149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-05-15T16:39:32.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.936+0000 7f973a389640 1 -- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 msgr2=0x7f9734149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-15T16:39:32.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.936+0000 7f9739387640 1 -- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 msgr2=0x7f9734140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-05-15T16:39:32.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.936+0000 7f973a389640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f9734149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-15T16:39:32.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.936+0000 7f9739387640 1 -- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 msgr2=0x7f9734140aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-05-15T16:39:32.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.936+0000 7f9739387640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 0x7f9734140aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-05-15T16:39:32.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.936+0000 7f9739387640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 0x7f9734140aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-05-15T16:39:32.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:32.936+0000 7f973a389640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f9734149fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-05-15T16:39:34.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:34.520+0000 7f972b7fe640 1 -- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 msgr2=0x7f9734149fd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-15T16:39:34.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:34.520+0000 7f972b7fe640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f9734149fd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:34.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:34.520+0000 7f972b7fe640 1 -- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 msgr2=0x7f9734140aa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-15T16:39:34.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:34.520+0000 7f972b7fe640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.161:3300/0 conn(0x7f97340b3980 0x7f9734140aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:34.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:34.520+0000 7f972b7fe640 1 -- 172.21.15.62:0/1423725269 >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 msgr2=0x7f97341474e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-15T16:39:34.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:34.520+0000 7f972b7fe640 1 --2- 172.21.15.62:0/1423725269 >> v2:172.21.15.62:3300/0 conn(0x7f97340ba0b0 0x7f97341474e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:34.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:34.524+0000 7f972b7fe640 1 -- 172.21.15.62:0/1423725269 --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f972000b0a0 con 0x7f9720007390 2023-05-15T16:39:34.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:34.524+0000 7f972b7fe640 1 -- 172.21.15.62:0/1423725269 --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f972000c280 con 0x7f97200036a0 2023-05-15T16:39:36.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.780+0000 7f9738b86640 1 -- 172.21.15.62:0/1423725269 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736596753 0 0) 0x7f972000b0a0 con 0x7f9720007390 2023-05-15T16:39:36.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.780+0000 7f9738b86640 1 -- 172.21.15.62:0/1423725269 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9718003530 con 0x7f9720007390 2023-05-15T16:39:36.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.780+0000 7f9738b86640 1 -- 172.21.15.62:0/1423725269 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1109480944 0 0) 0x7f972000c280 con 0x7f97200036a0 2023-05-15T16:39:36.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.780+0000 7f9738b86640 1 -- 172.21.15.62:0/1423725269 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f972000b0a0 con 0x7f97200036a0 2023-05-15T16:39:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.784+0000 7f9738b86640 1 -- 172.21.15.62:0/1423725269 <== mon.1 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2179409074 0 0) 0x7f972000b0a0 con 0x7f97200036a0 2023-05-15T16:39:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.784+0000 7f9738b86640 1 -- 172.21.15.62:0/1423725269 >> v1:172.21.15.62:6789/0 conn(0x7f9720007390 legacy=0x7f9720009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.784+0000 7f9738b86640 1 -- 172.21.15.62:0/1423725269 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972000d480 con 0x7f97200036a0 2023-05-15T16:39:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.784+0000 7f9738b86640 1 -- 172.21.15.62:0/1423725269 <== mon.1 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7f973000c570 con 0x7f97200036a0 2023-05-15T16:39:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.784+0000 7f9738b86640 1 -- 172.21.15.62:0/1423725269 >> v1:172.21.15.161:6789/0 conn(0x7f97200036a0 legacy=0x7f9720005ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.784+0000 7f9738b86640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f9718003b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:36.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.784+0000 7f9738b86640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97180040f0 0x7f97180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:36.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.784+0000 7f973a389640 1 -- 172.21.15.62:0/1423725269 reap_dead start 2023-05-15T16:39:36.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.784+0000 7f9738b86640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9718004f10 0x7f971800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:36.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.784+0000 7f9738b86640 1 -- 172.21.15.62:0/1423725269 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9718005630 con 0x7f9718004f10 2023-05-15T16:39:36.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.784+0000 7f9738b86640 1 -- 172.21.15.62:0/1423725269 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f971800bed0 con 0x7f97180040f0 2023-05-15T16:39:36.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.784+0000 7f9738b86640 1 -- 172.21.15.62:0/1423725269 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f971800c060 con 0x7f9734140fe0 2023-05-15T16:39:36.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.784+0000 7f9739387640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97180040f0 0x7f97180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:36.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.784+0000 7f973a389640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9718004f10 0x7f971800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:36.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.784+0000 7f9739b88640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f9718003b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:36.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.784+0000 7f9739387640 1 -- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 msgr2=0x7f9718003b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:36.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.784+0000 7f9739387640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f9718003b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:36.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.784+0000 7f9739387640 1 -- 172.21.15.62:0/1423725269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9718004f10 msgr2=0x7f971800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:36.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.784+0000 7f9739387640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9718004f10 0x7f971800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:36.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.784+0000 7f9739387640 1 -- 172.21.15.62:0/1423725269 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f972000b0a0 con 0x7f97180040f0 2023-05-15T16:39:36.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.784+0000 7f973a389640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9718004f10 0x7f971800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-15T16:39:36.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.788+0000 7f9739b88640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f9718003b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-15T16:39:36.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.792+0000 7f9739387640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97180040f0 0x7f97180047d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9724010c70 tx=0x7f972401d590 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9ef177ad020c8d96 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:36.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.792+0000 7f9738b86640 1 -- 172.21.15.62:0/1423725269 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97240b1070 con 0x7f97180040f0 2023-05-15T16:39:36.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.792+0000 7f9738b86640 1 -- 172.21.15.62:0/1423725269 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9724004020 con 0x7f97180040f0 2023-05-15T16:39:36.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.792+0000 7f9738b86640 1 -- 172.21.15.62:0/1423725269 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97240041b0 con 0x7f97180040f0 2023-05-15T16:39:36.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.792+0000 7f973bdec640 1 -- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97180040f0 msgr2=0x7f97180047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:36.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.792+0000 7f973bdec640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97180040f0 0x7f97180047d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9724010c70 tx=0x7f972401d590 comp rx=0 tx=0).stop 2023-05-15T16:39:36.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.792+0000 7f973bdec640 1 -- 172.21.15.62:0/1423725269 shutdown_connections 2023-05-15T16:39:36.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.792+0000 7f973bdec640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9718004f10 0x7f971800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.792+0000 7f973bdec640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97180040f0 0x7f97180047d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.792+0000 7f973bdec640 1 --2- 172.21.15.62:0/1423725269 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f9718003b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.792+0000 7f973bdec640 1 -- 172.21.15.62:0/1423725269 >> 172.21.15.62:0/1423725269 conn(0x7f973406dd10 msgr2=0x7f97340b9740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.792+0000 7f973bdec640 1 -- 172.21.15.62:0/1423725269 shutdown_connections 2023-05-15T16:39:36.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.792+0000 7f973bdec640 1 -- 172.21.15.62:0/1423725269 wait complete. 2023-05-15T16:39:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.796+0000 7f973bdec640 1 Processor -- start 2023-05-15T16:39:36.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.796+0000 7f973bdec640 1 -- start start 2023-05-15T16:39:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.796+0000 7f973bdec640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97180040f0 0x7f97341dd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:36.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.796+0000 7f973bdec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9718004f10 0x7f97341daa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:36.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.796+0000 7f973bdec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f97340b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:36.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.796+0000 7f973bdec640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97341d9fd0 con 0x7f97180040f0 2023-05-15T16:39:36.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.796+0000 7f973bdec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97340b6010 con 0x7f9718004f10 2023-05-15T16:39:36.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.796+0000 7f973bdec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97340b62e0 con 0x7f9734140fe0 2023-05-15T16:39:36.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.796+0000 7f9739b88640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97180040f0 0x7f97341dd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:36.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.800+0000 7f9739b88640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97180040f0 0x7f97341dd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49834/0 (socket says 172.21.15.62:49834) 2023-05-15T16:39:36.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.800+0000 7f9739b88640 1 -- 172.21.15.62:0/4166732822 learned_addr learned my addr 172.21.15.62:0/4166732822 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:36.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.800+0000 7f9739387640 1 --2- 172.21.15.62:0/4166732822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9718004f10 0x7f97341daa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:36.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.800+0000 7f973a389640 1 --2- 172.21.15.62:0/4166732822 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f97340b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:36.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.800+0000 7f9739b88640 1 -- 172.21.15.62:0/4166732822 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 msgr2=0x7f97340b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:36.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.800+0000 7f9739b88640 1 --2- 172.21.15.62:0/4166732822 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f97340b5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.800+0000 7f9739b88640 1 -- 172.21.15.62:0/4166732822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9718004f10 msgr2=0x7f97341daa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.800+0000 7f9739b88640 1 --2- 172.21.15.62:0/4166732822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9718004f10 0x7f97341daa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.800+0000 7f9739b88640 1 -- 172.21.15.62:0/4166732822 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9734146ce0 con 0x7f97180040f0 2023-05-15T16:39:36.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.800+0000 7f9739b88640 1 --2- 172.21.15.62:0/4166732822 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97180040f0 0x7f97341dd520 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f97300040e0 tx=0x7f97300041d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.800+0000 7f972a7fc640 1 -- 172.21.15.62:0/4166732822 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730003da0 con 0x7f97180040f0 2023-05-15T16:39:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.800+0000 7f972a7fc640 1 -- 172.21.15.62:0/4166732822 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973000c040 con 0x7f97180040f0 2023-05-15T16:39:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.800+0000 7f973bdec640 1 -- 172.21.15.62:0/4166732822 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97340b8230 con 0x7f97180040f0 2023-05-15T16:39:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.800+0000 7f972a7fc640 1 -- 172.21.15.62:0/4166732822 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9730022670 con 0x7f97180040f0 2023-05-15T16:39:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.800+0000 7f973bdec640 1 -- 172.21.15.62:0/4166732822 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9734146fc0 con 0x7f97180040f0 2023-05-15T16:39:36.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.800+0000 7f972a7fc640 1 -- 172.21.15.62:0/4166732822 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f973001f070 con 0x7f97180040f0 2023-05-15T16:39:36.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.800+0000 7f972a7fc640 1 -- 172.21.15.62:0/4166732822 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f9730018bc0 con 0x7f97180040f0 2023-05-15T16:39:36.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.800+0000 7f973bdec640 1 -- 172.21.15.62:0/4166732822 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9734073a90 con 0x7f97180040f0 2023-05-15T16:39:36.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.804+0000 7f972a7fc640 1 -- 172.21.15.62:0/4166732822 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f973000f040 con 0x7f97180040f0 2023-05-15T16:39:36.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.868+0000 7f973bdec640 1 -- 172.21.15.62:0/4166732822 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f97340bc610 con 0x7f97180040f0 2023-05-15T16:39:36.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.872+0000 7f972a7fc640 1 -- 172.21.15.62:0/4166732822 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f9730018dd0 con 0x7f97180040f0 2023-05-15T16:39:36.881 INFO:teuthology.orchestra.run.smithi062.stderr:adjusted tunables profile to default 2023-05-15T16:39:36.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.876+0000 7f973bdec640 1 -- 172.21.15.62:0/4166732822 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97180040f0 msgr2=0x7f97341dd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:36.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.876+0000 7f973bdec640 1 --2- 172.21.15.62:0/4166732822 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97180040f0 0x7f97341dd520 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f97300040e0 tx=0x7f97300041d0 comp rx=0 tx=0).stop 2023-05-15T16:39:36.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.876+0000 7f973bdec640 1 -- 172.21.15.62:0/4166732822 shutdown_connections 2023-05-15T16:39:36.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.876+0000 7f973bdec640 1 --2- 172.21.15.62:0/4166732822 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9734140fe0 0x7f97340b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:36.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.876+0000 7f973bdec640 1 --2- 172.21.15.62:0/4166732822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9718004f10 0x7f97341daa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:36.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.876+0000 7f973bdec640 1 --2- 172.21.15.62:0/4166732822 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97180040f0 0x7f97341dd520 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:36.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.876+0000 7f973bdec640 1 -- 172.21.15.62:0/4166732822 >> 172.21.15.62:0/4166732822 conn(0x7f973406dd10 msgr2=0x7f973413e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:36.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.876+0000 7f973bdec640 1 -- 172.21.15.62:0/4166732822 shutdown_connections 2023-05-15T16:39:36.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:36.876+0000 7f973bdec640 1 -- 172.21.15.62:0/4166732822 wait complete. 2023-05-15T16:39:36.900 INFO:tasks.ceph:check_enable_crimson: False 2023-05-15T16:39:36.901 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-05-15T16:39:36.901 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:39:36.901 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-05-15T16:39:36.911 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:39:36.912 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-05-15T16:39:36.964 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:39:36.964 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-05-15T16:39:37.017 DEBUG:teuthology.orchestra.run.smithi062:> set -ex 2023-05-15T16:39:37.018 DEBUG:teuthology.orchestra.run.smithi062:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-05-15T16:39:37.059 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:37.052+0000 7f5cf6c57180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-15T16:39:37.062 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:37.058+0000 7fb4eacce180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-05-15T16:39:37.071 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-05-15T16:39:37.072 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-05-15T16:39:37.087 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-05-15T16:39:37.087 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-05-15T16:39:37.140 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-05-15T16:39:37.141 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-05-15T16:39:37.199 DEBUG:teuthology.orchestra.run.smithi161:> set -ex 2023-05-15T16:39:37.199 DEBUG:teuthology.orchestra.run.smithi161:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-05-15T16:39:37.255 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 780dd483-5a31-4c7e-bd31-ab5ab8e5b409 0 2023-05-15T16:39:37.418 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.414+0000 7f490e779640 1 Processor -- start 2023-05-15T16:39:37.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.414+0000 7f490e779640 1 -- start start 2023-05-15T16:39:37.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.414+0000 7f490e779640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49080b7ba0 0x7f49080bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:37.419 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.414+0000 7f490e779640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f49080b8fd0 0x7f49080b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:37.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.414+0000 7f490e779640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49080b88b0 con 0x7f49080b7f70 2023-05-15T16:39:37.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.414+0000 7f490e779640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4908142200 con 0x7f49080b8fd0 2023-05-15T16:39:37.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.414+0000 7f490e779640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49080b9db0 con 0x7f49080b7ba0 2023-05-15T16:39:37.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.414+0000 7f49077fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f49080b8fd0 0x7f49080b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:37.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.414+0000 7f4907fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49080b7ba0 0x7f49080bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:37.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.414+0000 7f49077fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f49080b8fd0 0x7f49080b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37174/0 (socket says 172.21.15.161:37174) 2023-05-15T16:39:37.420 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.414+0000 7f49077fe640 1 -- 172.21.15.161:0/2703191389 learned_addr learned my addr 172.21.15.161:0/2703191389 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-05-15T16:39:37.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.414+0000 7f49077fe640 1 -- 172.21.15.161:0/2703191389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49080b7ba0 msgr2=0x7f49080bd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:37.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.414+0000 7f49077fe640 1 --2- 172.21.15.161:0/2703191389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49080b7ba0 0x7f49080bd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.414+0000 7f49077fe640 1 -- 172.21.15.161:0/2703191389 >> v1:172.21.15.62:6789/0 conn(0x7f49080b7f70 legacy=0x7f4908147bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:37.421 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.414+0000 7f49077fe640 1 -- 172.21.15.161:0/2703191389 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49080ba020 con 0x7f49080b8fd0 2023-05-15T16:39:37.425 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f49077fe640 1 --2- 172.21.15.161:0/2703191389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49080b8fd0 0x7f49080b4770 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f48fc009870 tx=0x7f48fc01ecf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=877a112ca01512df server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:37.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f4906ffd640 1 -- 172.21.15.161:0/2703191389 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc0a89b0 con 0x7f49080b8fd0 2023-05-15T16:39:37.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f4906ffd640 1 -- 172.21.15.161:0/2703191389 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48fc0a8b10 con 0x7f49080b8fd0 2023-05-15T16:39:37.426 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f4906ffd640 1 -- 172.21.15.161:0/2703191389 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48fc0a8ea0 con 0x7f49080b8fd0 2023-05-15T16:39:37.427 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f490e779640 1 -- 172.21.15.161:0/2703191389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49080b8fd0 msgr2=0x7f49080b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:37.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f490e779640 1 --2- 172.21.15.161:0/2703191389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49080b8fd0 0x7f49080b4770 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f48fc009870 tx=0x7f48fc01ecf0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f490e779640 1 -- 172.21.15.161:0/2703191389 shutdown_connections 2023-05-15T16:39:37.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f490e779640 1 --2- 172.21.15.161:0/2703191389 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49080b8fd0 0x7f49080b4770 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.428 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f490e779640 1 --2- 172.21.15.161:0/2703191389 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49080b7ba0 0x7f49080bd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f490e779640 1 -- 172.21.15.161:0/2703191389 >> 172.21.15.161:0/2703191389 conn(0x7f49080bdde0 msgr2=0x7f49080be1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:37.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f490e779640 1 -- 172.21.15.161:0/2703191389 shutdown_connections 2023-05-15T16:39:37.429 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f490e779640 1 -- 172.21.15.161:0/2703191389 wait complete. 2023-05-15T16:39:37.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f490e779640 1 Processor -- start 2023-05-15T16:39:37.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f490e779640 1 -- start start 2023-05-15T16:39:37.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f490e779640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49080b7ba0 0x7f49081447d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:37.430 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f490e779640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49080b7f70 0x7f49081e2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:37.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f490e779640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49080b8fd0 0x7f490806adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:37.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f490e779640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49081e2650 con 0x7f49080b8fd0 2023-05-15T16:39:37.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f490e779640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4908144d10 con 0x7f49080b7f70 2023-05-15T16:39:37.431 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f490e779640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f490806c5a0 con 0x7f49080b7ba0 2023-05-15T16:39:37.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f49077fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49080b7f70 0x7f49081e2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:37.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f4907fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49080b7ba0 0x7f49081447d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:37.432 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f4907fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49080b7ba0 0x7f49081447d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:59448/0 (socket says 172.21.15.161:59448) 2023-05-15T16:39:37.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f49077fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49080b7f70 0x7f49081e2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37176/0 (socket says 172.21.15.161:37176) 2023-05-15T16:39:37.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f4907fff640 1 -- 172.21.15.161:0/1994955959 learned_addr learned my addr 172.21.15.161:0/1994955959 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-05-15T16:39:37.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f490cd16640 1 --2- 172.21.15.161:0/1994955959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49080b8fd0 0x7f490806adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:37.433 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f4907fff640 1 -- 172.21.15.161:0/1994955959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49080b7f70 msgr2=0x7f49081e2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:37.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f4907fff640 1 --2- 172.21.15.161:0/1994955959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49080b7f70 0x7f49081e2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f4907fff640 1 -- 172.21.15.161:0/1994955959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49080b8fd0 msgr2=0x7f490806adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:37.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f4907fff640 1 --2- 172.21.15.161:0/1994955959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49080b8fd0 0x7f490806adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.434 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f4907fff640 1 -- 172.21.15.161:0/1994955959 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48fc0094d0 con 0x7f49080b7ba0 2023-05-15T16:39:37.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f49077fe640 1 --2- 172.21.15.161:0/1994955959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49080b7f70 0x7f49081e2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-15T16:39:37.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f4907fff640 1 --2- 172.21.15.161:0/1994955959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49080b7ba0 0x7f49081447d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f48f800e930 tx=0x7f48f800edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:37.435 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f4904ff9640 1 -- 172.21.15.161:0/1994955959 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f8009690 con 0x7f49080b7ba0 2023-05-15T16:39:37.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f4904ff9640 1 -- 172.21.15.161:0/1994955959 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48f800ca00 con 0x7f49080b7ba0 2023-05-15T16:39:37.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f4904ff9640 1 -- 172.21.15.161:0/1994955959 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48f800cd70 con 0x7f49080b7ba0 2023-05-15T16:39:37.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f490e779640 1 -- 172.21.15.161:0/1994955959 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49080b94d0 con 0x7f49080b7ba0 2023-05-15T16:39:37.436 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.418+0000 7f490e779640 1 -- 172.21.15.161:0/1994955959 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49080ba300 con 0x7f49080b7ba0 2023-05-15T16:39:37.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.422+0000 7f4904ff9640 1 -- 172.21.15.161:0/1994955959 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f48f8005ca0 con 0x7f49080b7ba0 2023-05-15T16:39:37.437 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.422+0000 7f4904ff9640 1 -- 172.21.15.161:0/1994955959 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f48f8013840 con 0x7f49080b7ba0 2023-05-15T16:39:37.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.422+0000 7f48ee7fc640 1 -- 172.21.15.161:0/1994955959 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49080b9660 con 0x7f49080b7ba0 2023-05-15T16:39:37.438 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.434+0000 7f4904ff9640 1 -- 172.21.15.161:0/1994955959 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f48f8021060 con 0x7f49080b7ba0 2023-05-15T16:39:37.505 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.502+0000 7f48ee7fc640 1 -- 172.21.15.161:0/1994955959 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd new", "uuid": "780dd483-5a31-4c7e-bd31-ab5ab8e5b409", "id": 0} v 0) v1 -- 0x7f49081e28c0 con 0x7f49080b7ba0 2023-05-15T16:39:37.514 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.510+0000 7f4904ff9640 1 -- 172.21.15.161:0/1994955959 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "780dd483-5a31-4c7e-bd31-ab5ab8e5b409", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f48f8017070 con 0x7f49080b7ba0 2023-05-15T16:39:37.515 INFO:teuthology.orchestra.run.smithi161.stdout:0 2023-05-15T16:39:37.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.510+0000 7f48ee7fc640 1 -- 172.21.15.161:0/1994955959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49080b7ba0 msgr2=0x7f49081447d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:37.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.510+0000 7f48ee7fc640 1 --2- 172.21.15.161:0/1994955959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49080b7ba0 0x7f49081447d0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f48f800e930 tx=0x7f48f800edf0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.510+0000 7f48ee7fc640 1 -- 172.21.15.161:0/1994955959 shutdown_connections 2023-05-15T16:39:37.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.510+0000 7f48ee7fc640 1 --2- 172.21.15.161:0/1994955959 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49080b8fd0 0x7f490806adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.516 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.510+0000 7f48ee7fc640 1 --2- 172.21.15.161:0/1994955959 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49080b7f70 0x7f49081e2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.510+0000 7f48ee7fc640 1 --2- 172.21.15.161:0/1994955959 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49080b7ba0 0x7f49081447d0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.510+0000 7f48ee7fc640 1 -- 172.21.15.161:0/1994955959 >> 172.21.15.161:0/1994955959 conn(0x7f49080bdde0 msgr2=0x7f49080bc660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:37.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.510+0000 7f48ee7fc640 1 -- 172.21.15.161:0/1994955959 shutdown_connections 2023-05-15T16:39:37.517 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.510+0000 7f48ee7fc640 1 -- 172.21.15.161:0/1994955959 wait complete. 2023-05-15T16:39:37.531 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new d34effc2-e11d-468e-8890-90a4fe6fe11a 1 2023-05-15T16:39:37.575 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:37.574+0000 7fb4eacce180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-15T16:39:37.593 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:37.584+0000 7f5cf6c57180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-05-15T16:39:37.644 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.642+0000 7f5bea09e640 1 Processor -- start 2023-05-15T16:39:37.645 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.642+0000 7f5bea09e640 1 -- start start 2023-05-15T16:39:37.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.642+0000 7f5bea09e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5be406d110 0x7f5be4146900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:37.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.642+0000 7f5bea09e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5be414aae0 0x7f5be40b8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:37.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.642+0000 7f5bea09e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5be41405a0 0x7f5be4140a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:37.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.642+0000 7f5bea09e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be40b9510 con 0x7f5be406d110 2023-05-15T16:39:37.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.642+0000 7f5bea09e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5be414a000 con 0x7f5be41405a0 2023-05-15T16:39:37.646 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.642+0000 7f5bea09e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be414a2e0 con 0x7f5be414aae0 2023-05-15T16:39:37.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.642+0000 7f5be2ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5be414aae0 0x7f5be40b8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:37.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.642+0000 7f5be3fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5be41405a0 0x7f5be4140a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:37.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.642+0000 7f5be3fff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5be41405a0 0x7f5be4140a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37182/0 (socket says 172.21.15.161:37182) 2023-05-15T16:39:37.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.642+0000 7f5be2ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5be414aae0 0x7f5be40b8be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:59460/0 (socket says 172.21.15.161:59460) 2023-05-15T16:39:37.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.642+0000 7f5be3fff640 1 -- 172.21.15.161:0/3716307806 learned_addr learned my addr 172.21.15.161:0/3716307806 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-05-15T16:39:37.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.642+0000 7f5be3fff640 1 -- 172.21.15.161:0/3716307806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5be414aae0 msgr2=0x7f5be40b8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:37.647 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.642+0000 7f5be3fff640 1 --2- 172.21.15.161:0/3716307806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5be414aae0 0x7f5be40b8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.642+0000 7f5be3fff640 1 -- 172.21.15.161:0/3716307806 >> v2:172.21.15.62:3300/0 conn(0x7f5be406d110 msgr2=0x7f5be4146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:37.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.642+0000 7f5be3fff640 1 --2- 172.21.15.161:0/3716307806 >> v2:172.21.15.62:3300/0 conn(0x7f5be406d110 0x7f5be4146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.648 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.642+0000 7f5be3fff640 1 -- 172.21.15.161:0/3716307806 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be414a5c0 con 0x7f5be41405a0 2023-05-15T16:39:37.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5be3fff640 1 --2- 172.21.15.161:0/3716307806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5be41405a0 0x7f5be4140a00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5be4066420 tx=0x7f5bd401c9d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b5bb83db7cc4fe server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:37.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5be27fc640 1 -- 172.21.15.161:0/3716307806 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd40a5650 con 0x7f5be41405a0 2023-05-15T16:39:37.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5be27fc640 1 -- 172.21.15.161:0/3716307806 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd40a57b0 con 0x7f5be41405a0 2023-05-15T16:39:37.649 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5be27fc640 1 -- 172.21.15.161:0/3716307806 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd40a5b40 con 0x7f5be41405a0 2023-05-15T16:39:37.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5bea09e640 1 -- 172.21.15.161:0/3716307806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5be41405a0 msgr2=0x7f5be4140a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:37.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5bea09e640 1 --2- 172.21.15.161:0/3716307806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5be41405a0 0x7f5be4140a00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5be4066420 tx=0x7f5bd401c9d0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5bea09e640 1 -- 172.21.15.161:0/3716307806 shutdown_connections 2023-05-15T16:39:37.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5bea09e640 1 --2- 172.21.15.161:0/3716307806 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5be41405a0 0x7f5be4140a00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5bea09e640 1 --2- 172.21.15.161:0/3716307806 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5be414aae0 0x7f5be40b8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5bea09e640 1 --2- 172.21.15.161:0/3716307806 >> v2:172.21.15.62:3300/0 conn(0x7f5be406d110 0x7f5be4146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.650 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5bea09e640 1 -- 172.21.15.161:0/3716307806 >> 172.21.15.161:0/3716307806 conn(0x7f5be40bcc50 msgr2=0x7f5be40bd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:37.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5bea09e640 1 -- 172.21.15.161:0/3716307806 shutdown_connections 2023-05-15T16:39:37.651 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5bea09e640 1 -- 172.21.15.161:0/3716307806 wait complete. 2023-05-15T16:39:37.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5bea09e640 1 Processor -- start 2023-05-15T16:39:37.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5bea09e640 1 -- start start 2023-05-15T16:39:37.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5bea09e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5be406d110 0x7f5be4148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:37.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5bea09e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5be41405a0 0x7f5be4139390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:37.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5bea09e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5be414aae0 0x7f5be40b3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:37.653 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5bea09e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be41494a0 con 0x7f5be406d110 2023-05-15T16:39:37.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5bea09e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be4134ac0 con 0x7f5be41405a0 2023-05-15T16:39:37.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5bea09e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be4139cd0 con 0x7f5be414aae0 2023-05-15T16:39:37.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5be2ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5be41405a0 0x7f5be4139390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:37.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5be3fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5be414aae0 0x7f5be40b3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:37.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5be3fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5be414aae0 0x7f5be40b3f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:59466/0 (socket says 172.21.15.161:59466) 2023-05-15T16:39:37.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5be3fff640 1 -- 172.21.15.161:0/3853588990 learned_addr learned my addr 172.21.15.161:0/3853588990 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-05-15T16:39:37.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5be37fe640 1 --2- 172.21.15.161:0/3853588990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5be406d110 0x7f5be4148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:37.654 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5be3fff640 1 -- 172.21.15.161:0/3853588990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5be41405a0 msgr2=0x7f5be4139390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:37.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5be3fff640 1 --2- 172.21.15.161:0/3853588990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5be41405a0 0x7f5be4139390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5be3fff640 1 -- 172.21.15.161:0/3853588990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5be406d110 msgr2=0x7f5be4148f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:37.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5be3fff640 1 --2- 172.21.15.161:0/3853588990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5be406d110 0x7f5be4148f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5be3fff640 1 -- 172.21.15.161:0/3853588990 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd4009b30 con 0x7f5be414aae0 2023-05-15T16:39:37.655 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5be37fe640 1 --2- 172.21.15.161:0/3853588990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5be406d110 0x7f5be4148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:39:37.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5be3fff640 1 --2- 172.21.15.161:0/3853588990 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5be414aae0 0x7f5be40b3f50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5bd401b080 tx=0x7f5bd4019770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:37.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5bdbfff640 1 -- 172.21.15.161:0/3853588990 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd40b8670 con 0x7f5be414aae0 2023-05-15T16:39:37.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5bdbfff640 1 -- 172.21.15.161:0/3853588990 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd40b87d0 con 0x7f5be414aae0 2023-05-15T16:39:37.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.646+0000 7f5bdbfff640 1 -- 172.21.15.161:0/3853588990 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd40b8b80 con 0x7f5be414aae0 2023-05-15T16:39:37.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.650+0000 7f5bea09e640 1 -- 172.21.15.161:0/3853588990 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be406f5a0 con 0x7f5be414aae0 2023-05-15T16:39:37.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.650+0000 7f5bea09e640 1 -- 172.21.15.161:0/3853588990 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be406f410 con 0x7f5be414aae0 2023-05-15T16:39:37.656 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.650+0000 7f5bdbfff640 1 -- 172.21.15.161:0/3853588990 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5bd40c1400 con 0x7f5be414aae0 2023-05-15T16:39:37.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.650+0000 7f5bdbfff640 1 -- 172.21.15.161:0/3853588990 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f5bd40b67f0 con 0x7f5be414aae0 2023-05-15T16:39:37.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.650+0000 7f5bea09e640 1 -- 172.21.15.161:0/3853588990 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be40b9120 con 0x7f5be414aae0 2023-05-15T16:39:37.657 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.654+0000 7f5bdbfff640 1 -- 172.21.15.161:0/3853588990 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f5bd40dfb00 con 0x7f5be414aae0 2023-05-15T16:39:37.723 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.718+0000 7f5bea09e640 1 -- 172.21.15.161:0/3853588990 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d34effc2-e11d-468e-8890-90a4fe6fe11a", "id": 1} v 0) v1 -- 0x7f5be40711b0 con 0x7f5be414aae0 2023-05-15T16:39:37.735 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.730+0000 7f5bdbfff640 1 -- 172.21.15.161:0/3853588990 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d34effc2-e11d-468e-8890-90a4fe6fe11a", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5bd40ce030 con 0x7f5be414aae0 2023-05-15T16:39:37.735 INFO:teuthology.orchestra.run.smithi161.stdout:1 2023-05-15T16:39:37.736 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.734+0000 7f5bea09e640 1 -- 172.21.15.161:0/3853588990 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5be414aae0 msgr2=0x7f5be40b3f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:37.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.734+0000 7f5bea09e640 1 --2- 172.21.15.161:0/3853588990 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5be414aae0 0x7f5be40b3f50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5bd401b080 tx=0x7f5bd4019770 comp rx=0 tx=0).stop 2023-05-15T16:39:37.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.734+0000 7f5bea09e640 1 -- 172.21.15.161:0/3853588990 shutdown_connections 2023-05-15T16:39:37.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.734+0000 7f5bea09e640 1 --2- 172.21.15.161:0/3853588990 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5be414aae0 0x7f5be40b3f50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.734+0000 7f5bea09e640 1 --2- 172.21.15.161:0/3853588990 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5be41405a0 0x7f5be4139390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.734+0000 7f5bea09e640 1 --2- 172.21.15.161:0/3853588990 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5be406d110 0x7f5be4148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.737 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.734+0000 7f5bea09e640 1 -- 172.21.15.161:0/3853588990 >> 172.21.15.161:0/3853588990 conn(0x7f5be40bcc50 msgr2=0x7f5be406f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:37.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.734+0000 7f5bea09e640 1 -- 172.21.15.161:0/3853588990 shutdown_connections 2023-05-15T16:39:37.738 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.734+0000 7f5bea09e640 1 -- 172.21.15.161:0/3853588990 wait complete. 2023-05-15T16:39:37.752 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 277c65ad-f31f-4e9c-a8b8-8688dc19132f 2 2023-05-15T16:39:37.755 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:37.750+0000 7fb4eacce180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-15T16:39:37.773 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:37.764+0000 7f5cf6c57180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-05-15T16:39:37.864 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.862+0000 7f9db3311640 1 Processor -- start 2023-05-15T16:39:37.865 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.862+0000 7f9db3311640 1 -- start start 2023-05-15T16:39:37.866 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.862+0000 7f9db3311640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9dac06d110 0x7f9dac146900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:37.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.862+0000 7f9db3311640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9dac14aae0 0x7f9dac0b8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:37.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.862+0000 7f9db3311640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9dac1405a0 0x7f9dac140a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:37.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.862+0000 7f9db3311640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dac0b9510 con 0x7f9dac14aae0 2023-05-15T16:39:37.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.862+0000 7f9db3311640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dac14a000 con 0x7f9dac1405a0 2023-05-15T16:39:37.867 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.862+0000 7f9db3311640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac14a2e0 con 0x7f9dac06d110 2023-05-15T16:39:37.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.862+0000 7f9db10ad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9dac06d110 0x7f9dac146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:37.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.862+0000 7f9db18ae640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9dac1405a0 0x7f9dac140a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:37.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.862+0000 7f9db10ad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9dac06d110 0x7f9dac146900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:59480/0 (socket says 172.21.15.161:59480) 2023-05-15T16:39:37.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.862+0000 7f9db10ad640 1 -- 172.21.15.161:0/80559096 learned_addr learned my addr 172.21.15.161:0/80559096 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-05-15T16:39:37.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.862+0000 7f9db08ac640 1 --2- 172.21.15.161:0/80559096 >> v2:172.21.15.62:3300/0 conn(0x7f9dac14aae0 0x7f9dac0b8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:37.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.862+0000 7f9db18ae640 1 -- 172.21.15.161:0/80559096 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9dac06d110 msgr2=0x7f9dac146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:37.868 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.862+0000 7f9db18ae640 1 --2- 172.21.15.161:0/80559096 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9dac06d110 0x7f9dac146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.862+0000 7f9db18ae640 1 -- 172.21.15.161:0/80559096 >> v2:172.21.15.62:3300/0 conn(0x7f9dac14aae0 msgr2=0x7f9dac0b8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:37.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.862+0000 7f9db18ae640 1 --2- 172.21.15.161:0/80559096 >> v2:172.21.15.62:3300/0 conn(0x7f9dac14aae0 0x7f9dac0b8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.862+0000 7f9db18ae640 1 -- 172.21.15.161:0/80559096 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dac14a5c0 con 0x7f9dac1405a0 2023-05-15T16:39:37.869 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.862+0000 7f9db08ac640 1 --2- 172.21.15.161:0/80559096 >> v2:172.21.15.62:3300/0 conn(0x7f9dac14aae0 0x7f9dac0b8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:39:37.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.866+0000 7f9db18ae640 1 --2- 172.21.15.161:0/80559096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9dac1405a0 0x7f9dac140a00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9dac066420 tx=0x7f9da801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfb4af629ffdd193 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:37.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.866+0000 7f9da3fff640 1 -- 172.21.15.161:0/80559096 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da80ab600 con 0x7f9dac1405a0 2023-05-15T16:39:37.870 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.866+0000 7f9da3fff640 1 -- 172.21.15.161:0/80559096 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da80a7050 con 0x7f9dac1405a0 2023-05-15T16:39:37.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.866+0000 7f9da3fff640 1 -- 172.21.15.161:0/80559096 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da80ab980 con 0x7f9dac1405a0 2023-05-15T16:39:37.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.866+0000 7f9db3311640 1 -- 172.21.15.161:0/80559096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9dac1405a0 msgr2=0x7f9dac140a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:37.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.866+0000 7f9db3311640 1 --2- 172.21.15.161:0/80559096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9dac1405a0 0x7f9dac140a00 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9dac066420 tx=0x7f9da801c460 comp rx=0 tx=0).stop 2023-05-15T16:39:37.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.866+0000 7f9db3311640 1 -- 172.21.15.161:0/80559096 shutdown_connections 2023-05-15T16:39:37.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.866+0000 7f9db3311640 1 --2- 172.21.15.161:0/80559096 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9dac1405a0 0x7f9dac140a00 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.866+0000 7f9db3311640 1 --2- 172.21.15.161:0/80559096 >> v2:172.21.15.62:3300/0 conn(0x7f9dac14aae0 0x7f9dac0b8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.866+0000 7f9db3311640 1 --2- 172.21.15.161:0/80559096 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9dac06d110 0x7f9dac146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.866+0000 7f9db3311640 1 -- 172.21.15.161:0/80559096 >> 172.21.15.161:0/80559096 conn(0x7f9dac0bcc50 msgr2=0x7f9dac0bd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:37.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.866+0000 7f9db3311640 1 -- 172.21.15.161:0/80559096 shutdown_connections 2023-05-15T16:39:37.872 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.866+0000 7f9db3311640 1 -- 172.21.15.161:0/80559096 wait complete. 2023-05-15T16:39:37.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db3311640 1 Processor -- start 2023-05-15T16:39:37.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db3311640 1 -- start start 2023-05-15T16:39:37.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db3311640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9dac06d110 0x7f9dac139bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:37.875 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db3311640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dac1405a0 0x7f9dac0bbf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:37.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db3311640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9dac14aae0 0x7f9dac144e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:37.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db3311640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac0bc470 con 0x7f9dac1405a0 2023-05-15T16:39:37.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db3311640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac13e770 con 0x7f9dac06d110 2023-05-15T16:39:37.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db3311640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dac1459d0 con 0x7f9dac14aae0 2023-05-15T16:39:37.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db10ad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9dac06d110 0x7f9dac139bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:37.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db10ad640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9dac06d110 0x7f9dac139bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37220/0 (socket says 172.21.15.161:37220) 2023-05-15T16:39:37.876 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db10ad640 1 -- 172.21.15.161:0/236966463 learned_addr learned my addr 172.21.15.161:0/236966463 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-05-15T16:39:37.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db18ae640 1 --2- 172.21.15.161:0/236966463 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9dac14aae0 0x7f9dac144e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:37.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db08ac640 1 --2- 172.21.15.161:0/236966463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dac1405a0 0x7f9dac0bbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:37.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db10ad640 1 -- 172.21.15.161:0/236966463 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9dac14aae0 msgr2=0x7f9dac144e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:37.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db10ad640 1 --2- 172.21.15.161:0/236966463 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9dac14aae0 0x7f9dac144e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db10ad640 1 -- 172.21.15.161:0/236966463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dac1405a0 msgr2=0x7f9dac0bbf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:37.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db10ad640 1 --2- 172.21.15.161:0/236966463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dac1405a0 0x7f9dac0bbf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.877 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db10ad640 1 -- 172.21.15.161:0/236966463 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9da8009420 con 0x7f9dac06d110 2023-05-15T16:39:37.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db18ae640 1 --2- 172.21.15.161:0/236966463 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9dac14aae0 0x7f9dac144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-15T16:39:37.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db08ac640 1 --2- 172.21.15.161:0/236966463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dac1405a0 0x7f9dac0bbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:39:37.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db10ad640 1 --2- 172.21.15.161:0/236966463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9dac06d110 0x7f9dac139bb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9da400efc0 tx=0x7f9da400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:37.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9da1ffb640 1 -- 172.21.15.161:0/236966463 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da400cda0 con 0x7f9dac06d110 2023-05-15T16:39:37.878 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9da1ffb640 1 -- 172.21.15.161:0/236966463 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9da400f040 con 0x7f9dac06d110 2023-05-15T16:39:37.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db3311640 1 -- 172.21.15.161:0/236966463 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dac06f5a0 con 0x7f9dac06d110 2023-05-15T16:39:37.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9da1ffb640 1 -- 172.21.15.161:0/236966463 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9da4014680 con 0x7f9dac06d110 2023-05-15T16:39:37.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db3311640 1 -- 172.21.15.161:0/236966463 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dac06f410 con 0x7f9dac06d110 2023-05-15T16:39:37.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9da1ffb640 1 -- 172.21.15.161:0/236966463 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f9da4014ae0 con 0x7f9dac06d110 2023-05-15T16:39:37.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9da1ffb640 1 -- 172.21.15.161:0/236966463 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f9da401ddd0 con 0x7f9dac06d110 2023-05-15T16:39:37.879 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.870+0000 7f9db3311640 1 -- 172.21.15.161:0/236966463 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dac0b9120 con 0x7f9dac06d110 2023-05-15T16:39:37.880 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.874+0000 7f9da1ffb640 1 -- 172.21.15.161:0/236966463 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f9da401d410 con 0x7f9dac06d110 2023-05-15T16:39:37.943 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.938+0000 7f9db3311640 1 -- 172.21.15.161:0/236966463 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "277c65ad-f31f-4e9c-a8b8-8688dc19132f", "id": 2} v 0) v1 -- 0x7f9dac0711b0 con 0x7f9dac06d110 2023-05-15T16:39:37.953 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.950+0000 7f9da1ffb640 1 -- 172.21.15.161:0/236966463 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "277c65ad-f31f-4e9c-a8b8-8688dc19132f", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9da401d9b0 con 0x7f9dac06d110 2023-05-15T16:39:37.954 INFO:teuthology.orchestra.run.smithi161.stdout:2 2023-05-15T16:39:37.954 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.950+0000 7f9db3311640 1 -- 172.21.15.161:0/236966463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9dac06d110 msgr2=0x7f9dac139bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:37.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.950+0000 7f9db3311640 1 --2- 172.21.15.161:0/236966463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9dac06d110 0x7f9dac139bb0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9da400efc0 tx=0x7f9da400c490 comp rx=0 tx=0).stop 2023-05-15T16:39:37.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.950+0000 7f9db3311640 1 -- 172.21.15.161:0/236966463 shutdown_connections 2023-05-15T16:39:37.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.950+0000 7f9db3311640 1 --2- 172.21.15.161:0/236966463 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9dac14aae0 0x7f9dac144e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.950+0000 7f9db3311640 1 --2- 172.21.15.161:0/236966463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dac1405a0 0x7f9dac0bbf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.950+0000 7f9db3311640 1 --2- 172.21.15.161:0/236966463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9dac06d110 0x7f9dac139bb0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:37.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.950+0000 7f9db3311640 1 -- 172.21.15.161:0/236966463 >> 172.21.15.161:0/236966463 conn(0x7f9dac0bcc50 msgr2=0x7f9dac13ab90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:37.955 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.950+0000 7f9db3311640 1 -- 172.21.15.161:0/236966463 shutdown_connections 2023-05-15T16:39:37.956 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:37.950+0000 7f9db3311640 1 -- 172.21.15.161:0/236966463 wait complete. 2023-05-15T16:39:37.969 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 5a4a4d5f-f863-4783-89c2-2bd806813376 3 2023-05-15T16:39:38.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.078+0000 7f103a96f640 1 Processor -- start 2023-05-15T16:39:38.080 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.078+0000 7f103a96f640 1 -- start start 2023-05-15T16:39:38.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.078+0000 7f103a96f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f103406d110 0x7f1034146900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:38.081 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.078+0000 7f103a96f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f103414aae0 0x7f10340b8be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:38.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.078+0000 7f103a96f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f103414a000 con 0x7f10341405a0 2023-05-15T16:39:38.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.078+0000 7f103a96f640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10340b9510 con 0x7f103406d110 2023-05-15T16:39:38.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.078+0000 7f103a96f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f103414a2e0 con 0x7f103414aae0 2023-05-15T16:39:38.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.078+0000 7f10337fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f103414aae0 0x7f10340b8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:38.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.078+0000 7f1038f0c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f10341405a0 0x7f1034140a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:35200/0 (socket says 172.21.15.161:35200) 2023-05-15T16:39:38.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.078+0000 7f1038f0c640 1 -- 172.21.15.161:0/1245026240 learned_addr learned my addr 172.21.15.161:0/1245026240 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-05-15T16:39:38.082 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.078+0000 7f1033fff640 1 --2- 172.21.15.161:0/1245026240 >> v2:172.21.15.62:3300/0 conn(0x7f103406d110 0x7f1034146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:38.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.078+0000 7f10337fe640 1 -- 172.21.15.161:0/1245026240 >> v2:172.21.15.62:3300/0 conn(0x7f103406d110 msgr2=0x7f1034146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:38.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.078+0000 7f10337fe640 1 --2- 172.21.15.161:0/1245026240 >> v2:172.21.15.62:3300/0 conn(0x7f103406d110 0x7f1034146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.078+0000 7f10337fe640 1 -- 172.21.15.161:0/1245026240 >> v1:172.21.15.161:6789/0 conn(0x7f10341405a0 legacy=0x7f1034140a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:38.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.078+0000 7f10337fe640 1 -- 172.21.15.161:0/1245026240 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f103414a5c0 con 0x7f103414aae0 2023-05-15T16:39:38.083 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.078+0000 7f1032ffd640 1 -- 172.21.15.161:0/1245026240 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 225580629 0 0) 0x7f103414a000 con 0x7f10341405a0 2023-05-15T16:39:38.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f10337fe640 1 --2- 172.21.15.161:0/1245026240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f103414aae0 0x7f10340b8be0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f10340bdcc0 tx=0x7f102801c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5e0f2152eeac910 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:38.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f1032ffd640 1 -- 172.21.15.161:0/1245026240 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10280ab600 con 0x7f103414aae0 2023-05-15T16:39:38.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f1032ffd640 1 -- 172.21.15.161:0/1245026240 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10280a7050 con 0x7f103414aae0 2023-05-15T16:39:38.084 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f1032ffd640 1 -- 172.21.15.161:0/1245026240 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10280ab980 con 0x7f103414aae0 2023-05-15T16:39:38.085 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f103a96f640 1 -- 172.21.15.161:0/1245026240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f103414aae0 msgr2=0x7f10340b8be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:38.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f103a96f640 1 --2- 172.21.15.161:0/1245026240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f103414aae0 0x7f10340b8be0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f10340bdcc0 tx=0x7f102801c460 comp rx=0 tx=0).stop 2023-05-15T16:39:38.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f103a96f640 1 -- 172.21.15.161:0/1245026240 shutdown_connections 2023-05-15T16:39:38.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f103a96f640 1 --2- 172.21.15.161:0/1245026240 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f103414aae0 0x7f10340b8be0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f103a96f640 1 --2- 172.21.15.161:0/1245026240 >> v2:172.21.15.62:3300/0 conn(0x7f103406d110 0x7f1034146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f103a96f640 1 -- 172.21.15.161:0/1245026240 >> 172.21.15.161:0/1245026240 conn(0x7f10340bcc50 msgr2=0x7f10340bd050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:38.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f103a96f640 1 -- 172.21.15.161:0/1245026240 shutdown_connections 2023-05-15T16:39:38.086 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f103a96f640 1 -- 172.21.15.161:0/1245026240 wait complete. 2023-05-15T16:39:38.087 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f103a96f640 1 Processor -- start 2023-05-15T16:39:38.087 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f103a96f640 1 -- start start 2023-05-15T16:39:38.088 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f103a96f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f103406d110 0x7f1034131470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:38.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f103a96f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10341405a0 0x7f103413f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:38.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f103a96f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f103414aae0 0x7f10341301e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:38.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f103a96f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1034134de0 con 0x7f103414aae0 2023-05-15T16:39:38.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f103a96f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10341319b0 con 0x7f10341405a0 2023-05-15T16:39:38.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f103a96f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f103413e580 con 0x7f103406d110 2023-05-15T16:39:38.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f1033fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f103406d110 0x7f1034131470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:38.089 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f1033fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f103406d110 0x7f1034131470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:59498/0 (socket says 172.21.15.161:59498) 2023-05-15T16:39:38.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f1033fff640 1 -- 172.21.15.161:0/3517570186 learned_addr learned my addr 172.21.15.161:0/3517570186 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-05-15T16:39:38.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f10337fe640 1 --2- 172.21.15.161:0/3517570186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10341405a0 0x7f103413f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:38.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f1038f0c640 1 --2- 172.21.15.161:0/3517570186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f103414aae0 0x7f10341301e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:38.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f1033fff640 1 -- 172.21.15.161:0/3517570186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10341405a0 msgr2=0x7f103413f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:38.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f1033fff640 1 --2- 172.21.15.161:0/3517570186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10341405a0 0x7f103413f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f1033fff640 1 -- 172.21.15.161:0/3517570186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f103414aae0 msgr2=0x7f10341301e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:38.090 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f1033fff640 1 --2- 172.21.15.161:0/3517570186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f103414aae0 0x7f10341301e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f1033fff640 1 -- 172.21.15.161:0/3517570186 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1028009420 con 0x7f103406d110 2023-05-15T16:39:38.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f1033fff640 1 --2- 172.21.15.161:0/3517570186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f103406d110 0x7f1034131470 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f102400d830 tx=0x7f102400dcf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:38.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f1030ff9640 1 -- 172.21.15.161:0/3517570186 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102400b6c0 con 0x7f103406d110 2023-05-15T16:39:38.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f1030ff9640 1 -- 172.21.15.161:0/3517570186 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f102400b820 con 0x7f103406d110 2023-05-15T16:39:38.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f1030ff9640 1 -- 172.21.15.161:0/3517570186 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f102400bb90 con 0x7f103406d110 2023-05-15T16:39:38.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f103a96f640 1 -- 172.21.15.161:0/3517570186 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10340b92b0 con 0x7f103406d110 2023-05-15T16:39:38.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.082+0000 7f103a96f640 1 -- 172.21.15.161:0/3517570186 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10340b9120 con 0x7f103406d110 2023-05-15T16:39:38.091 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.086+0000 7f1030ff9640 1 -- 172.21.15.161:0/3517570186 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f102401e760 con 0x7f103406d110 2023-05-15T16:39:38.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.086+0000 7f1030ff9640 1 -- 172.21.15.161:0/3517570186 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f1024014be0 con 0x7f103406d110 2023-05-15T16:39:38.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.086+0000 7f103a96f640 1 -- 172.21.15.161:0/3517570186 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1034153a80 con 0x7f103406d110 2023-05-15T16:39:38.092 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.086+0000 7f1030ff9640 1 -- 172.21.15.161:0/3517570186 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f1024014da0 con 0x7f103406d110 2023-05-15T16:39:38.158 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.154+0000 7f103a96f640 1 -- 172.21.15.161:0/3517570186 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd new", "uuid": "5a4a4d5f-f863-4783-89c2-2bd806813376", "id": 3} v 0) v1 -- 0x7f10340711b0 con 0x7f103406d110 2023-05-15T16:39:38.168 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.166+0000 7f1030ff9640 1 -- 172.21.15.161:0/3517570186 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5a4a4d5f-f863-4783-89c2-2bd806813376", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1024014750 con 0x7f103406d110 2023-05-15T16:39:38.168 INFO:teuthology.orchestra.run.smithi161.stdout:3 2023-05-15T16:39:38.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.166+0000 7f103a96f640 1 -- 172.21.15.161:0/3517570186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f103406d110 msgr2=0x7f1034131470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:38.170 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.166+0000 7f103a96f640 1 --2- 172.21.15.161:0/3517570186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f103406d110 0x7f1034131470 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f102400d830 tx=0x7f102400dcf0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.166+0000 7f103a96f640 1 -- 172.21.15.161:0/3517570186 shutdown_connections 2023-05-15T16:39:38.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.166+0000 7f103a96f640 1 --2- 172.21.15.161:0/3517570186 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f103414aae0 0x7f10341301e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.166+0000 7f103a96f640 1 --2- 172.21.15.161:0/3517570186 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10341405a0 0x7f103413f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.166+0000 7f103a96f640 1 --2- 172.21.15.161:0/3517570186 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f103406d110 0x7f1034131470 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.166+0000 7f103a96f640 1 -- 172.21.15.161:0/3517570186 >> 172.21.15.161:0/3517570186 conn(0x7f10340bcc50 msgr2=0x7f10340b7ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:38.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.166+0000 7f103a96f640 1 -- 172.21.15.161:0/3517570186 shutdown_connections 2023-05-15T16:39:38.171 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.166+0000 7f103a96f640 1 -- 172.21.15.161:0/3517570186 wait complete. 2023-05-15T16:39:38.185 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new ba2e6df7-2918-486c-b4fa-b9e30c852085 4 2023-05-15T16:39:38.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.302+0000 7fa3c506a640 1 Processor -- start 2023-05-15T16:39:38.304 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.302+0000 7fa3c506a640 1 -- start start 2023-05-15T16:39:38.305 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.302+0000 7fa3c506a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa3c00b7ba0 0x7fa3c00bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:38.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.302+0000 7fa3c506a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa3c00b7f70 0x7fa3c0147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:38.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.302+0000 7fa3c506a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c00b88b0 con 0x7fa3c00b8fd0 2023-05-15T16:39:38.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.302+0000 7fa3c506a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c0142200 con 0x7fa3c00b7f70 2023-05-15T16:39:38.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.302+0000 7fa3c506a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c00b9db0 con 0x7fa3c00b7ba0 2023-05-15T16:39:38.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.302+0000 7fa3bed9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa3c00b7ba0 0x7fa3c00bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:38.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.302+0000 7fa3be59c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fa3c00b8fd0 0x7fa3c00b4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:35212/0 (socket says 172.21.15.161:35212) 2023-05-15T16:39:38.306 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.302+0000 7fa3bed9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa3c00b7ba0 0x7fa3c00bd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37240/0 (socket says 172.21.15.161:37240) 2023-05-15T16:39:38.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.302+0000 7fa3be59c640 1 -- 172.21.15.161:0/1391000558 learned_addr learned my addr 172.21.15.161:0/1391000558 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-05-15T16:39:38.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.302+0000 7fa3bf59e640 1 --2- 172.21.15.161:0/1391000558 >> v2:172.21.15.62:3300/0 conn(0x7fa3c00b7f70 0x7fa3c0147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:38.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.302+0000 7fa3bed9d640 1 -- 172.21.15.161:0/1391000558 >> v2:172.21.15.62:3300/0 conn(0x7fa3c00b7f70 msgr2=0x7fa3c0147bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:38.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.302+0000 7fa3bed9d640 1 --2- 172.21.15.161:0/1391000558 >> v2:172.21.15.62:3300/0 conn(0x7fa3c00b7f70 0x7fa3c0147bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.307 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.302+0000 7fa3bed9d640 1 -- 172.21.15.161:0/1391000558 >> v1:172.21.15.161:6789/0 conn(0x7fa3c00b8fd0 legacy=0x7fa3c00b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:38.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.302+0000 7fa3bdd9b640 1 -- 172.21.15.161:0/1391000558 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2296414235 0 0) 0x7fa3c00b88b0 con 0x7fa3c00b8fd0 2023-05-15T16:39:38.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.302+0000 7fa3bed9d640 1 -- 172.21.15.161:0/1391000558 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c00b4e80 con 0x7fa3c00b7ba0 2023-05-15T16:39:38.308 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.302+0000 7fa3bf59e640 1 --2- 172.21.15.161:0/1391000558 >> v2:172.21.15.62:3300/0 conn(0x7fa3c00b7f70 0x7fa3c0147bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:39:38.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3bed9d640 1 --2- 172.21.15.161:0/1391000558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3c00b7ba0 0x7fa3c00bd770 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0070260 tx=0x7fa3b001ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efe82da1287a5bc2 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:38.309 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3bdd9b640 1 -- 172.21.15.161:0/1391000558 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b00a8950 con 0x7fa3c00b7ba0 2023-05-15T16:39:38.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3bdd9b640 1 -- 172.21.15.161:0/1391000558 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b00a8ab0 con 0x7fa3c00b7ba0 2023-05-15T16:39:38.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3bdd9b640 1 -- 172.21.15.161:0/1391000558 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b00a8e40 con 0x7fa3c00b7ba0 2023-05-15T16:39:38.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3c506a640 1 -- 172.21.15.161:0/1391000558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3c00b7ba0 msgr2=0x7fa3c00bd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:38.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3c506a640 1 --2- 172.21.15.161:0/1391000558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3c00b7ba0 0x7fa3c00bd770 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fa3c0070260 tx=0x7fa3b001ec50 comp rx=0 tx=0).stop 2023-05-15T16:39:38.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3c506a640 1 -- 172.21.15.161:0/1391000558 shutdown_connections 2023-05-15T16:39:38.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3c506a640 1 --2- 172.21.15.161:0/1391000558 >> v2:172.21.15.62:3300/0 conn(0x7fa3c00b7f70 0x7fa3c0147bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3c506a640 1 --2- 172.21.15.161:0/1391000558 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3c00b7ba0 0x7fa3c00bd770 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.310 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3c506a640 1 -- 172.21.15.161:0/1391000558 >> 172.21.15.161:0/1391000558 conn(0x7fa3c00bdde0 msgr2=0x7fa3c00be1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:38.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3c506a640 1 -- 172.21.15.161:0/1391000558 shutdown_connections 2023-05-15T16:39:38.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3c506a640 1 -- 172.21.15.161:0/1391000558 wait complete. 2023-05-15T16:39:38.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3c506a640 1 Processor -- start 2023-05-15T16:39:38.311 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3c506a640 1 -- start start 2023-05-15T16:39:38.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3c506a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3c00b7ba0 0x7fa3c0142760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:38.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3c506a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3c00b7f70 0x7fa3c01dc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:38.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3c506a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3c00b8fd0 0x7fa3c0147d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:38.313 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3c506a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c01dc780 con 0x7fa3c00b7f70 2023-05-15T16:39:38.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3c506a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c0148280 con 0x7fa3c00b8fd0 2023-05-15T16:39:38.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3c506a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c0144010 con 0x7fa3c00b7ba0 2023-05-15T16:39:38.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3bed9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3c00b7ba0 0x7fa3c0142760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:38.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3bf59e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3c00b8fd0 0x7fa3c0147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:38.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3bed9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3c00b7ba0 0x7fa3c0142760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:59502/0 (socket says 172.21.15.161:59502) 2023-05-15T16:39:38.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3bed9d640 1 -- 172.21.15.161:0/1147282491 learned_addr learned my addr 172.21.15.161:0/1147282491 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-05-15T16:39:38.314 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3be59c640 1 --2- 172.21.15.161:0/1147282491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3c00b7f70 0x7fa3c01dc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:38.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3bf59e640 1 -- 172.21.15.161:0/1147282491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3c00b7ba0 msgr2=0x7fa3c0142760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:38.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3bf59e640 1 --2- 172.21.15.161:0/1147282491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3c00b7ba0 0x7fa3c0142760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3bf59e640 1 -- 172.21.15.161:0/1147282491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3c00b7f70 msgr2=0x7fa3c01dc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:38.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3bf59e640 1 --2- 172.21.15.161:0/1147282491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3c00b7f70 0x7fa3c01dc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3bf59e640 1 -- 172.21.15.161:0/1147282491 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b0009420 con 0x7fa3c00b8fd0 2023-05-15T16:39:38.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3bf59e640 1 --2- 172.21.15.161:0/1147282491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3c00b8fd0 0x7fa3c0147d40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800cdf0 tx=0x7fa3b800a710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:38.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3a77fe640 1 -- 172.21.15.161:0/1147282491 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b800d840 con 0x7fa3c00b8fd0 2023-05-15T16:39:38.315 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3a77fe640 1 -- 172.21.15.161:0/1147282491 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3b800d9a0 con 0x7fa3c00b8fd0 2023-05-15T16:39:38.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.306+0000 7fa3a77fe640 1 -- 172.21.15.161:0/1147282491 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3b800dd90 con 0x7fa3c00b8fd0 2023-05-15T16:39:38.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.310+0000 7fa3c506a640 1 -- 172.21.15.161:0/1147282491 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c00ba300 con 0x7fa3c00b8fd0 2023-05-15T16:39:38.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.310+0000 7fa3c506a640 1 -- 172.21.15.161:0/1147282491 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c00ba020 con 0x7fa3c00b8fd0 2023-05-15T16:39:38.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.310+0000 7fa3a77fe640 1 -- 172.21.15.161:0/1147282491 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fa3b801f740 con 0x7fa3c00b8fd0 2023-05-15T16:39:38.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.310+0000 7fa3a77fe640 1 -- 172.21.15.161:0/1147282491 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7fa3b8015ae0 con 0x7fa3c00b8fd0 2023-05-15T16:39:38.316 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.310+0000 7fa3c506a640 1 -- 172.21.15.161:0/1147282491 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c00b94d0 con 0x7fa3c00b8fd0 2023-05-15T16:39:38.317 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.310+0000 7fa3a77fe640 1 -- 172.21.15.161:0/1147282491 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fa3b801a070 con 0x7fa3c00b8fd0 2023-05-15T16:39:38.342 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:38.338+0000 7fb4eacce180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-15T16:39:38.343 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:38.332+0000 7f5cf6c57180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-05-15T16:39:38.384 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.382+0000 7fa3c506a640 1 -- 172.21.15.161:0/1147282491 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ba2e6df7-2918-486c-b4fa-b9e30c852085", "id": 4} v 0) v1 -- 0x7fa3c004dbe0 con 0x7fa3c00b8fd0 2023-05-15T16:39:38.394 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.390+0000 7fa3a77fe640 1 -- 172.21.15.161:0/1147282491 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ba2e6df7-2918-486c-b4fa-b9e30c852085", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fa3b8015cf0 con 0x7fa3c00b8fd0 2023-05-15T16:39:38.395 INFO:teuthology.orchestra.run.smithi161.stdout:4 2023-05-15T16:39:38.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.394+0000 7fa3c506a640 1 -- 172.21.15.161:0/1147282491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3c00b8fd0 msgr2=0x7fa3c0147d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:38.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.394+0000 7fa3c506a640 1 --2- 172.21.15.161:0/1147282491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3c00b8fd0 0x7fa3c0147d40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa3b800cdf0 tx=0x7fa3b800a710 comp rx=0 tx=0).stop 2023-05-15T16:39:38.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.394+0000 7fa3c506a640 1 -- 172.21.15.161:0/1147282491 shutdown_connections 2023-05-15T16:39:38.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.394+0000 7fa3c506a640 1 --2- 172.21.15.161:0/1147282491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa3c00b8fd0 0x7fa3c0147d40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.394+0000 7fa3c506a640 1 --2- 172.21.15.161:0/1147282491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa3c00b7f70 0x7fa3c01dc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.396 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.394+0000 7fa3c506a640 1 --2- 172.21.15.161:0/1147282491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa3c00b7ba0 0x7fa3c0142760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.397 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.394+0000 7fa3c506a640 1 -- 172.21.15.161:0/1147282491 >> 172.21.15.161:0/1147282491 conn(0x7fa3c00bdde0 msgr2=0x7fa3c00bd110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:38.397 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.394+0000 7fa3c506a640 1 -- 172.21.15.161:0/1147282491 shutdown_connections 2023-05-15T16:39:38.398 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.394+0000 7fa3c506a640 1 -- 172.21.15.161:0/1147282491 wait complete. 2023-05-15T16:39:38.399 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:38.388+0000 7f5cf6c57180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-15T16:39:38.399 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:38.394+0000 7fb4eacce180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-05-15T16:39:38.411 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 7e242cff-26b2-49d7-bd7b-5bc1f775eda6 5 2023-05-15T16:39:38.451 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:38.446+0000 7fb4eacce180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-15T16:39:38.452 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:38.444+0000 7f5cf6c57180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-05-15T16:39:38.526 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.522+0000 7f49dd7fe640 1 Processor -- start 2023-05-15T16:39:38.527 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.522+0000 7f49dd7fe640 1 -- start start 2023-05-15T16:39:38.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.522+0000 7f49dd7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49d806aa20 0x7f49d80b8390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:38.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.522+0000 7f49dd7fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f49d806ec20 0x7f49d806f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:38.528 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.522+0000 7f49dd7fe640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49d80b88d0 con 0x7f49d80b9bf0 2023-05-15T16:39:38.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.522+0000 7f49dd7fe640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49d8070b00 con 0x7f49d806ec20 2023-05-15T16:39:38.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.522+0000 7f49dd7fe640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8147a80 con 0x7f49d806aa20 2023-05-15T16:39:38.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.522+0000 7f49d6ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49d806aa20 0x7f49d80b8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:38.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.526+0000 7f49d6ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49d806aa20 0x7f49d80b8390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.161:59506/0 (socket says 172.21.15.161:59506) 2023-05-15T16:39:38.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.526+0000 7f49d6ffd640 1 -- 172.21.15.161:0/801003414 learned_addr learned my addr 172.21.15.161:0/801003414 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-05-15T16:39:38.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.526+0000 7f49d77fe640 1 --2- 172.21.15.161:0/801003414 >> v2:172.21.15.161:3300/0 conn(0x7f49d806ec20 0x7f49d806f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:38.529 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.526+0000 7f49d6ffd640 1 -- 172.21.15.161:0/801003414 >> v2:172.21.15.161:3300/0 conn(0x7f49d806ec20 msgr2=0x7f49d806f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:38.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.526+0000 7f49d6ffd640 1 --2- 172.21.15.161:0/801003414 >> v2:172.21.15.161:3300/0 conn(0x7f49d806ec20 0x7f49d806f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.526+0000 7f49d6ffd640 1 -- 172.21.15.161:0/801003414 >> v1:172.21.15.161:6789/0 conn(0x7f49d80b9bf0 legacy=0x7f49d8140a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:38.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.526+0000 7f49d6ffd640 1 -- 172.21.15.161:0/801003414 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d8146cc0 con 0x7f49d806aa20 2023-05-15T16:39:38.530 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.526+0000 7f49d77fe640 1 --2- 172.21.15.161:0/801003414 >> v2:172.21.15.161:3300/0 conn(0x7f49d806ec20 0x7f49d806f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-15T16:39:38.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.526+0000 7f49d6ffd640 1 --2- 172.21.15.161:0/801003414 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49d806aa20 0x7f49d80b8390 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f49c800b920 tx=0x7f49c801c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bba4210a3a5cba33 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:38.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.526+0000 7f49d5ffb640 1 -- 172.21.15.161:0/801003414 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c80a5970 con 0x7f49d806aa20 2023-05-15T16:39:38.531 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.526+0000 7f49d5ffb640 1 -- 172.21.15.161:0/801003414 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c80a5ad0 con 0x7f49d806aa20 2023-05-15T16:39:38.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.526+0000 7f49d5ffb640 1 -- 172.21.15.161:0/801003414 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c80a5e60 con 0x7f49d806aa20 2023-05-15T16:39:38.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.526+0000 7f49dd7fe640 1 -- 172.21.15.161:0/801003414 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49d806aa20 msgr2=0x7f49d80b8390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:38.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.526+0000 7f49dd7fe640 1 --2- 172.21.15.161:0/801003414 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49d806aa20 0x7f49d80b8390 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f49c800b920 tx=0x7f49c801c9b0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.526+0000 7f49dd7fe640 1 -- 172.21.15.161:0/801003414 shutdown_connections 2023-05-15T16:39:38.532 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.526+0000 7f49dd7fe640 1 --2- 172.21.15.161:0/801003414 >> v2:172.21.15.161:3300/0 conn(0x7f49d806ec20 0x7f49d806f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.526+0000 7f49dd7fe640 1 --2- 172.21.15.161:0/801003414 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49d806aa20 0x7f49d80b8390 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.526+0000 7f49dd7fe640 1 -- 172.21.15.161:0/801003414 >> 172.21.15.161:0/801003414 conn(0x7f49d80bd0b0 msgr2=0x7f49d80b8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:38.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.526+0000 7f49dd7fe640 1 -- 172.21.15.161:0/801003414 shutdown_connections 2023-05-15T16:39:38.533 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.526+0000 7f49dd7fe640 1 -- 172.21.15.161:0/801003414 wait complete. 2023-05-15T16:39:38.533 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:38.530+0000 7fb4eacce180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-15T16:39:38.536 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:38.524+0000 7f5cf6c57180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-05-15T16:39:38.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49dd7fe640 1 Processor -- start 2023-05-15T16:39:38.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49dd7fe640 1 -- start start 2023-05-15T16:39:38.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49dd7fe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49d806aa20 0x7f49d8138670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:38.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49dd7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49d806ec20 0x7f49d8141900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:38.537 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49dd7fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49d81e0960 0x7f49d813a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:38.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49dd7fe640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d8138bb0 con 0x7f49d806ec20 2023-05-15T16:39:38.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49dd7fe640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d81414d0 con 0x7f49d806aa20 2023-05-15T16:39:38.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49dd7fe640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49d813c0d0 con 0x7f49d81e0960 2023-05-15T16:39:38.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49d6ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49d806aa20 0x7f49d8138670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:38.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49d6ffd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49d806aa20 0x7f49d8138670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37274/0 (socket says 172.21.15.161:37274) 2023-05-15T16:39:38.538 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49d6ffd640 1 -- 172.21.15.161:0/3665375980 learned_addr learned my addr 172.21.15.161:0/3665375980 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-05-15T16:39:38.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49d77fe640 1 --2- 172.21.15.161:0/3665375980 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49d81e0960 0x7f49d813a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:38.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49d67fc640 1 --2- 172.21.15.161:0/3665375980 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49d806ec20 0x7f49d8141900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:38.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49d6ffd640 1 -- 172.21.15.161:0/3665375980 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49d81e0960 msgr2=0x7f49d813a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:38.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49d6ffd640 1 --2- 172.21.15.161:0/3665375980 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49d81e0960 0x7f49d813a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49d6ffd640 1 -- 172.21.15.161:0/3665375980 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49d806ec20 msgr2=0x7f49d8141900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:38.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49d6ffd640 1 --2- 172.21.15.161:0/3665375980 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49d806ec20 0x7f49d8141900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.539 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49d6ffd640 1 -- 172.21.15.161:0/3665375980 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d000bbd0 con 0x7f49d806aa20 2023-05-15T16:39:38.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49d77fe640 1 --2- 172.21.15.161:0/3665375980 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49d81e0960 0x7f49d813a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-15T16:39:38.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49d67fc640 1 --2- 172.21.15.161:0/3665375980 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49d806ec20 0x7f49d8141900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:39:38.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49d6ffd640 1 --2- 172.21.15.161:0/3665375980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49d806aa20 0x7f49d8138670 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f49c800b2c0 tx=0x7f49c8019750 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:38.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49bf7fe640 1 -- 172.21.15.161:0/3665375980 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c80b8670 con 0x7f49d806aa20 2023-05-15T16:39:38.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49dd7fe640 1 -- 172.21.15.161:0/3665375980 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c800b580 con 0x7f49d806aa20 2023-05-15T16:39:38.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49dd7fe640 1 -- 172.21.15.161:0/3665375980 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d806adf0 con 0x7f49d806aa20 2023-05-15T16:39:38.540 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49bf7fe640 1 -- 172.21.15.161:0/3665375980 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c80b87d0 con 0x7f49d806aa20 2023-05-15T16:39:38.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49bf7fe640 1 -- 172.21.15.161:0/3665375980 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c80b8b40 con 0x7f49d806aa20 2023-05-15T16:39:38.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49bf7fe640 1 -- 172.21.15.161:0/3665375980 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f49c80b4070 con 0x7f49d806aa20 2023-05-15T16:39:38.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49bf7fe640 1 -- 172.21.15.161:0/3665375980 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7f49c80b8d60 con 0x7f49d806aa20 2023-05-15T16:39:38.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.530+0000 7f49dd7fe640 1 -- 172.21.15.161:0/3665375980 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49b8005260 con 0x7f49d806aa20 2023-05-15T16:39:38.541 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.534+0000 7f49bf7fe640 1 -- 172.21.15.161:0/3665375980 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f49c80b2070 con 0x7f49d806aa20 2023-05-15T16:39:38.586 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:38.582+0000 7fb4eacce180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-15T16:39:38.587 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:38.580+0000 7f5cf6c57180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-05-15T16:39:38.606 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.602+0000 7f49dd7fe640 1 -- 172.21.15.161:0/3665375980 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7e242cff-26b2-49d7-bd7b-5bc1f775eda6", "id": 5} v 0) v1 -- 0x7f49b8005880 con 0x7f49d806aa20 2023-05-15T16:39:38.615 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.614+0000 7f49bf7fe640 1 -- 172.21.15.161:0/3665375980 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7e242cff-26b2-49d7-bd7b-5bc1f775eda6", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f49c80c2920 con 0x7f49d806aa20 2023-05-15T16:39:38.616 INFO:teuthology.orchestra.run.smithi161.stdout:5 2023-05-15T16:39:38.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.614+0000 7f49dd7fe640 1 -- 172.21.15.161:0/3665375980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49d806aa20 msgr2=0x7f49d8138670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:38.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.614+0000 7f49dd7fe640 1 --2- 172.21.15.161:0/3665375980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49d806aa20 0x7f49d8138670 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f49c800b2c0 tx=0x7f49c8019750 comp rx=0 tx=0).stop 2023-05-15T16:39:38.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.614+0000 7f49dd7fe640 1 -- 172.21.15.161:0/3665375980 shutdown_connections 2023-05-15T16:39:38.617 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.614+0000 7f49dd7fe640 1 --2- 172.21.15.161:0/3665375980 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f49d81e0960 0x7f49d813a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.614+0000 7f49dd7fe640 1 --2- 172.21.15.161:0/3665375980 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f49d806ec20 0x7f49d8141900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.614+0000 7f49dd7fe640 1 --2- 172.21.15.161:0/3665375980 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f49d806aa20 0x7f49d8138670 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.614+0000 7f49dd7fe640 1 -- 172.21.15.161:0/3665375980 >> 172.21.15.161:0/3665375980 conn(0x7f49d80bd0b0 msgr2=0x7f49d813e020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:38.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.614+0000 7f49dd7fe640 1 -- 172.21.15.161:0/3665375980 shutdown_connections 2023-05-15T16:39:38.618 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.614+0000 7f49dd7fe640 1 -- 172.21.15.161:0/3665375980 wait complete. 2023-05-15T16:39:38.632 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 1ed9dcc8-4515-4e93-84ae-cc2452f9f82a 6 2023-05-15T16:39:38.667 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:38.662+0000 7fb4eacce180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-15T16:39:38.668 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:38.660+0000 7f5cf6c57180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-05-15T16:39:38.720 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:38.718+0000 7fb4eacce180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-15T16:39:38.722 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:38.716+0000 7f5cf6c57180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-05-15T16:39:38.782 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.778+0000 7fce76958640 1 Processor -- start 2023-05-15T16:39:38.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.778+0000 7fce76958640 1 -- start start 2023-05-15T16:39:38.783 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.778+0000 7fce76958640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fce700b89c0 0x7fce700b8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:38.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.782+0000 7fce76958640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce700bd7e0 0x7fce70143c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:38.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.782+0000 7fce76958640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce7006c910 con 0x7fce70149cb0 2023-05-15T16:39:38.784 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.782+0000 7fce76958640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce700b92d0 con 0x7fce700b89c0 2023-05-15T16:39:38.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.782+0000 7fce76958640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce7006c630 con 0x7fce700bd7e0 2023-05-15T16:39:38.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.782+0000 7fce6ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fce700b89c0 0x7fce700b8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:38.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.782+0000 7fce74ef5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce700bd7e0 0x7fce70143c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:38.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.782+0000 7fce6ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fce700b89c0 0x7fce700b8d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37280/0 (socket says 172.21.15.161:37280) 2023-05-15T16:39:38.785 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.782+0000 7fce6ffff640 1 -- 172.21.15.161:0/2701831516 learned_addr learned my addr 172.21.15.161:0/2701831516 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-05-15T16:39:38.786 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.782+0000 7fce6ffff640 1 -- 172.21.15.161:0/2701831516 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce700bd7e0 msgr2=0x7fce70143c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:38.787 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.782+0000 7fce6ffff640 1 --2- 172.21.15.161:0/2701831516 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce700bd7e0 0x7fce70143c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.782+0000 7fce6ffff640 1 -- 172.21.15.161:0/2701831516 >> v1:172.21.15.161:6789/0 conn(0x7fce70149cb0 legacy=0x7fce7014db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:38.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.782+0000 7fce6ffff640 1 -- 172.21.15.161:0/2701831516 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce7014d390 con 0x7fce700b89c0 2023-05-15T16:39:38.788 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.782+0000 7fce74ef5640 1 --2- 172.21.15.161:0/2701831516 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce700bd7e0 0x7fce70143c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-15T16:39:38.789 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.782+0000 7fce6ffff640 1 --2- 172.21.15.161:0/2701831516 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce700b89c0 0x7fce700b8d90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fce68009e50 tx=0x7fce6801c950 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d130e9abffb9f6c9 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:38.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce6effd640 1 -- 172.21.15.161:0/2701831516 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce680a5830 con 0x7fce700b89c0 2023-05-15T16:39:38.793 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce6effd640 1 -- 172.21.15.161:0/2701831516 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce680a5990 con 0x7fce700b89c0 2023-05-15T16:39:38.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce6effd640 1 -- 172.21.15.161:0/2701831516 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce680a5d20 con 0x7fce700b89c0 2023-05-15T16:39:38.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce76958640 1 -- 172.21.15.161:0/2701831516 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce700b89c0 msgr2=0x7fce700b8d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:38.794 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce76958640 1 --2- 172.21.15.161:0/2701831516 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce700b89c0 0x7fce700b8d90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fce68009e50 tx=0x7fce6801c950 comp rx=0 tx=0).stop 2023-05-15T16:39:38.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce76958640 1 -- 172.21.15.161:0/2701831516 shutdown_connections 2023-05-15T16:39:38.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce76958640 1 --2- 172.21.15.161:0/2701831516 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce700bd7e0 0x7fce70143c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce76958640 1 --2- 172.21.15.161:0/2701831516 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce700b89c0 0x7fce700b8d90 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce76958640 1 -- 172.21.15.161:0/2701831516 >> 172.21.15.161:0/2701831516 conn(0x7fce700bdde0 msgr2=0x7fce700be1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:38.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce76958640 1 -- 172.21.15.161:0/2701831516 shutdown_connections 2023-05-15T16:39:38.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce76958640 1 -- 172.21.15.161:0/2701831516 wait complete. 2023-05-15T16:39:38.795 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce76958640 1 Processor -- start 2023-05-15T16:39:38.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce76958640 1 -- start start 2023-05-15T16:39:38.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce76958640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce700b89c0 0x7fce70143990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:38.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce76958640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce700bd7e0 0x7fce70146e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:38.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce76958640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce70149cb0 0x7fce70142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:38.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce76958640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce70143ed0 con 0x7fce700bd7e0 2023-05-15T16:39:38.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce76958640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce701e26f0 con 0x7fce700b89c0 2023-05-15T16:39:38.796 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce76958640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce700b7b10 con 0x7fce70149cb0 2023-05-15T16:39:38.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce6ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce700b89c0 0x7fce70143990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:38.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce74ef5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce70149cb0 0x7fce70142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:38.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce6ffff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce700b89c0 0x7fce70143990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37284/0 (socket says 172.21.15.161:37284) 2023-05-15T16:39:38.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.786+0000 7fce6ffff640 1 -- 172.21.15.161:0/4073903421 learned_addr learned my addr 172.21.15.161:0/4073903421 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-05-15T16:39:38.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.790+0000 7fce6f7fe640 1 --2- 172.21.15.161:0/4073903421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce700bd7e0 0x7fce70146e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:38.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.790+0000 7fce6ffff640 1 -- 172.21.15.161:0/4073903421 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce70149cb0 msgr2=0x7fce70142810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:38.797 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.790+0000 7fce6ffff640 1 --2- 172.21.15.161:0/4073903421 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce70149cb0 0x7fce70142810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.790+0000 7fce6ffff640 1 -- 172.21.15.161:0/4073903421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce700bd7e0 msgr2=0x7fce70146e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:38.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.790+0000 7fce6ffff640 1 --2- 172.21.15.161:0/4073903421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce700bd7e0 0x7fce70146e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.790+0000 7fce6ffff640 1 -- 172.21.15.161:0/4073903421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce60009420 con 0x7fce700b89c0 2023-05-15T16:39:38.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.790+0000 7fce74ef5640 1 --2- 172.21.15.161:0/4073903421 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce70149cb0 0x7fce70142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-15T16:39:38.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.790+0000 7fce6ffff640 1 --2- 172.21.15.161:0/4073903421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce700b89c0 0x7fce70143990 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fce6801a580 tx=0x7fce680196f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:38.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.790+0000 7fce6cff9640 1 -- 172.21.15.161:0/4073903421 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce680b8670 con 0x7fce700b89c0 2023-05-15T16:39:38.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.790+0000 7fce6cff9640 1 -- 172.21.15.161:0/4073903421 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce680b87d0 con 0x7fce700b89c0 2023-05-15T16:39:38.798 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.790+0000 7fce76958640 1 -- 172.21.15.161:0/4073903421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce68009b30 con 0x7fce700b89c0 2023-05-15T16:39:38.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.790+0000 7fce6cff9640 1 -- 172.21.15.161:0/4073903421 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce680b8b80 con 0x7fce700b89c0 2023-05-15T16:39:38.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.790+0000 7fce76958640 1 -- 172.21.15.161:0/4073903421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce70156fa0 con 0x7fce700b89c0 2023-05-15T16:39:38.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.790+0000 7fce6cff9640 1 -- 172.21.15.161:0/4073903421 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fce680c1400 con 0x7fce700b89c0 2023-05-15T16:39:38.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.790+0000 7fce6cff9640 1 -- 172.21.15.161:0/4073903421 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fce680b6a30 con 0x7fce700b89c0 2023-05-15T16:39:38.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.790+0000 7fce76958640 1 -- 172.21.15.161:0/4073903421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce70156e10 con 0x7fce700b89c0 2023-05-15T16:39:38.799 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.790+0000 7fce6cff9640 1 -- 172.21.15.161:0/4073903421 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7fce680bc020 con 0x7fce700b89c0 2023-05-15T16:39:38.862 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.858+0000 7fce76958640 1 -- 172.21.15.161:0/4073903421 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1ed9dcc8-4515-4e93-84ae-cc2452f9f82a", "id": 6} v 0) v1 -- 0x7fce70157130 con 0x7fce700b89c0 2023-05-15T16:39:38.863 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:38.858+0000 7fb4eacce180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-15T16:39:38.868 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:38.860+0000 7f5cf6c57180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-05-15T16:39:38.871 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.870+0000 7fce6cff9640 1 -- 172.21.15.161:0/4073903421 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1ed9dcc8-4515-4e93-84ae-cc2452f9f82a", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fce680b6da0 con 0x7fce700b89c0 2023-05-15T16:39:38.872 INFO:teuthology.orchestra.run.smithi161.stdout:6 2023-05-15T16:39:38.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.870+0000 7fce76958640 1 -- 172.21.15.161:0/4073903421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce700b89c0 msgr2=0x7fce70143990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:38.873 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.870+0000 7fce76958640 1 --2- 172.21.15.161:0/4073903421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce700b89c0 0x7fce70143990 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fce6801a580 tx=0x7fce680196f0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.870+0000 7fce76958640 1 -- 172.21.15.161:0/4073903421 shutdown_connections 2023-05-15T16:39:38.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.870+0000 7fce76958640 1 --2- 172.21.15.161:0/4073903421 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fce70149cb0 0x7fce70142810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.870+0000 7fce76958640 1 --2- 172.21.15.161:0/4073903421 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fce700bd7e0 0x7fce70146e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.870+0000 7fce76958640 1 --2- 172.21.15.161:0/4073903421 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fce700b89c0 0x7fce70143990 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:38.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.870+0000 7fce76958640 1 -- 172.21.15.161:0/4073903421 >> 172.21.15.161:0/4073903421 conn(0x7fce700bdde0 msgr2=0x7fce700b94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:38.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.870+0000 7fce76958640 1 -- 172.21.15.161:0/4073903421 shutdown_connections 2023-05-15T16:39:38.874 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.870+0000 7fce76958640 1 -- 172.21.15.161:0/4073903421 wait complete. 2023-05-15T16:39:38.893 DEBUG:teuthology.orchestra.run.smithi161:> sudo ceph --cluster ceph osd new 46d2baee-113b-4165-bda7-8aeb67c7fd44 7 2023-05-15T16:39:38.931 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:38.924+0000 7f5cf6c57180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-15T16:39:38.935 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:38.930+0000 7fb4eacce180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-05-15T16:39:39.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.998+0000 7f4c9c976640 1 Processor -- start 2023-05-15T16:39:39.002 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.998+0000 7f4c9c976640 1 -- start start 2023-05-15T16:39:39.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.998+0000 7f4c9c976640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4c980b75f0 0x7f4c980b7a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:39.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.998+0000 7f4c9c976640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4c981417d0 0x7f4c98141c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:39.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.998+0000 7f4c9c976640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c981480f0 con 0x7f4c98071910 2023-05-15T16:39:39.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.998+0000 7f4c9c976640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c980b45c0 con 0x7f4c980b75f0 2023-05-15T16:39:39.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.998+0000 7f4c9c976640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c98142150 con 0x7f4c981417d0 2023-05-15T16:39:39.003 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.998+0000 7f4c9659c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f4c98071910 0x7f4c981479e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.161:35236/0 (socket says 172.21.15.161:35236) 2023-05-15T16:39:39.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.998+0000 7f4c96d9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4c981417d0 0x7f4c98141c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:39.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.998+0000 7f4c9659c640 1 -- 172.21.15.161:0/3682764234 learned_addr learned my addr 172.21.15.161:0/3682764234 (peer_addr_for_me v1:172.21.15.161:0/0) 2023-05-15T16:39:39.004 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.998+0000 7f4c8dd9b640 1 --2- 172.21.15.161:0/3682764234 >> v2:172.21.15.62:3300/0 conn(0x7f4c980b75f0 0x7f4c980b7a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:39.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:38.998+0000 7f4c95d9b640 1 -- 172.21.15.161:0/3682764234 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834279867 0 0) 0x7f4c981480f0 con 0x7f4c98071910 2023-05-15T16:39:39.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.002+0000 7f4c95d9b640 1 -- 172.21.15.161:0/3682764234 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c84003530 con 0x7f4c98071910 2023-05-15T16:39:39.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.002+0000 7f4c96d9d640 1 -- 172.21.15.161:0/3682764234 >> v2:172.21.15.62:3300/0 conn(0x7f4c980b75f0 msgr2=0x7f4c980b7a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:39.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.002+0000 7f4c96d9d640 1 --2- 172.21.15.161:0/3682764234 >> v2:172.21.15.62:3300/0 conn(0x7f4c980b75f0 0x7f4c980b7a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:39.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.002+0000 7f4c96d9d640 1 -- 172.21.15.161:0/3682764234 >> v1:172.21.15.161:6789/0 conn(0x7f4c98071910 legacy=0x7f4c981479e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:39.005 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.002+0000 7f4c96d9d640 1 -- 172.21.15.161:0/3682764234 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c9814afb0 con 0x7f4c981417d0 2023-05-15T16:39:39.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.002+0000 7f4c96d9d640 1 --2- 172.21.15.161:0/3682764234 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4c981417d0 0x7f4c98141c10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009d90 tx=0x7f4c9001c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b117f73a7473ee4 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:39.006 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.002+0000 7f4c95d9b640 1 -- 172.21.15.161:0/3682764234 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c900a59e0 con 0x7f4c981417d0 2023-05-15T16:39:39.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.002+0000 7f4c95d9b640 1 -- 172.21.15.161:0/3682764234 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c900a5b40 con 0x7f4c981417d0 2023-05-15T16:39:39.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.002+0000 7f4c95d9b640 1 -- 172.21.15.161:0/3682764234 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c900ad440 con 0x7f4c981417d0 2023-05-15T16:39:39.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.002+0000 7f4c9c976640 1 -- 172.21.15.161:0/3682764234 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4c981417d0 msgr2=0x7f4c98141c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:39.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.002+0000 7f4c9c976640 1 --2- 172.21.15.161:0/3682764234 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4c981417d0 0x7f4c98141c10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f4c90009d90 tx=0x7f4c9001c920 comp rx=0 tx=0).stop 2023-05-15T16:39:39.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.002+0000 7f4c9c976640 1 -- 172.21.15.161:0/3682764234 shutdown_connections 2023-05-15T16:39:39.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.002+0000 7f4c9c976640 1 --2- 172.21.15.161:0/3682764234 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4c981417d0 0x7f4c98141c10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:39.007 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.002+0000 7f4c9c976640 1 --2- 172.21.15.161:0/3682764234 >> v2:172.21.15.62:3300/0 conn(0x7f4c980b75f0 0x7f4c980b7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:39.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.002+0000 7f4c9c976640 1 -- 172.21.15.161:0/3682764234 >> 172.21.15.161:0/3682764234 conn(0x7f4c9806a8c0 msgr2=0x7f4c9806acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:39.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.002+0000 7f4c9c976640 1 -- 172.21.15.161:0/3682764234 shutdown_connections 2023-05-15T16:39:39.008 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.002+0000 7f4c9c976640 1 -- 172.21.15.161:0/3682764234 wait complete. 2023-05-15T16:39:39.009 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c9c976640 1 Processor -- start 2023-05-15T16:39:39.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c9c976640 1 -- start start 2023-05-15T16:39:39.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c9c976640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4c98071910 0x7f4c98140bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:39.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c9c976640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c980b75f0 0x7f4c9812b920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:39.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c9c976640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c981417d0 0x7f4c98134600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:39.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c9c976640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9813f550 con 0x7f4c980b75f0 2023-05-15T16:39:39.010 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c9c976640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9814a0a0 con 0x7f4c981417d0 2023-05-15T16:39:39.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c9c976640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9814a940 con 0x7f4c98071910 2023-05-15T16:39:39.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c96d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c981417d0 0x7f4c98134600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:39.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c9659c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4c98071910 0x7f4c98140bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:39.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c96d9d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c981417d0 0x7f4c98134600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.161:37292/0 (socket says 172.21.15.161:37292) 2023-05-15T16:39:39.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c96d9d640 1 -- 172.21.15.161:0/556526534 learned_addr learned my addr 172.21.15.161:0/556526534 (peer_addr_for_me v2:172.21.15.161:0/0) 2023-05-15T16:39:39.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c8dd9b640 1 --2- 172.21.15.161:0/556526534 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c980b75f0 0x7f4c9812b920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:39.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c96d9d640 1 -- 172.21.15.161:0/556526534 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4c98071910 msgr2=0x7f4c98140bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:39.011 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c96d9d640 1 --2- 172.21.15.161:0/556526534 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4c98071910 0x7f4c98140bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:39.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c96d9d640 1 -- 172.21.15.161:0/556526534 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c980b75f0 msgr2=0x7f4c9812b920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:39.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c96d9d640 1 --2- 172.21.15.161:0/556526534 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c980b75f0 0x7f4c9812b920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:39.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c96d9d640 1 -- 172.21.15.161:0/556526534 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c90009a70 con 0x7f4c981417d0 2023-05-15T16:39:39.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c8dd9b640 1 --2- 172.21.15.161:0/556526534 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c980b75f0 0x7f4c9812b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-15T16:39:39.012 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c96d9d640 1 --2- 172.21.15.161:0/556526534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c981417d0 0x7f4c98134600 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4c900b0040 tx=0x7f4c900196c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:39.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c8f7fe640 1 -- 172.21.15.161:0/556526534 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c900add90 con 0x7f4c981417d0 2023-05-15T16:39:39.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c8f7fe640 1 -- 172.21.15.161:0/556526534 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c90009450 con 0x7f4c981417d0 2023-05-15T16:39:39.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c8f7fe640 1 -- 172.21.15.161:0/556526534 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c900b9690 con 0x7f4c981417d0 2023-05-15T16:39:39.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c9c976640 1 -- 172.21.15.161:0/556526534 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c98071ce0 con 0x7f4c981417d0 2023-05-15T16:39:39.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c9c976640 1 -- 172.21.15.161:0/556526534 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c9814b8c0 con 0x7f4c981417d0 2023-05-15T16:39:39.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c8f7fe640 1 -- 172.21.15.161:0/556526534 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4c900b9af0 con 0x7f4c981417d0 2023-05-15T16:39:39.013 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c8f7fe640 1 -- 172.21.15.161:0/556526534 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7f4c900b7400 con 0x7f4c981417d0 2023-05-15T16:39:39.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.006+0000 7f4c9c976640 1 -- 172.21.15.161:0/556526534 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9814bd70 con 0x7f4c981417d0 2023-05-15T16:39:39.014 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.010+0000 7f4c8f7fe640 1 -- 172.21.15.161:0/556526534 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f4c900b2070 con 0x7f4c981417d0 2023-05-15T16:39:39.096 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.094+0000 7f4c9c976640 1 -- 172.21.15.161:0/556526534 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd new", "uuid": "46d2baee-113b-4165-bda7-8aeb67c7fd44", "id": 7} v 0) v1 -- 0x7f4c98141160 con 0x7f4c981417d0 2023-05-15T16:39:39.106 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.102+0000 7f4c8f7fe640 1 -- 172.21.15.161:0/556526534 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "46d2baee-113b-4165-bda7-8aeb67c7fd44", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4c900c4460 con 0x7f4c981417d0 2023-05-15T16:39:39.107 INFO:teuthology.orchestra.run.smithi161.stdout:7 2023-05-15T16:39:39.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.106+0000 7f4c9c976640 1 -- 172.21.15.161:0/556526534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c981417d0 msgr2=0x7f4c98134600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:39.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.106+0000 7f4c9c976640 1 --2- 172.21.15.161:0/556526534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c981417d0 0x7f4c98134600 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4c900b0040 tx=0x7f4c900196c0 comp rx=0 tx=0).stop 2023-05-15T16:39:39.108 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.106+0000 7f4c9c976640 1 -- 172.21.15.161:0/556526534 shutdown_connections 2023-05-15T16:39:39.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.106+0000 7f4c9c976640 1 --2- 172.21.15.161:0/556526534 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4c981417d0 0x7f4c98134600 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:39.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.106+0000 7f4c9c976640 1 --2- 172.21.15.161:0/556526534 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4c980b75f0 0x7f4c9812b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:39.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.106+0000 7f4c9c976640 1 --2- 172.21.15.161:0/556526534 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4c98071910 0x7f4c98140bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:39.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.106+0000 7f4c9c976640 1 -- 172.21.15.161:0/556526534 >> 172.21.15.161:0/556526534 conn(0x7f4c9806a8c0 msgr2=0x7f4c980b87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:39.109 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.106+0000 7f4c9c976640 1 -- 172.21.15.161:0/556526534 shutdown_connections 2023-05-15T16:39:39.110 INFO:teuthology.orchestra.run.smithi161.stderr:2023-05-15T16:39:39.106+0000 7f4c9c976640 1 -- 172.21.15.161:0/556526534 wait complete. 2023-05-15T16:39:39.122 INFO:tasks.ceph.osd.0:Restarting daemon 2023-05-15T16:39:39.122 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-05-15T16:39:39.125 INFO:tasks.ceph.osd.0:Started 2023-05-15T16:39:39.126 INFO:tasks.ceph.osd.1:Restarting daemon 2023-05-15T16:39:39.126 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-05-15T16:39:39.128 INFO:tasks.ceph.osd.1:Started 2023-05-15T16:39:39.128 INFO:tasks.ceph.osd.2:Restarting daemon 2023-05-15T16:39:39.129 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-05-15T16:39:39.131 INFO:tasks.ceph.osd.2:Started 2023-05-15T16:39:39.131 INFO:tasks.ceph.osd.3:Restarting daemon 2023-05-15T16:39:39.132 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-05-15T16:39:39.134 INFO:tasks.ceph.osd.3:Started 2023-05-15T16:39:39.135 INFO:tasks.ceph.osd.4:Restarting daemon 2023-05-15T16:39:39.135 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-05-15T16:39:39.164 INFO:tasks.ceph.osd.4:Started 2023-05-15T16:39:39.165 INFO:tasks.ceph.osd.5:Restarting daemon 2023-05-15T16:39:39.165 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-05-15T16:39:39.167 INFO:tasks.ceph.osd.5:Started 2023-05-15T16:39:39.167 INFO:tasks.ceph.osd.6:Restarting daemon 2023-05-15T16:39:39.167 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-05-15T16:39:39.169 INFO:tasks.ceph.osd.6:Started 2023-05-15T16:39:39.169 INFO:tasks.ceph.osd.7:Restarting daemon 2023-05-15T16:39:39.170 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-05-15T16:39:39.171 INFO:tasks.ceph.osd.7:Started 2023-05-15T16:39:39.172 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-15T16:39:39.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.332+0000 7f428c320640 1 Processor -- start 2023-05-15T16:39:39.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.332+0000 7f428c320640 1 -- start start 2023-05-15T16:39:39.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.332+0000 7f428c320640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42840b2f80 0x7f4284070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:39.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.332+0000 7f428c320640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4284147e80 con 0x7f42840b2bb0 2023-05-15T16:39:39.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.332+0000 7f428c320640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42840b76c0 con 0x7f42840b71a0 2023-05-15T16:39:39.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.332+0000 7f428c320640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42840b4750 con 0x7f42840b2f80 2023-05-15T16:39:39.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.332+0000 7f42898bb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42840b2f80 0x7f4284070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:39.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.332+0000 7f428a0bc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f42840b2bb0 0x7f42840b8530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:53722/0 (socket says 172.21.15.62:53722) 2023-05-15T16:39:39.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.332+0000 7f428a0bc640 1 -- 172.21.15.62:0/611041562 learned_addr learned my addr 172.21.15.62:0/611041562 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:39:39.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.332+0000 7f42898bb640 1 -- 172.21.15.62:0/611041562 >> v1:172.21.15.161:6789/0 conn(0x7f42840b71a0 legacy=0x7f4284148340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:39.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.332+0000 7f42898bb640 1 -- 172.21.15.62:0/611041562 >> v1:172.21.15.62:6789/0 conn(0x7f42840b2bb0 legacy=0x7f42840b8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:39.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.332+0000 7f42898bb640 1 -- 172.21.15.62:0/611041562 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42840b79a0 con 0x7f42840b2f80 2023-05-15T16:39:39.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.332+0000 7f42890ba640 1 -- 172.21.15.62:0/611041562 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3292871351 0 0) 0x7f4284147e80 con 0x7f42840b2bb0 2023-05-15T16:39:39.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f42898bb640 1 --2- 172.21.15.62:0/611041562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42840b2f80 0x7f4284070e70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f42740097c0 tx=0x7f427401ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d761dc2dd5f89cb7 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:39.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f42890ba640 1 -- 172.21.15.62:0/611041562 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42740a8930 con 0x7f42840b2f80 2023-05-15T16:39:39.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f42890ba640 1 -- 172.21.15.62:0/611041562 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42740a8a90 con 0x7f42840b2f80 2023-05-15T16:39:39.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f42890ba640 1 -- 172.21.15.62:0/611041562 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42740a8e20 con 0x7f42840b2f80 2023-05-15T16:39:39.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f428c320640 1 -- 172.21.15.62:0/611041562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42840b2f80 msgr2=0x7f4284070e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:39.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f428c320640 1 --2- 172.21.15.62:0/611041562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42840b2f80 0x7f4284070e70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f42740097c0 tx=0x7f427401ec30 comp rx=0 tx=0).stop 2023-05-15T16:39:39.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f428c320640 1 -- 172.21.15.62:0/611041562 shutdown_connections 2023-05-15T16:39:39.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f428c320640 1 --2- 172.21.15.62:0/611041562 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42840b2f80 0x7f4284070e70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:39.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f428c320640 1 -- 172.21.15.62:0/611041562 >> 172.21.15.62:0/611041562 conn(0x7f42840bc350 msgr2=0x7f42840bc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:39.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f428c320640 1 -- 172.21.15.62:0/611041562 shutdown_connections 2023-05-15T16:39:39.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f428c320640 1 -- 172.21.15.62:0/611041562 wait complete. 2023-05-15T16:39:39.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f428c320640 1 Processor -- start 2023-05-15T16:39:39.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f428c320640 1 -- start start 2023-05-15T16:39:39.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f428c320640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42840b2bb0 0x7f428413fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:39.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f428c320640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42840b2f80 0x7f428413e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:39.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f428c320640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42840b71a0 0x7f428413eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:39.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f428c320640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42841402a0 con 0x7f42840b2bb0 2023-05-15T16:39:39.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f428c320640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428413f5e0 con 0x7f42840b2f80 2023-05-15T16:39:39.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f428c320640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428413e3e0 con 0x7f42840b71a0 2023-05-15T16:39:39.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f428a0bc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42840b2bb0 0x7f428413fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:39.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f428a0bc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42840b2bb0 0x7f428413fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49876/0 (socket says 172.21.15.62:49876) 2023-05-15T16:39:39.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f428a0bc640 1 -- 172.21.15.62:0/1709256202 learned_addr learned my addr 172.21.15.62:0/1709256202 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:39.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f42898bb640 1 --2- 172.21.15.62:0/1709256202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42840b2f80 0x7f428413e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:39.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.336+0000 7f428a8bd640 1 --2- 172.21.15.62:0/1709256202 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42840b71a0 0x7f428413eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:39.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.340+0000 7f428a0bc640 1 -- 172.21.15.62:0/1709256202 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42840b71a0 msgr2=0x7f428413eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:39.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.340+0000 7f428a0bc640 1 --2- 172.21.15.62:0/1709256202 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42840b71a0 0x7f428413eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:39.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.340+0000 7f428a0bc640 1 -- 172.21.15.62:0/1709256202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42840b2f80 msgr2=0x7f428413e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:39.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.340+0000 7f428a0bc640 1 --2- 172.21.15.62:0/1709256202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42840b2f80 0x7f428413e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:39.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.340+0000 7f428a0bc640 1 -- 172.21.15.62:0/1709256202 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4274009420 con 0x7f42840b2bb0 2023-05-15T16:39:39.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.340+0000 7f428a8bd640 1 --2- 172.21.15.62:0/1709256202 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42840b71a0 0x7f428413eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-15T16:39:39.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.340+0000 7f42898bb640 1 --2- 172.21.15.62:0/1709256202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42840b2f80 0x7f428413e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-15T16:39:39.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.340+0000 7f428a0bc640 1 --2- 172.21.15.62:0/1709256202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42840b2bb0 0x7f428413fd60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f428000c480 tx=0x7f428000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:39.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.340+0000 7f427affd640 1 -- 172.21.15.62:0/1709256202 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42800074e0 con 0x7f42840b2bb0 2023-05-15T16:39:39.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.340+0000 7f427affd640 1 -- 172.21.15.62:0/1709256202 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4280007660 con 0x7f42840b2bb0 2023-05-15T16:39:39.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.340+0000 7f427affd640 1 -- 172.21.15.62:0/1709256202 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280004a30 con 0x7f42840b2bb0 2023-05-15T16:39:39.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.340+0000 7f428c320640 1 -- 172.21.15.62:0/1709256202 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42840713b0 con 0x7f42840b2bb0 2023-05-15T16:39:39.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.340+0000 7f428c320640 1 -- 172.21.15.62:0/1709256202 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42840b7c80 con 0x7f42840b2bb0 2023-05-15T16:39:39.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.340+0000 7f427affd640 1 -- 172.21.15.62:0/1709256202 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f4280012400 con 0x7f42840b2bb0 2023-05-15T16:39:39.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.340+0000 7f427affd640 1 -- 172.21.15.62:0/1709256202 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f4280012d80 con 0x7f42840b2bb0 2023-05-15T16:39:39.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.340+0000 7f428c320640 1 -- 172.21.15.62:0/1709256202 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4284071540 con 0x7f42840b2bb0 2023-05-15T16:39:39.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.352+0000 7f427affd640 1 -- 172.21.15.62:0/1709256202 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f4280018070 con 0x7f42840b2bb0 2023-05-15T16:39:39.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.408+0000 7f428c320640 1 -- 172.21.15.62:0/1709256202 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f428413f340 con 0x7f42840b2bb0 2023-05-15T16:39:39.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.408+0000 7f427affd640 1 -- 172.21.15.62:0/1709256202 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f4280012780 con 0x7f42840b2bb0 2023-05-15T16:39:39.416 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:39:39.417 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":10,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:39:39.096112+0000","last_up_change":"0.000000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:39:39.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.408+0000 7f428c320640 1 -- 172.21.15.62:0/1709256202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42840b2bb0 msgr2=0x7f428413fd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:39.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.408+0000 7f428c320640 1 --2- 172.21.15.62:0/1709256202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42840b2bb0 0x7f428413fd60 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f428000c480 tx=0x7f428000c940 comp rx=0 tx=0).stop 2023-05-15T16:39:39.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.408+0000 7f428c320640 1 -- 172.21.15.62:0/1709256202 shutdown_connections 2023-05-15T16:39:39.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.408+0000 7f428c320640 1 --2- 172.21.15.62:0/1709256202 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42840b71a0 0x7f428413eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:39.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.408+0000 7f428c320640 1 --2- 172.21.15.62:0/1709256202 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42840b2f80 0x7f428413e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:39.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.408+0000 7f428c320640 1 --2- 172.21.15.62:0/1709256202 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42840b2bb0 0x7f428413fd60 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:39.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.412+0000 7f428c320640 1 -- 172.21.15.62:0/1709256202 >> 172.21.15.62:0/1709256202 conn(0x7f42840bc350 msgr2=0x7f42840b8070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:39.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.412+0000 7f428c320640 1 -- 172.21.15.62:0/1709256202 shutdown_connections 2023-05-15T16:39:39.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:39.412+0000 7f428c320640 1 -- 172.21.15.62:0/1709256202 wait complete. 2023-05-15T16:39:39.433 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-05-15T16:39:39.433 INFO:tasks.ceph:Waiting for OSDs to come up 2023-05-15T16:39:39.565 INFO:tasks.ceph.mgr.y.smithi062.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-05-15T16:39:39.565 INFO:tasks.ceph.mgr.y.smithi062.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-05-15T16:39:39.565 INFO:tasks.ceph.mgr.y.smithi062.stderr: from numpy import show_config as show_numpy_config 2023-05-15T16:39:39.580 INFO:tasks.ceph.mgr.x.smithi161.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2023-05-15T16:39:39.581 INFO:tasks.ceph.mgr.x.smithi161.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2023-05-15T16:39:39.581 INFO:tasks.ceph.mgr.x.smithi161.stderr: from numpy import show_config as show_numpy_config 2023-05-15T16:39:39.605 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:39.596+0000 7f5cf6c57180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-15T16:39:39.618 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:39.614+0000 7fb4eacce180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-05-15T16:39:39.731 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:39.724+0000 7f5cf6c57180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-15T16:39:39.739 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:39.734+0000 7fb4eacce180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-05-15T16:39:39.743 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-05-15T16:39:39.736+0000 7f9f08a4d640 -1 Falling back to public interface 2023-05-15T16:39:39.744 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-05-15T16:39:39.736+0000 7f41f554d640 -1 Falling back to public interface 2023-05-15T16:39:39.744 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-05-15T16:39:39.736+0000 7fa2014b3640 -1 Falling back to public interface 2023-05-15T16:39:39.756 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-05-15T16:39:39.748+0000 7fef1080e640 -1 Falling back to public interface 2023-05-15T16:39:39.776 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-05-15T16:39:39.774+0000 7fc5de583640 -1 Falling back to public interface 2023-05-15T16:39:39.808 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-05-15T16:39:39.806+0000 7f5f33613640 -1 Falling back to public interface 2023-05-15T16:39:39.809 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-05-15T16:39:39.806+0000 7f9cc09f4640 -1 Falling back to public interface 2023-05-15T16:39:39.809 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-05-15T16:39:39.806+0000 7f501d322640 -1 Falling back to public interface 2023-05-15T16:39:39.884 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:39.876+0000 7f5cf6c57180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-15T16:39:39.893 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:39.890+0000 7fb4eacce180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-05-15T16:39:39.950 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:39.944+0000 7f5cf6c57180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-15T16:39:39.956 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:39.954+0000 7fb4eacce180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-05-15T16:39:40.078 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:40.072+0000 7f5cf6c57180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-15T16:39:40.079 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:40.074+0000 7fb4eacce180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-05-15T16:39:40.239 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-15T16:39:40.355 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.344+0000 7f22df782640 1 Processor -- start 2023-05-15T16:39:40.356 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.344+0000 7f22df782640 1 -- start start 2023-05-15T16:39:40.356 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.348+0000 7f22df782640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d8069a10 0x7f22d814d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:40.356 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.348+0000 7f22df782640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f22d806f430 0x7f22d814d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:40.356 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.348+0000 7f22df782640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d8071ad0 con 0x7f22d8070c10 2023-05-15T16:39:40.356 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.348+0000 7f22df782640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22d8071f50 con 0x7f22d806f430 2023-05-15T16:39:40.356 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.348+0000 7f22df782640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d80711a0 con 0x7f22d8069a10 2023-05-15T16:39:40.357 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.348+0000 7f22dd51e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d8069a10 0x7f22d814d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:40.357 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.348+0000 7f22dcd1d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f22d806f430 0x7f22d814d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:40.357 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.348+0000 7f22ddd1f640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f22d8070c10 0x7f22d8143860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.62:45540/0 (socket says 172.21.15.62:45540) 2023-05-15T16:39:40.357 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.348+0000 7f22ddd1f640 1 -- 172.21.15.62:0/3404632524 learned_addr learned my addr 172.21.15.62:0/3404632524 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:39:40.357 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.348+0000 7f22dd51e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d8069a10 0x7f22d814d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.62:37166/0 (socket says 172.21.15.62:37166) 2023-05-15T16:39:40.357 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.348+0000 7f22cffff640 1 -- 172.21.15.62:0/3404632524 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 7680437 0 0) 0x7f22d8071ad0 con 0x7f22d8070c10 2023-05-15T16:39:40.358 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.348+0000 7f22cffff640 1 -- 172.21.15.62:0/3404632524 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22c4003530 con 0x7f22d8070c10 2023-05-15T16:39:40.358 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.348+0000 7f22dcd1d640 1 -- 172.21.15.62:0/3404632524 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d8069a10 msgr2=0x7f22d814d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:40.358 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.348+0000 7f22dcd1d640 1 --2- 172.21.15.62:0/3404632524 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d8069a10 0x7f22d814d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:40.358 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.348+0000 7f22dcd1d640 1 -- 172.21.15.62:0/3404632524 >> v1:172.21.15.161:6789/0 conn(0x7f22d8070c10 legacy=0x7f22d8143860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:40.358 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.348+0000 7f22dcd1d640 1 -- 172.21.15.62:0/3404632524 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d8071480 con 0x7f22d806f430 2023-05-15T16:39:40.358 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.348+0000 7f22dd51e640 1 --2- 172.21.15.62:0/3404632524 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d8069a10 0x7f22d814d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-15T16:39:40.361 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.348+0000 7f22dcd1d640 1 --2- 172.21.15.62:0/3404632524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22d806f430 0x7f22d814d7c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f22d40097c0 tx=0x7f22d401ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a319311d096c3aa server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:40.361 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.348+0000 7f22cffff640 1 -- 172.21.15.62:0/3404632524 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40a8970 con 0x7f22d806f430 2023-05-15T16:39:40.361 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22cffff640 1 -- 172.21.15.62:0/3404632524 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22d40a8ad0 con 0x7f22d806f430 2023-05-15T16:39:40.362 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22cffff640 1 -- 172.21.15.62:0/3404632524 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22d40a8e40 con 0x7f22d806f430 2023-05-15T16:39:40.362 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22df782640 1 -- 172.21.15.62:0/3404632524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22d806f430 msgr2=0x7f22d814d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:40.362 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22df782640 1 --2- 172.21.15.62:0/3404632524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22d806f430 0x7f22d814d7c0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f22d40097c0 tx=0x7f22d401ec70 comp rx=0 tx=0).stop 2023-05-15T16:39:40.362 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22df782640 1 -- 172.21.15.62:0/3404632524 shutdown_connections 2023-05-15T16:39:40.362 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22df782640 1 --2- 172.21.15.62:0/3404632524 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22d806f430 0x7f22d814d7c0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:40.362 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22df782640 1 --2- 172.21.15.62:0/3404632524 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d8069a10 0x7f22d814d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:40.362 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22df782640 1 -- 172.21.15.62:0/3404632524 >> 172.21.15.62:0/3404632524 conn(0x7f22d80bcbc0 msgr2=0x7f22d80bcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:40.363 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22df782640 1 -- 172.21.15.62:0/3404632524 shutdown_connections 2023-05-15T16:39:40.363 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22df782640 1 -- 172.21.15.62:0/3404632524 wait complete. 2023-05-15T16:39:40.363 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22df782640 1 Processor -- start 2023-05-15T16:39:40.363 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22df782640 1 -- start start 2023-05-15T16:39:40.363 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22df782640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22d8069a10 0x7f22d814b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:40.363 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22df782640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d806f430 0x7f22d81df6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:40.363 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22df782640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22d8070c10 0x7f22d81dfbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:40.364 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22df782640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d8137a70 con 0x7f22d8069a10 2023-05-15T16:39:40.364 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22df782640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d81380e0 con 0x7f22d8070c10 2023-05-15T16:39:40.364 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22df782640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d81df1c0 con 0x7f22d806f430 2023-05-15T16:39:40.364 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22dd51e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22d8069a10 0x7f22d814b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:40.364 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22dd51e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22d8069a10 0x7f22d814b230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49892/0 (socket says 172.21.15.62:49892) 2023-05-15T16:39:40.364 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22dd51e640 1 -- 172.21.15.62:0/3472049866 learned_addr learned my addr 172.21.15.62:0/3472049866 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:40.365 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22ddd1f640 1 --2- 172.21.15.62:0/3472049866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22d8070c10 0x7f22d81dfbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:40.365 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22dcd1d640 1 --2- 172.21.15.62:0/3472049866 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d806f430 0x7f22d81df6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:40.365 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22dd51e640 1 -- 172.21.15.62:0/3472049866 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d806f430 msgr2=0x7f22d81df6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:40.365 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22dd51e640 1 --2- 172.21.15.62:0/3472049866 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d806f430 0x7f22d81df6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:40.365 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22dd51e640 1 -- 172.21.15.62:0/3472049866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22d8070c10 msgr2=0x7f22d81dfbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:40.365 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22dd51e640 1 --2- 172.21.15.62:0/3472049866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22d8070c10 0x7f22d81dfbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:40.365 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22dd51e640 1 -- 172.21.15.62:0/3472049866 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c8009420 con 0x7f22d8069a10 2023-05-15T16:39:40.366 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22dd51e640 1 --2- 172.21.15.62:0/3472049866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22d8069a10 0x7f22d814b230 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f22c800ec10 tx=0x7f22c800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:40.366 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22cdffb640 1 -- 172.21.15.62:0/3472049866 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c800cc30 con 0x7f22d8069a10 2023-05-15T16:39:40.366 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22cdffb640 1 -- 172.21.15.62:0/3472049866 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c800cd90 con 0x7f22d8069a10 2023-05-15T16:39:40.366 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22cdffb640 1 -- 172.21.15.62:0/3472049866 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8013690 con 0x7f22d8069a10 2023-05-15T16:39:40.366 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22df782640 1 -- 172.21.15.62:0/3472049866 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d4009420 con 0x7f22d8069a10 2023-05-15T16:39:40.366 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22df782640 1 -- 172.21.15.62:0/3472049866 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d8069de0 con 0x7f22d8069a10 2023-05-15T16:39:40.366 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22cdffb640 1 -- 172.21.15.62:0/3472049866 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f22c8005ca0 con 0x7f22d8069a10 2023-05-15T16:39:40.367 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.352+0000 7f22cdffb640 1 -- 172.21.15.62:0/3472049866 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f22c80066f0 con 0x7f22d8069a10 2023-05-15T16:39:40.367 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.356+0000 7f22df782640 1 -- 172.21.15.62:0/3472049866 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d8071760 con 0x7f22d8069a10 2023-05-15T16:39:40.367 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.356+0000 7f22cdffb640 1 -- 172.21.15.62:0/3472049866 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72422 (secure 0 0 0) 0x7f22c8021060 con 0x7f22d8069a10 2023-05-15T16:39:40.421 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.412+0000 7f22df782640 1 -- 172.21.15.62:0/3472049866 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f22d80b8c20 con 0x7f22d8069a10 2023-05-15T16:39:40.422 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.416+0000 7f22cdffb640 1 -- 172.21.15.62:0/3472049866 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f22c8017070 con 0x7f22d8069a10 2023-05-15T16:39:40.422 INFO:teuthology.misc.health.smithi062.stdout: 2023-05-15T16:39:40.422 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":10,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:39:39.096112+0000","last_up_change":"0.000000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:39:40.423 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.416+0000 7f22df782640 1 -- 172.21.15.62:0/3472049866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22d8069a10 msgr2=0x7f22d814b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:40.423 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.416+0000 7f22df782640 1 --2- 172.21.15.62:0/3472049866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22d8069a10 0x7f22d814b230 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f22c800ec10 tx=0x7f22c800c520 comp rx=0 tx=0).stop 2023-05-15T16:39:40.423 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.416+0000 7f22df782640 1 -- 172.21.15.62:0/3472049866 shutdown_connections 2023-05-15T16:39:40.424 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.416+0000 7f22df782640 1 --2- 172.21.15.62:0/3472049866 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22d8070c10 0x7f22d81dfbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:40.424 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.416+0000 7f22df782640 1 --2- 172.21.15.62:0/3472049866 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d806f430 0x7f22d81df6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:40.424 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.416+0000 7f22df782640 1 --2- 172.21.15.62:0/3472049866 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22d8069a10 0x7f22d814b230 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:40.424 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.416+0000 7f22df782640 1 -- 172.21.15.62:0/3472049866 >> 172.21.15.62:0/3472049866 conn(0x7f22d80bcbc0 msgr2=0x7f22d814d280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:40.424 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.416+0000 7f22df782640 1 -- 172.21.15.62:0/3472049866 shutdown_connections 2023-05-15T16:39:40.424 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:40.416+0000 7f22df782640 1 -- 172.21.15.62:0/3472049866 wait complete. 2023-05-15T16:39:40.437 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-05-15T16:39:40.662 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:40.658+0000 7fb4eacce180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-15T16:39:40.690 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:40.684+0000 7f5cf6c57180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-05-15T16:39:40.738 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:40.734+0000 7fb4eacce180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-15T16:39:40.769 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:40.760+0000 7f5cf6c57180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-05-15T16:39:40.907 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:40.902+0000 7fb4eacce180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-15T16:39:40.947 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:40.940+0000 7f5cf6c57180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-05-15T16:39:40.980 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:40.978+0000 7fb4eacce180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-15T16:39:41.025 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:41.016+0000 7f5cf6c57180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-05-15T16:39:41.224 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:41.222+0000 7fb4eacce180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-15T16:39:41.281 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:41.272+0000 7f5cf6c57180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-05-15T16:39:41.282 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:41.278+0000 7fb4eacce180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-15T16:39:41.345 INFO:tasks.ceph.mgr.y.smithi062.stderr:2023-05-15T16:39:41.336+0000 7f5cf6c57180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-05-15T16:39:42.328 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:42.326+0000 7fb492694640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-05-15T16:39:42.329 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-15T16:39:42.326+0000 7fb492694640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-05-15T16:39:43.570 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-05-15T16:39:43.564+0000 7f9f08a4d640 -1 osd.3 0 log_to_monitors true 2023-05-15T16:39:43.571 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-05-15T16:39:43.566+0000 7fc5de583640 -1 osd.4 0 log_to_monitors true 2023-05-15T16:39:43.613 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-05-15T16:39:43.604+0000 7fef1080e640 -1 osd.0 0 log_to_monitors true 2023-05-15T16:39:43.634 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-05-15T16:39:43.628+0000 7f41f554d640 -1 osd.1 0 log_to_monitors true 2023-05-15T16:39:43.657 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-05-15T16:39:43.648+0000 7fa2014b3640 -1 osd.2 0 log_to_monitors true 2023-05-15T16:39:43.682 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-05-15T16:39:43.678+0000 7f5f33613640 -1 osd.5 0 log_to_monitors true 2023-05-15T16:39:43.707 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-05-15T16:39:43.702+0000 7f501d322640 -1 osd.6 0 log_to_monitors true 2023-05-15T16:39:43.746 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-05-15T16:39:43.742+0000 7f9cc09f4640 -1 osd.7 0 log_to_monitors true 2023-05-15T16:39:47.245 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-15T16:39:47.423 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.416+0000 7f4b16e21640 1 Processor -- start 2023-05-15T16:39:47.425 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.416+0000 7f4b16e21640 1 -- start start 2023-05-15T16:39:47.426 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.416+0000 7f4b16e21640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4b1006aa20 0x7f4b1006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:47.427 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.416+0000 7f4b16e21640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1006f4f0 0x7f4b101403a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:47.427 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.416+0000 7f4b16e21640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b100af720 con 0x7f4b100b9aa0 2023-05-15T16:39:47.427 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.416+0000 7f4b16e21640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b1006f950 con 0x7f4b1006aa20 2023-05-15T16:39:47.427 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.416+0000 7f4b16e21640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b100afc50 con 0x7f4b1006f4f0 2023-05-15T16:39:47.427 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.416+0000 7f4b14bbd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4b1006aa20 0x7f4b1006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:47.427 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.416+0000 7f4b14bbd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f4b1006aa20 0x7f4b1006efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.62:38420/0 (socket says 172.21.15.62:38420) 2023-05-15T16:39:47.427 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.416+0000 7f4b0ffff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f4b100b9aa0 0x7f4b1013fc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.62:55708/0 (socket says 172.21.15.62:55708) 2023-05-15T16:39:47.428 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.416+0000 7f4b14bbd640 1 -- 172.21.15.62:0/2894006098 learned_addr learned my addr 172.21.15.62:0/2894006098 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:47.428 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.416+0000 7f4b153be640 1 --2- 172.21.15.62:0/2894006098 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1006f4f0 0x7f4b101403a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:47.428 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.416+0000 7f4b14bbd640 1 -- 172.21.15.62:0/2894006098 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1006f4f0 msgr2=0x7f4b101403a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:47.428 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.416+0000 7f4b0f7fe640 1 -- 172.21.15.62:0/2894006098 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3947984383 0 0) 0x7f4b100af720 con 0x7f4b100b9aa0 2023-05-15T16:39:47.428 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.416+0000 7f4b14bbd640 1 --2- 172.21.15.62:0/2894006098 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1006f4f0 0x7f4b101403a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:47.428 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.416+0000 7f4b14bbd640 1 -- 172.21.15.62:0/2894006098 >> v1:172.21.15.161:6789/0 conn(0x7f4b100b9aa0 legacy=0x7f4b1013fc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:47.428 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.416+0000 7f4b14bbd640 1 -- 172.21.15.62:0/2894006098 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b100af970 con 0x7f4b1006aa20 2023-05-15T16:39:47.429 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.420+0000 7f4b153be640 1 --2- 172.21.15.62:0/2894006098 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1006f4f0 0x7f4b101403a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-15T16:39:47.429 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.420+0000 7f4b14bbd640 1 --2- 172.21.15.62:0/2894006098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b1006aa20 0x7f4b1006efb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4b00009870 tx=0x7f4b0001ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe6fd41dc5e281cc server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:47.430 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.420+0000 7f4b0f7fe640 1 -- 172.21.15.62:0/2894006098 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b000a8a50 con 0x7f4b1006aa20 2023-05-15T16:39:47.430 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.420+0000 7f4b0f7fe640 1 -- 172.21.15.62:0/2894006098 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b000a8bb0 con 0x7f4b1006aa20 2023-05-15T16:39:47.430 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.420+0000 7f4b0f7fe640 1 -- 172.21.15.62:0/2894006098 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b000b0440 con 0x7f4b1006aa20 2023-05-15T16:39:47.430 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.424+0000 7f4b16e21640 1 -- 172.21.15.62:0/2894006098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b1006aa20 msgr2=0x7f4b1006efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:47.431 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.424+0000 7f4b16e21640 1 --2- 172.21.15.62:0/2894006098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b1006aa20 0x7f4b1006efb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4b00009870 tx=0x7f4b0001ed70 comp rx=0 tx=0).stop 2023-05-15T16:39:47.431 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.424+0000 7f4b16e21640 1 -- 172.21.15.62:0/2894006098 shutdown_connections 2023-05-15T16:39:47.431 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.424+0000 7f4b16e21640 1 --2- 172.21.15.62:0/2894006098 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1006f4f0 0x7f4b101403a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:47.431 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.424+0000 7f4b16e21640 1 --2- 172.21.15.62:0/2894006098 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b1006aa20 0x7f4b1006efb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:47.431 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.424+0000 7f4b16e21640 1 -- 172.21.15.62:0/2894006098 >> 172.21.15.62:0/2894006098 conn(0x7f4b100bcff0 msgr2=0x7f4b100b8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:47.431 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.424+0000 7f4b16e21640 1 -- 172.21.15.62:0/2894006098 shutdown_connections 2023-05-15T16:39:47.432 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.424+0000 7f4b16e21640 1 -- 172.21.15.62:0/2894006098 wait complete. 2023-05-15T16:39:47.433 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.424+0000 7f4b16e21640 1 Processor -- start 2023-05-15T16:39:47.435 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.424+0000 7f4b16e21640 1 -- start start 2023-05-15T16:39:47.436 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b16e21640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1006aa20 0x7f4b10140a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:47.436 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b16e21640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b1006f4f0 0x7f4b1012dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:47.436 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b16e21640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b100b9aa0 0x7f4b101454d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:47.436 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b16e21640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1012cfa0 con 0x7f4b1006f4f0 2023-05-15T16:39:47.436 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b16e21640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b1012c730 con 0x7f4b100b9aa0 2023-05-15T16:39:47.437 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b16e21640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b101444d0 con 0x7f4b1006aa20 2023-05-15T16:39:47.437 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b0ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b1006f4f0 0x7f4b1012dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:47.437 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b0ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b1006f4f0 0x7f4b1012dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42760/0 (socket says 172.21.15.62:42760) 2023-05-15T16:39:47.437 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b0ffff640 1 -- 172.21.15.62:0/3966112268 learned_addr learned my addr 172.21.15.62:0/3966112268 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:47.437 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b153be640 1 --2- 172.21.15.62:0/3966112268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b100b9aa0 0x7f4b101454d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:47.437 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b14bbd640 1 --2- 172.21.15.62:0/3966112268 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1006aa20 0x7f4b10140a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:47.437 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b0ffff640 1 -- 172.21.15.62:0/3966112268 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1006aa20 msgr2=0x7f4b10140a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:47.438 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b0ffff640 1 --2- 172.21.15.62:0/3966112268 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1006aa20 0x7f4b10140a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:47.438 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b0ffff640 1 -- 172.21.15.62:0/3966112268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b100b9aa0 msgr2=0x7f4b101454d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:47.438 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b0ffff640 1 --2- 172.21.15.62:0/3966112268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b100b9aa0 0x7f4b101454d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:47.438 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b0ffff640 1 -- 172.21.15.62:0/3966112268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b04009420 con 0x7f4b1006f4f0 2023-05-15T16:39:47.438 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b0ffff640 1 --2- 172.21.15.62:0/3966112268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b1006f4f0 0x7f4b1012dad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800c840 tx=0x7f4b0800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:47.438 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b0d7fa640 1 -- 172.21.15.62:0/3966112268 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0800ce90 con 0x7f4b1006f4f0 2023-05-15T16:39:47.439 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b0d7fa640 1 -- 172.21.15.62:0/3966112268 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0800a640 con 0x7f4b1006f4f0 2023-05-15T16:39:47.439 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b0d7fa640 1 -- 172.21.15.62:0/3966112268 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0800a9f0 con 0x7f4b1006f4f0 2023-05-15T16:39:47.440 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b16e21640 1 -- 172.21.15.62:0/3966112268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b000094d0 con 0x7f4b1006f4f0 2023-05-15T16:39:47.440 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4b16e21640 1 -- 172.21.15.62:0/3966112268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b10071440 con 0x7f4b1006f4f0 2023-05-15T16:39:47.440 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.428+0000 7f4af6ffd640 1 -- 172.21.15.62:0/3966112268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b10071160 con 0x7f4b1006f4f0 2023-05-15T16:39:47.440 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.432+0000 7f4b0d7fa640 1 -- 172.21.15.62:0/3966112268 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 4) v1 ==== 84174+0+0 (secure 0 0 0) 0x7f4b0800ab50 con 0x7f4b1006f4f0 2023-05-15T16:39:47.440 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.432+0000 7f4b0d7fa640 1 --2- 172.21.15.62:0/3966112268 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4afc065320 0x7f4afc0677d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:47.440 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.432+0000 7f4b0d7fa640 1 -- 172.21.15.62:0/3966112268 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f4b08080b00 con 0x7f4b1006f4f0 2023-05-15T16:39:47.441 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.432+0000 7f4b14bbd640 1 --2- 172.21.15.62:0/3966112268 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4afc065320 0x7f4afc0677d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:47.441 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.432+0000 7f4b14bbd640 1 --2- 172.21.15.62:0/3966112268 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4afc065320 0x7f4afc0677d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4b000b2000 tx=0x7f4b000aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:47.447 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.440+0000 7f4b0d7fa640 1 -- 172.21.15.62:0/3966112268 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f4b0804f830 con 0x7f4b1006f4f0 2023-05-15T16:39:47.558 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-05-15T16:39:47.548+0000 7fa1fcc35640 -1 osd.2 0 waiting for initial osdmap 2023-05-15T16:39:47.593 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-05-15T16:39:47.590+0000 7f9cbc176640 -1 osd.7 0 waiting for initial osdmap 2023-05-15T16:39:47.597 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-05-15T16:39:47.592+0000 7fa1f527a640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-15T16:39:47.624 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-05-15T16:39:47.622+0000 7f9cb47bb640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-15T16:39:47.646 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-05-15T16:39:47.642+0000 7f5f2ed95640 -1 osd.5 0 waiting for initial osdmap 2023-05-15T16:39:47.659 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-05-15T16:39:47.654+0000 7f5018aa4640 -1 osd.6 0 waiting for initial osdmap 2023-05-15T16:39:47.676 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-05-15T16:39:47.674+0000 7f5f273da640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-15T16:39:47.684 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-05-15T16:39:47.678+0000 7fc5d9d05640 -1 osd.4 0 waiting for initial osdmap 2023-05-15T16:39:47.699 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-05-15T16:39:47.698+0000 7f50110e9640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-15T16:39:47.715 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-05-15T16:39:47.714+0000 7fc5d234a640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-15T16:39:47.731 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.724+0000 7f4af6ffd640 1 -- 172.21.15.62:0/3966112268 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b1006e920 con 0x7f4b1006f4f0 2023-05-15T16:39:47.732 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.724+0000 7f4b0d7fa640 1 -- 172.21.15.62:0/3966112268 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f4b08018020 con 0x7f4b1006f4f0 2023-05-15T16:39:47.732 INFO:teuthology.misc.health.smithi062.stdout: 2023-05-15T16:39:47.732 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":12,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:39:45.326054+0000","last_up_change":"0.000000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:39:47.734 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.728+0000 7f4af6ffd640 1 -- 172.21.15.62:0/3966112268 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4afc065320 msgr2=0x7f4afc0677d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:47.735 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.728+0000 7f4af6ffd640 1 --2- 172.21.15.62:0/3966112268 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4afc065320 0x7f4afc0677d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4b000b2000 tx=0x7f4b000aa070 comp rx=0 tx=0).stop 2023-05-15T16:39:47.735 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.728+0000 7f4af6ffd640 1 -- 172.21.15.62:0/3966112268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b1006f4f0 msgr2=0x7f4b1012dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:47.735 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.728+0000 7f4af6ffd640 1 --2- 172.21.15.62:0/3966112268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b1006f4f0 0x7f4b1012dad0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f4b0800c840 tx=0x7f4b0800cc40 comp rx=0 tx=0).stop 2023-05-15T16:39:47.735 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.728+0000 7f4af6ffd640 1 -- 172.21.15.62:0/3966112268 shutdown_connections 2023-05-15T16:39:47.735 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.728+0000 7f4af6ffd640 1 --2- 172.21.15.62:0/3966112268 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4b100b9aa0 0x7f4b101454d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:47.735 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.728+0000 7f4af6ffd640 1 --2- 172.21.15.62:0/3966112268 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4afc065320 0x7f4afc0677d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:47.736 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.728+0000 7f4af6ffd640 1 --2- 172.21.15.62:0/3966112268 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4b1006f4f0 0x7f4b1012dad0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:47.736 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.728+0000 7f4af6ffd640 1 --2- 172.21.15.62:0/3966112268 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4b1006aa20 0x7f4b10140a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:47.736 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.728+0000 7f4af6ffd640 1 -- 172.21.15.62:0/3966112268 >> 172.21.15.62:0/3966112268 conn(0x7f4b100bcff0 msgr2=0x7f4b1013fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:47.736 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.728+0000 7f4af6ffd640 1 -- 172.21.15.62:0/3966112268 shutdown_connections 2023-05-15T16:39:47.736 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:47.728+0000 7f4af6ffd640 1 -- 172.21.15.62:0/3966112268 wait complete. 2023-05-15T16:39:47.755 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-05-15T16:39:47.806 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-05-15T16:39:47.800+0000 7f9f041cf640 -1 osd.3 0 waiting for initial osdmap 2023-05-15T16:39:47.807 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-05-15T16:39:47.800+0000 7f41f0ccf640 -1 osd.1 0 waiting for initial osdmap 2023-05-15T16:39:47.821 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-05-15T16:39:47.812+0000 7fef0bf90640 -1 osd.0 0 waiting for initial osdmap 2023-05-15T16:39:47.825 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-05-15T16:39:47.820+0000 7f41e9314640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-15T16:39:47.826 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-05-15T16:39:47.820+0000 7f9efc814640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-15T16:39:47.858 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-05-15T16:39:47.852+0000 7fef045d5640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-05-15T16:39:54.563 DEBUG:teuthology.orchestra.run.smithi062:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-05-15T16:39:54.689 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.680+0000 7f78fe5da640 1 Processor -- start 2023-05-15T16:39:54.689 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.680+0000 7f78fe5da640 1 -- start start 2023-05-15T16:39:54.690 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.684+0000 7f78fe5da640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78f8141c10 0x7f78f80b78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:54.690 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.684+0000 7f78fe5da640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f78f806e390 0x7f78f80b5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:54.690 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.684+0000 7f78fe5da640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f78f8147970 0x7f78f8147db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:54.690 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.684+0000 7f78fe5da640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f806f140 con 0x7f78f8147970 2023-05-15T16:39:54.691 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.684+0000 7f78fe5da640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78f80b7e00 con 0x7f78f806e390 2023-05-15T16:39:54.691 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.684+0000 7f78fe5da640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f80b6b40 con 0x7f78f8141c10 2023-05-15T16:39:54.691 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.684+0000 7f78fcb77640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f78f8147970 0x7f78f8147db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:54.691 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.684+0000 7f78fcb77640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f78f8147970 0x7f78f8147db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42776/0 (socket says 172.21.15.62:42776) 2023-05-15T16:39:54.691 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.684+0000 7f78fcb77640 1 -- 172.21.15.62:0/4024528430 learned_addr learned my addr 172.21.15.62:0/4024528430 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:54.693 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.684+0000 7f78f7fff640 1 --2- 172.21.15.62:0/4024528430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78f8141c10 0x7f78f80b78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:54.693 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.684+0000 7f78effff640 1 --2- 172.21.15.62:0/4024528430 >> v2:172.21.15.161:3300/0 conn(0x7f78f806e390 0x7f78f80b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:54.693 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.684+0000 7f78fcb77640 1 -- 172.21.15.62:0/4024528430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78f8141c10 msgr2=0x7f78f80b78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:54.694 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.684+0000 7f78fcb77640 1 --2- 172.21.15.62:0/4024528430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78f8141c10 0x7f78f80b78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:54.694 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.684+0000 7f78fcb77640 1 -- 172.21.15.62:0/4024528430 >> v2:172.21.15.161:3300/0 conn(0x7f78f806e390 msgr2=0x7f78f80b5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:54.694 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.684+0000 7f78fcb77640 1 --2- 172.21.15.62:0/4024528430 >> v2:172.21.15.161:3300/0 conn(0x7f78f806e390 0x7f78f80b5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:54.696 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.684+0000 7f78fcb77640 1 -- 172.21.15.62:0/4024528430 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f80b6de0 con 0x7f78f8147970 2023-05-15T16:39:54.696 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.684+0000 7f78effff640 1 --2- 172.21.15.62:0/4024528430 >> v2:172.21.15.161:3300/0 conn(0x7f78f806e390 0x7f78f80b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:39:54.696 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.684+0000 7f78fcb77640 1 --2- 172.21.15.62:0/4024528430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78f8147970 0x7f78f8147db0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f78f806a790 tx=0x7f78f001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f4b24bcdf87729 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:54.697 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.684+0000 7f78f77fe640 1 -- 172.21.15.62:0/4024528430 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f00af400 con 0x7f78f8147970 2023-05-15T16:39:54.697 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.684+0000 7f78f77fe640 1 -- 172.21.15.62:0/4024528430 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f00ab050 con 0x7f78f8147970 2023-05-15T16:39:54.697 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.684+0000 7f78f77fe640 1 -- 172.21.15.62:0/4024528430 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f00af780 con 0x7f78f8147970 2023-05-15T16:39:54.702 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fe5da640 1 -- 172.21.15.62:0/4024528430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78f8147970 msgr2=0x7f78f8147db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:54.702 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fe5da640 1 --2- 172.21.15.62:0/4024528430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78f8147970 0x7f78f8147db0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f78f806a790 tx=0x7f78f001f1c0 comp rx=0 tx=0).stop 2023-05-15T16:39:54.703 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fe5da640 1 -- 172.21.15.62:0/4024528430 shutdown_connections 2023-05-15T16:39:54.703 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fe5da640 1 --2- 172.21.15.62:0/4024528430 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78f8147970 0x7f78f8147db0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:54.703 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fe5da640 1 --2- 172.21.15.62:0/4024528430 >> v2:172.21.15.161:3300/0 conn(0x7f78f806e390 0x7f78f80b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:54.703 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fe5da640 1 --2- 172.21.15.62:0/4024528430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78f8141c10 0x7f78f80b78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:54.704 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fe5da640 1 -- 172.21.15.62:0/4024528430 >> 172.21.15.62:0/4024528430 conn(0x7f78f8065960 msgr2=0x7f78f80697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:54.704 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fe5da640 1 -- 172.21.15.62:0/4024528430 shutdown_connections 2023-05-15T16:39:54.704 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fe5da640 1 -- 172.21.15.62:0/4024528430 wait complete. 2023-05-15T16:39:54.704 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fe5da640 1 Processor -- start 2023-05-15T16:39:54.705 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fe5da640 1 -- start start 2023-05-15T16:39:54.705 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fe5da640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78f806e390 0x7f78f80b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:54.705 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fe5da640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78f8141c10 0x7f78f80bb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:54.706 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fe5da640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78f8147970 0x7f78f81df120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:54.707 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fe5da640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f80bba80 con 0x7f78f8147970 2023-05-15T16:39:54.707 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fe5da640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78f80b4c10 con 0x7f78f8141c10 2023-05-15T16:39:54.707 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fe5da640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78f80baad0 con 0x7f78f806e390 2023-05-15T16:39:54.707 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fcb77640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78f8147970 0x7f78f81df120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:54.708 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fcb77640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78f8147970 0x7f78f81df120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42780/0 (socket says 172.21.15.62:42780) 2023-05-15T16:39:54.708 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fcb77640 1 -- 172.21.15.62:0/1597693416 learned_addr learned my addr 172.21.15.62:0/1597693416 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:54.708 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78effff640 1 --2- 172.21.15.62:0/1597693416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78f8141c10 0x7f78f80bb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:54.708 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78f7fff640 1 --2- 172.21.15.62:0/1597693416 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78f806e390 0x7f78f80b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:54.709 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fcb77640 1 -- 172.21.15.62:0/1597693416 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78f806e390 msgr2=0x7f78f80b46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:54.709 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fcb77640 1 --2- 172.21.15.62:0/1597693416 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78f806e390 0x7f78f80b46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:54.710 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fcb77640 1 -- 172.21.15.62:0/1597693416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78f8141c10 msgr2=0x7f78f80bb060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:54.710 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fcb77640 1 --2- 172.21.15.62:0/1597693416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78f8141c10 0x7f78f80bb060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:54.710 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fcb77640 1 -- 172.21.15.62:0/1597693416 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78f0009b30 con 0x7f78f8147970 2023-05-15T16:39:54.711 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78effff640 1 --2- 172.21.15.62:0/1597693416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78f8141c10 0x7f78f80bb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:39:54.711 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fcb77640 1 --2- 172.21.15.62:0/1597693416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78f8147970 0x7f78f81df120 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f78f00b2040 tx=0x7f78f001bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:54.711 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78f57fa640 1 -- 172.21.15.62:0/1597693416 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f00afd60 con 0x7f78f8147970 2023-05-15T16:39:54.712 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78f57fa640 1 -- 172.21.15.62:0/1597693416 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78f0009510 con 0x7f78f8147970 2023-05-15T16:39:54.712 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fe5da640 1 -- 172.21.15.62:0/1597693416 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78f80b73a0 con 0x7f78f8147970 2023-05-15T16:39:54.713 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78f57fa640 1 -- 172.21.15.62:0/1597693416 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78f00ba660 con 0x7f78f8147970 2023-05-15T16:39:54.713 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.688+0000 7f78fe5da640 1 -- 172.21.15.62:0/1597693416 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78f80b70c0 con 0x7f78f8147970 2023-05-15T16:39:54.713 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.692+0000 7f78fe5da640 1 -- 172.21.15.62:0/1597693416 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78f8141fe0 con 0x7f78f8147970 2023-05-15T16:39:54.713 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.692+0000 7f78f57fa640 1 -- 172.21.15.62:0/1597693416 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f78f00b6040 con 0x7f78f8147970 2023-05-15T16:39:54.714 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.692+0000 7f78f57fa640 1 --2- 172.21.15.62:0/1597693416 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f78d8065380 0x7f78d8067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:54.714 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.692+0000 7f78f57fa640 1 -- 172.21.15.62:0/1597693416 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f78f0120590 con 0x7f78f8147970 2023-05-15T16:39:54.714 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.692+0000 7f78f7fff640 1 --2- 172.21.15.62:0/1597693416 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f78d8065380 0x7f78d8067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:54.715 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.692+0000 7f78f7fff640 1 --2- 172.21.15.62:0/1597693416 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f78d8065380 0x7f78d8067830 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f78e000b950 tx=0x7f78e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:54.715 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.696+0000 7f78f57fa640 1 -- 172.21.15.62:0/1597693416 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f78f00ee6c0 con 0x7f78f8147970 2023-05-15T16:39:54.857 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.848+0000 7f78fe5da640 1 -- 172.21.15.62:0/1597693416 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78f806f880 con 0x7f78f8147970 2023-05-15T16:39:54.859 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.852+0000 7f78f57fa640 1 -- 172.21.15.62:0/1597693416 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12382 (secure 0 0 0) 0x7f78f00f1ce0 con 0x7f78f8147970 2023-05-15T16:39:54.859 INFO:teuthology.misc.health.smithi062.stdout: 2023-05-15T16:39:54.859 INFO:teuthology.misc.health.smithi062.stdout:{"epoch":16,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:39:51.630694+0000","last_up_change":"2023-05-15T16:39:48.597049+0000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-15T16:39:49.394028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37594},{"type":"v1","addr":"172.21.15.62:6825","nonce":37594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37594},{"type":"v1","addr":"172.21.15.62:6827","nonce":37594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37594},{"type":"v1","addr":"172.21.15.62:6831","nonce":37594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37594},{"type":"v1","addr":"172.21.15.62:6829","nonce":37594}]},"public_addr":"172.21.15.62:6825/37594","cluster_addr":"172.21.15.62:6827/37594","heartbeat_back_addr":"172.21.15.62:6831/37594","heartbeat_front_addr":"172.21.15.62:6829/37594","state":["exists","up"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37592},{"type":"v1","addr":"172.21.15.62:6808","nonce":37592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":37592},{"type":"v1","addr":"172.21.15.62:6814","nonce":37592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6821","nonce":37592},{"type":"v1","addr":"172.21.15.62:6823","nonce":37592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37592},{"type":"v1","addr":"172.21.15.62:6818","nonce":37592}]},"public_addr":"172.21.15.62:6808/37592","cluster_addr":"172.21.15.62:6814/37592","heartbeat_back_addr":"172.21.15.62:6823/37592","heartbeat_front_addr":"172.21.15.62:6818/37592","state":["exists","up"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":37591},{"type":"v1","addr":"172.21.15.62:6810","nonce":37591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":37591},{"type":"v1","addr":"172.21.15.62:6815","nonce":37591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37591},{"type":"v1","addr":"172.21.15.62:6822","nonce":37591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":37591},{"type":"v1","addr":"172.21.15.62:6819","nonce":37591}]},"public_addr":"172.21.15.62:6810/37591","cluster_addr":"172.21.15.62:6815/37591","heartbeat_back_addr":"172.21.15.62:6822/37591","heartbeat_front_addr":"172.21.15.62:6819/37591","state":["exists","up"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37593},{"type":"v1","addr":"172.21.15.62:6801","nonce":37593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37593},{"type":"v1","addr":"172.21.15.62:6803","nonce":37593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":37593},{"type":"v1","addr":"172.21.15.62:6812","nonce":37593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37593},{"type":"v1","addr":"172.21.15.62:6805","nonce":37593}]},"public_addr":"172.21.15.62:6801/37593","cluster_addr":"172.21.15.62:6803/37593","heartbeat_back_addr":"172.21.15.62:6812/37593","heartbeat_front_addr":"172.21.15.62:6805/37593","state":["exists","up"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37854},{"type":"v1","addr":"172.21.15.161:6801","nonce":37854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37854},{"type":"v1","addr":"172.21.15.161:6803","nonce":37854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37854},{"type":"v1","addr":"172.21.15.161:6807","nonce":37854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37854},{"type":"v1","addr":"172.21.15.161:6805","nonce":37854}]},"public_addr":"172.21.15.161:6801/37854","cluster_addr":"172.21.15.161:6803/37854","heartbeat_back_addr":"172.21.15.161:6807/37854","heartbeat_front_addr":"172.21.15.161:6805/37854","state":["exists","up"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37855},{"type":"v1","addr":"172.21.15.161:6810","nonce":37855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37855},{"type":"v1","addr":"172.21.15.161:6815","nonce":37855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37855},{"type":"v1","addr":"172.21.15.161:6824","nonce":37855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37855},{"type":"v1","addr":"172.21.15.161:6820","nonce":37855}]},"public_addr":"172.21.15.161:6810/37855","cluster_addr":"172.21.15.161:6815/37855","heartbeat_back_addr":"172.21.15.161:6824/37855","heartbeat_front_addr":"172.21.15.161:6820/37855","state":["exists","up"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":37856},{"type":"v1","addr":"172.21.15.161:6814","nonce":37856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37856},{"type":"v1","addr":"172.21.15.161:6819","nonce":37856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":37856},{"type":"v1","addr":"172.21.15.161:6830","nonce":37856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37856},{"type":"v1","addr":"172.21.15.161:6826","nonce":37856}]},"public_addr":"172.21.15.161:6814/37856","cluster_addr":"172.21.15.161:6819/37856","heartbeat_back_addr":"172.21.15.161:6830/37856","heartbeat_front_addr":"172.21.15.161:6826/37856","state":["exists","up"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":37857},{"type":"v1","addr":"172.21.15.161:6813","nonce":37857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":37857},{"type":"v1","addr":"172.21.15.161:6821","nonce":37857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":37857},{"type":"v1","addr":"172.21.15.161:6831","nonce":37857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":37857},{"type":"v1","addr":"172.21.15.161:6827","nonce":37857}]},"public_addr":"172.21.15.161:6813/37857","cluster_addr":"172.21.15.161:6821/37857","heartbeat_back_addr":"172.21.15.161:6831/37857","heartbeat_front_addr":"172.21.15.161:6827/37857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.592907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.618143+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.641533+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.614355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.579293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.718353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.730135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.792887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:39:54.861 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.852+0000 7f78fe5da640 1 -- 172.21.15.62:0/1597693416 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f78d8065380 msgr2=0x7f78d8067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:54.861 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.852+0000 7f78fe5da640 1 --2- 172.21.15.62:0/1597693416 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f78d8065380 0x7f78d8067830 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f78e000b950 tx=0x7f78e0008040 comp rx=0 tx=0).stop 2023-05-15T16:39:54.861 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.852+0000 7f78fe5da640 1 -- 172.21.15.62:0/1597693416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78f8147970 msgr2=0x7f78f81df120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:54.861 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.852+0000 7f78fe5da640 1 --2- 172.21.15.62:0/1597693416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78f8147970 0x7f78f81df120 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f78f00b2040 tx=0x7f78f001bf60 comp rx=0 tx=0).stop 2023-05-15T16:39:54.862 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.852+0000 7f78fe5da640 1 -- 172.21.15.62:0/1597693416 shutdown_connections 2023-05-15T16:39:54.862 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.852+0000 7f78fe5da640 1 --2- 172.21.15.62:0/1597693416 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f78d8065380 0x7f78d8067830 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:54.862 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.852+0000 7f78fe5da640 1 --2- 172.21.15.62:0/1597693416 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f78f8147970 0x7f78f81df120 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:54.862 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.852+0000 7f78fe5da640 1 --2- 172.21.15.62:0/1597693416 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f78f8141c10 0x7f78f80bb060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:54.862 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.852+0000 7f78fe5da640 1 --2- 172.21.15.62:0/1597693416 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f78f806e390 0x7f78f80b46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:54.862 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.852+0000 7f78fe5da640 1 -- 172.21.15.62:0/1597693416 >> 172.21.15.62:0/1597693416 conn(0x7f78f8065960 msgr2=0x7f78f80b8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:54.862 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.852+0000 7f78fe5da640 1 -- 172.21.15.62:0/1597693416 shutdown_connections 2023-05-15T16:39:54.862 INFO:teuthology.misc.health.smithi062.stderr:2023-05-15T16:39:54.852+0000 7f78fe5da640 1 -- 172.21.15.62:0/1597693416 wait complete. 2023-05-15T16:39:54.878 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-05-15T16:39:54.878 INFO:tasks.ceph:Creating RBD pool 2023-05-15T16:39:54.879 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd pool create rbd 8 2023-05-15T16:39:55.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:54.996+0000 7fb6fe641640 1 Processor -- start 2023-05-15T16:39:55.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:54.996+0000 7fb6fe641640 1 -- start start 2023-05-15T16:39:55.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:54.996+0000 7fb6fe641640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb6f8141ff0 0x7fb6f80b86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:55.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:54.996+0000 7fb6fe641640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6f8148250 0x7fb6f8148670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:55.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:54.996+0000 7fb6fe641640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6f80b61e0 con 0x7fb6f80b94f0 2023-05-15T16:39:55.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:54.996+0000 7fb6fe641640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6f81423c0 con 0x7fb6f8141ff0 2023-05-15T16:39:55.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:54.996+0000 7fb6fe641640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f80b9b00 con 0x7fb6f8148250 2023-05-15T16:39:55.003 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:54.996+0000 7fb6f7fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb6f8141ff0 0x7fb6f80b86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:55.004 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:54.996+0000 7fb6f77fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb6f80b94f0 0x7fb6f80be0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48924/0 (socket says 172.21.15.62:48924) 2023-05-15T16:39:55.004 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:54.996+0000 7fb6f77fe640 1 -- 172.21.15.62:0/456598303 learned_addr learned my addr 172.21.15.62:0/456598303 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:39:55.004 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:54.996+0000 7fb6fcbde640 1 --2- 172.21.15.62:0/456598303 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6f8148250 0x7fb6f8148670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:55.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:54.996+0000 7fb6f7fff640 1 -- 172.21.15.62:0/456598303 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6f8148250 msgr2=0x7fb6f8148670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:55.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:54.996+0000 7fb6f7fff640 1 --2- 172.21.15.62:0/456598303 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6f8148250 0x7fb6f8148670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:55.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:54.996+0000 7fb6f7fff640 1 -- 172.21.15.62:0/456598303 >> v1:172.21.15.62:6789/0 conn(0x7fb6f80b94f0 legacy=0x7fb6f80be0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:55.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:54.996+0000 7fb6f7fff640 1 -- 172.21.15.62:0/456598303 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6f80be800 con 0x7fb6f8141ff0 2023-05-15T16:39:55.005 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:54.996+0000 7fb6fcbde640 1 --2- 172.21.15.62:0/456598303 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6f8148250 0x7fb6f8148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:39:55.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6f7fff640 1 --2- 172.21.15.62:0/456598303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f8141ff0 0x7fb6f80b86e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80097c0 tx=0x7fb6e801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b7aa8a375c3375 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:55.006 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6f6ffd640 1 -- 172.21.15.62:0/456598303 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e80a8970 con 0x7fb6f8141ff0 2023-05-15T16:39:55.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6f6ffd640 1 -- 172.21.15.62:0/456598303 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e80a8ad0 con 0x7fb6f8141ff0 2023-05-15T16:39:55.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6f6ffd640 1 -- 172.21.15.62:0/456598303 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e80a8e60 con 0x7fb6f8141ff0 2023-05-15T16:39:55.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6fe641640 1 -- 172.21.15.62:0/456598303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f8141ff0 msgr2=0x7fb6f80b86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:55.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6fe641640 1 --2- 172.21.15.62:0/456598303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f8141ff0 0x7fb6f80b86e0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80097c0 tx=0x7fb6e801ec70 comp rx=0 tx=0).stop 2023-05-15T16:39:55.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6fe641640 1 -- 172.21.15.62:0/456598303 shutdown_connections 2023-05-15T16:39:55.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6fe641640 1 --2- 172.21.15.62:0/456598303 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6f8148250 0x7fb6f8148670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:55.007 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6fe641640 1 --2- 172.21.15.62:0/456598303 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f8141ff0 0x7fb6f80b86e0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:55.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6fe641640 1 -- 172.21.15.62:0/456598303 >> 172.21.15.62:0/456598303 conn(0x7fb6f806e480 msgr2=0x7fb6f806e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:55.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6fe641640 1 -- 172.21.15.62:0/456598303 shutdown_connections 2023-05-15T16:39:55.008 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6fe641640 1 -- 172.21.15.62:0/456598303 wait complete. 2023-05-15T16:39:55.009 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6fe641640 1 Processor -- start 2023-05-15T16:39:55.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6fe641640 1 -- start start 2023-05-15T16:39:55.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6fe641640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f80b94f0 0x7fb6f813f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:55.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6fe641640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6f8141ff0 0x7fb6f806b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:55.010 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6fe641640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6f8148250 0x7fb6f806bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:55.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6fe641640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f813f990 con 0x7fb6f80b94f0 2023-05-15T16:39:55.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6fe641640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f813d320 con 0x7fb6f8141ff0 2023-05-15T16:39:55.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6fe641640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6f806b410 con 0x7fb6f8148250 2023-05-15T16:39:55.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6f7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f80b94f0 0x7fb6f813f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:55.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6f7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f80b94f0 0x7fb6f813f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50704/0 (socket says 172.21.15.62:50704) 2023-05-15T16:39:55.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6f7fff640 1 -- 172.21.15.62:0/1647171330 learned_addr learned my addr 172.21.15.62:0/1647171330 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:55.011 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6f77fe640 1 --2- 172.21.15.62:0/1647171330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6f8141ff0 0x7fb6f806b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:55.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6fcbde640 1 --2- 172.21.15.62:0/1647171330 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6f8148250 0x7fb6f806bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:55.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6f7fff640 1 -- 172.21.15.62:0/1647171330 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6f8148250 msgr2=0x7fb6f806bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:55.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6f7fff640 1 --2- 172.21.15.62:0/1647171330 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6f8148250 0x7fb6f806bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:55.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6f7fff640 1 -- 172.21.15.62:0/1647171330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6f8141ff0 msgr2=0x7fb6f806b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:55.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6f7fff640 1 --2- 172.21.15.62:0/1647171330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6f8141ff0 0x7fb6f806b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:55.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6f7fff640 1 -- 172.21.15.62:0/1647171330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e8009420 con 0x7fb6f80b94f0 2023-05-15T16:39:55.012 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6fcbde640 1 --2- 172.21.15.62:0/1647171330 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6f8148250 0x7fb6f806bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:39:55.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6f77fe640 1 --2- 172.21.15.62:0/1647171330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6f8141ff0 0x7fb6f806b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:39:55.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6f7fff640 1 --2- 172.21.15.62:0/1647171330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f80b94f0 0x7fb6f813f450 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80b3040 tx=0x7fb6e801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:55.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6f4ff9640 1 -- 172.21.15.62:0/1647171330 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e80b9630 con 0x7fb6f80b94f0 2023-05-15T16:39:55.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6f4ff9640 1 -- 172.21.15.62:0/1647171330 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e80b97b0 con 0x7fb6f80b94f0 2023-05-15T16:39:55.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6f4ff9640 1 -- 172.21.15.62:0/1647171330 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e80b9b60 con 0x7fb6f80b94f0 2023-05-15T16:39:55.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6fe641640 1 -- 172.21.15.62:0/1647171330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6f80b8d00 con 0x7fb6f80b94f0 2023-05-15T16:39:55.013 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.000+0000 7fb6fe641640 1 -- 172.21.15.62:0/1647171330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6f80b92c0 con 0x7fb6f80b94f0 2023-05-15T16:39:55.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.004+0000 7fb6fe641640 1 -- 172.21.15.62:0/1647171330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6f80b8fe0 con 0x7fb6f80b94f0 2023-05-15T16:39:55.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.004+0000 7fb6f4ff9640 1 -- 172.21.15.62:0/1647171330 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fb6e80b7040 con 0x7fb6f80b94f0 2023-05-15T16:39:55.016 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.004+0000 7fb6f4ff9640 1 --2- 172.21.15.62:0/1647171330 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb6e4065380 0x7fb6e4067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:55.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.004+0000 7fb6f4ff9640 1 -- 172.21.15.62:0/1647171330 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb6e81203a0 con 0x7fb6f80b94f0 2023-05-15T16:39:55.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.004+0000 7fb6f77fe640 1 --2- 172.21.15.62:0/1647171330 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb6e4065380 0x7fb6e4067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:55.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.004+0000 7fb6f77fe640 1 --2- 172.21.15.62:0/1647171330 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb6e4065380 0x7fb6e4067830 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb6f806caa0 tx=0x7fb6ec009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:55.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.008+0000 7fb6f4ff9640 1 -- 172.21.15.62:0/1647171330 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fb6e80ee560 con 0x7fb6f80b94f0 2023-05-15T16:39:55.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.164+0000 7fb6fe641640 1 -- 172.21.15.62:0/1647171330 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fb6f8067960 con 0x7fb6f80b94f0 2023-05-15T16:39:55.442 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:39:55.446 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:39:55.451 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:39:55.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.664+0000 7fb6f4ff9640 1 -- 172.21.15.62:0/1647171330 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) v1 ==== 109+0+0 (secure 0 0 0) 0x7fb6e80f1b80 con 0x7fb6f80b94f0 2023-05-15T16:39:55.672 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'rbd' created 2023-05-15T16:39:55.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.668+0000 7fb6fe641640 1 -- 172.21.15.62:0/1647171330 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb6e4065380 msgr2=0x7fb6e4067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:55.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.668+0000 7fb6fe641640 1 --2- 172.21.15.62:0/1647171330 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb6e4065380 0x7fb6e4067830 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb6f806caa0 tx=0x7fb6ec009040 comp rx=0 tx=0).stop 2023-05-15T16:39:55.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.668+0000 7fb6fe641640 1 -- 172.21.15.62:0/1647171330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f80b94f0 msgr2=0x7fb6f813f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:55.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.668+0000 7fb6fe641640 1 --2- 172.21.15.62:0/1647171330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f80b94f0 0x7fb6f813f450 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb6e80b3040 tx=0x7fb6e801ba10 comp rx=0 tx=0).stop 2023-05-15T16:39:55.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.668+0000 7fb6fe641640 1 -- 172.21.15.62:0/1647171330 shutdown_connections 2023-05-15T16:39:55.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.668+0000 7fb6fe641640 1 --2- 172.21.15.62:0/1647171330 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb6f8148250 0x7fb6f806bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:55.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.668+0000 7fb6fe641640 1 --2- 172.21.15.62:0/1647171330 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb6f8141ff0 0x7fb6f806b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:55.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.668+0000 7fb6fe641640 1 --2- 172.21.15.62:0/1647171330 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb6e4065380 0x7fb6e4067830 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:55.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.668+0000 7fb6fe641640 1 --2- 172.21.15.62:0/1647171330 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb6f80b94f0 0x7fb6f813f450 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:55.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.668+0000 7fb6fe641640 1 -- 172.21.15.62:0/1647171330 >> 172.21.15.62:0/1647171330 conn(0x7fb6f806e480 msgr2=0x7fb6f81d3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:55.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.668+0000 7fb6fe641640 1 -- 172.21.15.62:0/1647171330 shutdown_connections 2023-05-15T16:39:55.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.668+0000 7fb6fe641640 1 -- 172.21.15.62:0/1647171330 wait complete. 2023-05-15T16:39:55.698 DEBUG:teuthology.orchestra.run.smithi062:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-05-15T16:39:55.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.824+0000 7f43dd044640 1 Processor -- start 2023-05-15T16:39:55.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.824+0000 7f43dd044640 1 -- start start 2023-05-15T16:39:55.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43dd044640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43d80b5300 0x7f43d8141890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:55.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43dd044640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f43d80b6700 0x7f43d81522a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:55.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43dd044640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43d806e760 con 0x7f43d80b7d30 2023-05-15T16:39:55.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43dd044640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43d806ed30 con 0x7f43d80b6700 2023-05-15T16:39:55.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43dd044640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d80b6f00 con 0x7f43d80b5300 2023-05-15T16:39:55.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43d759e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f43d80b6700 0x7f43d81522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:55.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43d659c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f43d80b7d30 0x7f43d8147b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48938/0 (socket says 172.21.15.62:48938) 2023-05-15T16:39:55.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43d659c640 1 -- 172.21.15.62:0/2906614069 learned_addr learned my addr 172.21.15.62:0/2906614069 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:39:55.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43d6d9d640 1 --2- 172.21.15.62:0/2906614069 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43d80b5300 0x7f43d8141890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:55.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43d759e640 1 -- 172.21.15.62:0/2906614069 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43d80b5300 msgr2=0x7f43d8141890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:55.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43d759e640 1 --2- 172.21.15.62:0/2906614069 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43d80b5300 0x7f43d8141890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:55.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43d759e640 1 -- 172.21.15.62:0/2906614069 >> v1:172.21.15.62:6789/0 conn(0x7f43d80b7d30 legacy=0x7f43d8147b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:55.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43d759e640 1 -- 172.21.15.62:0/2906614069 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d80b6c20 con 0x7f43d80b6700 2023-05-15T16:39:55.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43d759e640 1 --2- 172.21.15.62:0/2906614069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d80b6700 0x7f43d81522a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009d90 tx=0x7f43d001f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d99bf4c1b67f65 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:55.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43d5d9b640 1 -- 172.21.15.62:0/2906614069 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d00af600 con 0x7f43d80b6700 2023-05-15T16:39:55.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43d5d9b640 1 -- 172.21.15.62:0/2906614069 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d00ab050 con 0x7f43d80b6700 2023-05-15T16:39:55.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43d5d9b640 1 -- 172.21.15.62:0/2906614069 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d00af980 con 0x7f43d80b6700 2023-05-15T16:39:55.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43dd044640 1 -- 172.21.15.62:0/2906614069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d80b6700 msgr2=0x7f43d81522a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:55.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43dd044640 1 --2- 172.21.15.62:0/2906614069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d80b6700 0x7f43d81522a0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f43d0009d90 tx=0x7f43d001f130 comp rx=0 tx=0).stop 2023-05-15T16:39:55.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43dd044640 1 -- 172.21.15.62:0/2906614069 shutdown_connections 2023-05-15T16:39:55.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43dd044640 1 --2- 172.21.15.62:0/2906614069 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d80b6700 0x7f43d81522a0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:55.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43dd044640 1 --2- 172.21.15.62:0/2906614069 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43d80b5300 0x7f43d8141890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:55.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43dd044640 1 -- 172.21.15.62:0/2906614069 >> 172.21.15.62:0/2906614069 conn(0x7f43d80697b0 msgr2=0x7f43d8069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:55.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43dd044640 1 -- 172.21.15.62:0/2906614069 shutdown_connections 2023-05-15T16:39:55.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.828+0000 7f43dd044640 1 -- 172.21.15.62:0/2906614069 wait complete. 2023-05-15T16:39:55.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43dd044640 1 Processor -- start 2023-05-15T16:39:55.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43dd044640 1 -- start start 2023-05-15T16:39:55.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43dd044640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43d80b5300 0x7f43d8133de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:55.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43dd044640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43d80b6700 0x7f43d813daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:55.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43dd044640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d80b7d30 0x7f43d813dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:55.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43dd044640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d813e870 con 0x7f43d80b7d30 2023-05-15T16:39:55.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43dd044640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43d8134320 con 0x7f43d80b5300 2023-05-15T16:39:55.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43dd044640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43d813d610 con 0x7f43d80b6700 2023-05-15T16:39:55.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43d759e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d80b7d30 0x7f43d813dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:55.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43d759e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d80b7d30 0x7f43d813dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50720/0 (socket says 172.21.15.62:50720) 2023-05-15T16:39:55.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43d759e640 1 -- 172.21.15.62:0/1271634367 learned_addr learned my addr 172.21.15.62:0/1271634367 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:55.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43d6d9d640 1 --2- 172.21.15.62:0/1271634367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43d80b5300 0x7f43d8133de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:55.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43d759e640 1 -- 172.21.15.62:0/1271634367 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43d80b6700 msgr2=0x7f43d813daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:55.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43d759e640 1 --2- 172.21.15.62:0/1271634367 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43d80b6700 0x7f43d813daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:55.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43d759e640 1 -- 172.21.15.62:0/1271634367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43d80b5300 msgr2=0x7f43d8133de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:55.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43d759e640 1 --2- 172.21.15.62:0/1271634367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43d80b5300 0x7f43d8133de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:55.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43d759e640 1 -- 172.21.15.62:0/1271634367 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43d0009a70 con 0x7f43d80b7d30 2023-05-15T16:39:55.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43d6d9d640 1 --2- 172.21.15.62:0/1271634367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43d80b5300 0x7f43d8133de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:39:55.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43d759e640 1 --2- 172.21.15.62:0/1271634367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d80b7d30 0x7f43d813dfe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f43d001d7e0 tx=0x7f43d001bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:55.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43bf7fe640 1 -- 172.21.15.62:0/1271634367 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d00b9610 con 0x7f43d80b7d30 2023-05-15T16:39:55.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43bf7fe640 1 -- 172.21.15.62:0/1271634367 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43d00b9770 con 0x7f43d80b7d30 2023-05-15T16:39:55.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43dd044640 1 -- 172.21.15.62:0/1271634367 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43d80b56d0 con 0x7f43d80b7d30 2023-05-15T16:39:55.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43bf7fe640 1 -- 172.21.15.62:0/1271634367 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43d00b9ae0 con 0x7f43d80b7d30 2023-05-15T16:39:55.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43dd044640 1 -- 172.21.15.62:0/1271634367 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43d806e3f0 con 0x7f43d80b7d30 2023-05-15T16:39:55.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.832+0000 7f43dd044640 1 -- 172.21.15.62:0/1271634367 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43d8141dd0 con 0x7f43d80b7d30 2023-05-15T16:39:55.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.836+0000 7f43bf7fe640 1 -- 172.21.15.62:0/1271634367 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f43d00b6050 con 0x7f43d80b7d30 2023-05-15T16:39:55.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.836+0000 7f43bf7fe640 1 --2- 172.21.15.62:0/1271634367 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f43c4065380 0x7f43c4067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:55.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.836+0000 7f43bf7fe640 1 -- 172.21.15.62:0/1271634367 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5199+0+0 (secure 0 0 0) 0x7f43d0120ab0 con 0x7f43d80b7d30 2023-05-15T16:39:55.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.836+0000 7f43d6d9d640 1 --2- 172.21.15.62:0/1271634367 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f43c4065380 0x7f43c4067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:55.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.836+0000 7f43d6d9d640 1 --2- 172.21.15.62:0/1271634367 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f43c4065380 0x7f43c4067830 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009840 tx=0x7f43c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:55.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.840+0000 7f43bf7fe640 1 -- 172.21.15.62:0/1271634367 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f43d00eeb20 con 0x7f43d80b7d30 2023-05-15T16:39:56.002 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:55.996+0000 7f43dd044640 1 -- 172.21.15.62:0/1271634367 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f43d813d7a0 con 0x7f43d80b7d30 2023-05-15T16:39:56.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.680+0000 7f43bf7fe640 1 -- 172.21.15.62:0/1271634367 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v18) v1 ==== 173+0+0 (secure 0 0 0) 0x7f43d00b40c0 con 0x7f43d80b7d30 2023-05-15T16:39:56.686 INFO:teuthology.orchestra.run.smithi062.stderr:enabled application 'rbd' on pool 'rbd' 2023-05-15T16:39:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.684+0000 7f43dd044640 1 -- 172.21.15.62:0/1271634367 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f43c4065380 msgr2=0x7f43c4067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.684+0000 7f43dd044640 1 --2- 172.21.15.62:0/1271634367 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f43c4065380 0x7f43c4067830 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f43c8009840 tx=0x7f43c8008040 comp rx=0 tx=0).stop 2023-05-15T16:39:56.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.684+0000 7f43dd044640 1 -- 172.21.15.62:0/1271634367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d80b7d30 msgr2=0x7f43d813dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.684+0000 7f43dd044640 1 --2- 172.21.15.62:0/1271634367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d80b7d30 0x7f43d813dfe0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f43d001d7e0 tx=0x7f43d001bed0 comp rx=0 tx=0).stop 2023-05-15T16:39:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.684+0000 7f43dd044640 1 -- 172.21.15.62:0/1271634367 shutdown_connections 2023-05-15T16:39:56.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.684+0000 7f43dd044640 1 --2- 172.21.15.62:0/1271634367 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f43c4065380 0x7f43c4067830 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.684+0000 7f43dd044640 1 --2- 172.21.15.62:0/1271634367 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f43d80b7d30 0x7f43d813dfe0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.684+0000 7f43dd044640 1 --2- 172.21.15.62:0/1271634367 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f43d80b6700 0x7f43d813daa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:56.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.684+0000 7f43dd044640 1 --2- 172.21.15.62:0/1271634367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f43d80b5300 0x7f43d8133de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:56.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.684+0000 7f43dd044640 1 -- 172.21.15.62:0/1271634367 >> 172.21.15.62:0/1271634367 conn(0x7f43d80697b0 msgr2=0x7f43d80b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:56.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.684+0000 7f43dd044640 1 -- 172.21.15.62:0/1271634367 shutdown_connections 2023-05-15T16:39:56.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.684+0000 7f43dd044640 1 -- 172.21.15.62:0/1271634367 wait complete. 2023-05-15T16:39:56.716 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-05-15T16:39:56.716 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-15T16:39:56.717 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-15T16:39:56.719 INFO:tasks.ceph.mds.a:Started 2023-05-15T16:39:56.719 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-15T16:39:56.719 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-15T16:39:56.721 INFO:tasks.ceph.mds.c:Started 2023-05-15T16:39:56.721 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-15T16:39:56.722 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-15T16:39:56.724 INFO:tasks.ceph.mds.b:Started 2023-05-15T16:39:56.725 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-05-15T16:39:56.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-15T16:39:56.797 INFO:tasks.ceph.mds.c.smithi062.stdout:starting mds.c at 2023-05-15T16:39:56.797 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2023-05-15T16:39:56.820 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-05-15T16:39:56.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.840+0000 7f8d0856b640 1 Processor -- start 2023-05-15T16:39:56.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.840+0000 7f8d0856b640 1 -- start start 2023-05-15T16:39:56.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.840+0000 7f8d0856b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8d000b2bb0 0x7f8d000b8530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:56.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.840+0000 7f8d0856b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8d000b2f80 0x7f8d00070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:56.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.840+0000 7f8d0856b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d000b71a0 0x7f8d00148340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:56.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.840+0000 7f8d0856b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d000b4750 con 0x7f8d000b2bb0 2023-05-15T16:39:56.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.840+0000 7f8d0856b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d00147e80 con 0x7f8d000b2f80 2023-05-15T16:39:56.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.840+0000 7f8d0856b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d000b8a70 con 0x7f8d000b71a0 2023-05-15T16:39:56.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.840+0000 7f8d06307640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8d000b2bb0 0x7f8d000b8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:56.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.840+0000 7f8d06307640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8d000b2bb0 0x7f8d000b8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50776/0 (socket says 172.21.15.62:50776) 2023-05-15T16:39:56.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.840+0000 7f8d06307640 1 -- 172.21.15.62:0/2735404134 learned_addr learned my addr 172.21.15.62:0/2735404134 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:56.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.840+0000 7f8d06b08640 1 --2- 172.21.15.62:0/2735404134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d000b71a0 0x7f8d00148340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:56.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.840+0000 7f8d05b06640 1 --2- 172.21.15.62:0/2735404134 >> v2:172.21.15.161:3300/0 conn(0x7f8d000b2f80 0x7f8d00070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:56.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.840+0000 7f8d06307640 1 -- 172.21.15.62:0/2735404134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d000b71a0 msgr2=0x7f8d00148340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:56.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.840+0000 7f8d06307640 1 --2- 172.21.15.62:0/2735404134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d000b71a0 0x7f8d00148340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:56.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.840+0000 7f8d06307640 1 -- 172.21.15.62:0/2735404134 >> v2:172.21.15.161:3300/0 conn(0x7f8d000b2f80 msgr2=0x7f8d00070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:56.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.840+0000 7f8d06307640 1 --2- 172.21.15.62:0/2735404134 >> v2:172.21.15.161:3300/0 conn(0x7f8d000b2f80 0x7f8d00070e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:56.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.840+0000 7f8d06307640 1 -- 172.21.15.62:0/2735404134 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d000b76c0 con 0x7f8d000b2bb0 2023-05-15T16:39:56.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.844+0000 7f8d06307640 1 --2- 172.21.15.62:0/2735404134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d000b2bb0 0x7f8d000b8530 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8d00145a30 tx=0x7f8cfc01ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1dcc7bc240a5819 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:56.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.844+0000 7f8d05305640 1 -- 172.21.15.62:0/2735404134 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc0a89b0 con 0x7f8d000b2bb0 2023-05-15T16:39:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.844+0000 7f8d05305640 1 -- 172.21.15.62:0/2735404134 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cfc0a8b10 con 0x7f8d000b2bb0 2023-05-15T16:39:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.844+0000 7f8d05305640 1 -- 172.21.15.62:0/2735404134 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cfc0a8ea0 con 0x7f8d000b2bb0 2023-05-15T16:39:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.844+0000 7f8d0856b640 1 -- 172.21.15.62:0/2735404134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d000b2bb0 msgr2=0x7f8d000b8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.844+0000 7f8d0856b640 1 --2- 172.21.15.62:0/2735404134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d000b2bb0 0x7f8d000b8530 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f8d00145a30 tx=0x7f8cfc01ecf0 comp rx=0 tx=0).stop 2023-05-15T16:39:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.844+0000 7f8d0856b640 1 -- 172.21.15.62:0/2735404134 shutdown_connections 2023-05-15T16:39:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.844+0000 7f8d0856b640 1 --2- 172.21.15.62:0/2735404134 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d000b71a0 0x7f8d00148340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.844+0000 7f8d0856b640 1 --2- 172.21.15.62:0/2735404134 >> v2:172.21.15.161:3300/0 conn(0x7f8d000b2f80 0x7f8d00070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:56.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.844+0000 7f8d0856b640 1 --2- 172.21.15.62:0/2735404134 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d000b2bb0 0x7f8d000b8530 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:56.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.844+0000 7f8d0856b640 1 -- 172.21.15.62:0/2735404134 >> 172.21.15.62:0/2735404134 conn(0x7f8d000bc350 msgr2=0x7f8d000bc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:56.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.844+0000 7f8d0856b640 1 -- 172.21.15.62:0/2735404134 shutdown_connections 2023-05-15T16:39:56.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.844+0000 7f8d0856b640 1 -- 172.21.15.62:0/2735404134 wait complete. 2023-05-15T16:39:56.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.844+0000 7f8d0856b640 1 Processor -- start 2023-05-15T16:39:56.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.844+0000 7f8d0856b640 1 -- start start 2023-05-15T16:39:56.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d0856b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d000b2bb0 0x7f8d001380d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:56.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d0856b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d000b2f80 0x7f8d0013ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:56.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d0856b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d000b71a0 0x7f8d00139790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:56.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d0856b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d00139300 con 0x7f8d000b71a0 2023-05-15T16:39:56.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d0856b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d00146200 con 0x7f8d000b2f80 2023-05-15T16:39:56.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d0856b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d001e1210 con 0x7f8d000b2bb0 2023-05-15T16:39:56.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d06b08640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d000b71a0 0x7f8d00139790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:56.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d06b08640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d000b71a0 0x7f8d00139790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50782/0 (socket says 172.21.15.62:50782) 2023-05-15T16:39:56.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d06b08640 1 -- 172.21.15.62:0/4208752847 learned_addr learned my addr 172.21.15.62:0/4208752847 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:56.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d05b06640 1 --2- 172.21.15.62:0/4208752847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d000b2f80 0x7f8d0013ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:56.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d06307640 1 --2- 172.21.15.62:0/4208752847 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d000b2bb0 0x7f8d001380d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:56.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d06b08640 1 -- 172.21.15.62:0/4208752847 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d000b2bb0 msgr2=0x7f8d001380d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:56.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d06b08640 1 --2- 172.21.15.62:0/4208752847 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d000b2bb0 0x7f8d001380d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:56.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d06b08640 1 -- 172.21.15.62:0/4208752847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d000b2f80 msgr2=0x7f8d0013ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:56.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d06b08640 1 --2- 172.21.15.62:0/4208752847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d000b2f80 0x7f8d0013ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:56.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d06b08640 1 -- 172.21.15.62:0/4208752847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cfc0094d0 con 0x7f8d000b71a0 2023-05-15T16:39:56.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d06307640 1 --2- 172.21.15.62:0/4208752847 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d000b2bb0 0x7f8d001380d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-15T16:39:56.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d06b08640 1 --2- 172.21.15.62:0/4208752847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d000b71a0 0x7f8d00139790 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8009dd0 tx=0x7f8cf800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:56.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8cf6ffd640 1 -- 172.21.15.62:0/4208752847 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8014480 con 0x7f8d000b71a0 2023-05-15T16:39:56.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8cf6ffd640 1 -- 172.21.15.62:0/4208752847 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cf800f040 con 0x7f8d000b71a0 2023-05-15T16:39:56.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d0856b640 1 -- 172.21.15.62:0/4208752847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d000b7c80 con 0x7f8d000b71a0 2023-05-15T16:39:56.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8cf6ffd640 1 -- 172.21.15.62:0/4208752847 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cf8014840 con 0x7f8d000b71a0 2023-05-15T16:39:56.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d0856b640 1 -- 172.21.15.62:0/4208752847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d000b79a0 con 0x7f8d000b71a0 2023-05-15T16:39:56.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d0856b640 1 -- 172.21.15.62:0/4208752847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d000713b0 con 0x7f8d000b71a0 2023-05-15T16:39:56.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8cf6ffd640 1 -- 172.21.15.62:0/4208752847 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f8cf80149a0 con 0x7f8d000b71a0 2023-05-15T16:39:56.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8cf6ffd640 1 --2- 172.21.15.62:0/4208752847 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8ce40653b0 0x7f8ce4067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:56.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8cf6ffd640 1 -- 172.21.15.62:0/4208752847 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8cf8082f40 con 0x7f8d000b71a0 2023-05-15T16:39:56.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d06307640 1 --2- 172.21.15.62:0/4208752847 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8ce40653b0 0x7f8ce4067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:56.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.848+0000 7f8d06307640 1 --2- 172.21.15.62:0/4208752847 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8ce40653b0 0x7f8ce4067860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc0b2000 tx=0x7f8cfc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:56.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:56.852+0000 7f8cf6ffd640 1 -- 172.21.15.62:0/4208752847 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f8cf8050f10 con 0x7f8d000b71a0 2023-05-15T16:39:57.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.008+0000 7f8d0856b640 1 -- 172.21.15.62:0/4208752847 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d00067960 con 0x7f8d000b71a0 2023-05-15T16:39:57.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.008+0000 7f8cf6ffd640 1 -- 172.21.15.62:0/4208752847 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+14181 (secure 0 0 0) 0x7f8cf8054530 con 0x7f8d000b71a0 2023-05-15T16:39:57.018 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:39:57.018 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":18,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:39:56.664256+0000","last_up_change":"2023-05-15T16:39:48.597049+0000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-15T16:39:49.394028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-15T16:39:55.208679+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37594},{"type":"v1","addr":"172.21.15.62:6825","nonce":37594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37594},{"type":"v1","addr":"172.21.15.62:6827","nonce":37594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37594},{"type":"v1","addr":"172.21.15.62:6831","nonce":37594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37594},{"type":"v1","addr":"172.21.15.62:6829","nonce":37594}]},"public_addr":"172.21.15.62:6825/37594","cluster_addr":"172.21.15.62:6827/37594","heartbeat_back_addr":"172.21.15.62:6831/37594","heartbeat_front_addr":"172.21.15.62:6829/37594","state":["exists","up"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37592},{"type":"v1","addr":"172.21.15.62:6808","nonce":37592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":37592},{"type":"v1","addr":"172.21.15.62:6814","nonce":37592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6821","nonce":37592},{"type":"v1","addr":"172.21.15.62:6823","nonce":37592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37592},{"type":"v1","addr":"172.21.15.62:6818","nonce":37592}]},"public_addr":"172.21.15.62:6808/37592","cluster_addr":"172.21.15.62:6814/37592","heartbeat_back_addr":"172.21.15.62:6823/37592","heartbeat_front_addr":"172.21.15.62:6818/37592","state":["exists","up"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":37591},{"type":"v1","addr":"172.21.15.62:6810","nonce":37591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":37591},{"type":"v1","addr":"172.21.15.62:6815","nonce":37591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37591},{"type":"v1","addr":"172.21.15.62:6822","nonce":37591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":37591},{"type":"v1","addr":"172.21.15.62:6819","nonce":37591}]},"public_addr":"172.21.15.62:6810/37591","cluster_addr":"172.21.15.62:6815/37591","heartbeat_back_addr":"172.21.15.62:6822/37591","heartbeat_front_addr":"172.21.15.62:6819/37591","state":["exists","up"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37593},{"type":"v1","addr":"172.21.15.62:6801","nonce":37593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37593},{"type":"v1","addr":"172.21.15.62:6803","nonce":37593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":37593},{"type":"v1","addr":"172.21.15.62:6812","nonce":37593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37593},{"type":"v1","addr":"172.21.15.62:6805","nonce":37593}]},"public_addr":"172.21.15.62:6801/37593","cluster_addr":"172.21.15.62:6803/37593","heartbeat_back_addr":"172.21.15.62:6812/37593","heartbeat_front_addr":"172.21.15.62:6805/37593","state":["exists","up"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37854},{"type":"v1","addr":"172.21.15.161:6801","nonce":37854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37854},{"type":"v1","addr":"172.21.15.161:6803","nonce":37854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37854},{"type":"v1","addr":"172.21.15.161:6807","nonce":37854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37854},{"type":"v1","addr":"172.21.15.161:6805","nonce":37854}]},"public_addr":"172.21.15.161:6801/37854","cluster_addr":"172.21.15.161:6803/37854","heartbeat_back_addr":"172.21.15.161:6807/37854","heartbeat_front_addr":"172.21.15.161:6805/37854","state":["exists","up"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37855},{"type":"v1","addr":"172.21.15.161:6810","nonce":37855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37855},{"type":"v1","addr":"172.21.15.161:6815","nonce":37855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37855},{"type":"v1","addr":"172.21.15.161:6824","nonce":37855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37855},{"type":"v1","addr":"172.21.15.161:6820","nonce":37855}]},"public_addr":"172.21.15.161:6810/37855","cluster_addr":"172.21.15.161:6815/37855","heartbeat_back_addr":"172.21.15.161:6824/37855","heartbeat_front_addr":"172.21.15.161:6820/37855","state":["exists","up"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":37856},{"type":"v1","addr":"172.21.15.161:6814","nonce":37856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37856},{"type":"v1","addr":"172.21.15.161:6819","nonce":37856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":37856},{"type":"v1","addr":"172.21.15.161:6830","nonce":37856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37856},{"type":"v1","addr":"172.21.15.161:6826","nonce":37856}]},"public_addr":"172.21.15.161:6814/37856","cluster_addr":"172.21.15.161:6819/37856","heartbeat_back_addr":"172.21.15.161:6830/37856","heartbeat_front_addr":"172.21.15.161:6826/37856","state":["exists","up"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":37857},{"type":"v1","addr":"172.21.15.161:6813","nonce":37857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":37857},{"type":"v1","addr":"172.21.15.161:6821","nonce":37857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":37857},{"type":"v1","addr":"172.21.15.161:6831","nonce":37857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":37857},{"type":"v1","addr":"172.21.15.161:6827","nonce":37857}]},"public_addr":"172.21.15.161:6813/37857","cluster_addr":"172.21.15.161:6821/37857","heartbeat_back_addr":"172.21.15.161:6831/37857","heartbeat_front_addr":"172.21.15.161:6827/37857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.592907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.618143+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.641533+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.614355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.579293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.718353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.730135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.792887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:39:57.019 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.012+0000 7f8d0856b640 1 -- 172.21.15.62:0/4208752847 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8ce40653b0 msgr2=0x7f8ce4067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:57.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.012+0000 7f8d0856b640 1 --2- 172.21.15.62:0/4208752847 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8ce40653b0 0x7f8ce4067860 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8cfc0b2000 tx=0x7f8cfc008040 comp rx=0 tx=0).stop 2023-05-15T16:39:57.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.012+0000 7f8d0856b640 1 -- 172.21.15.62:0/4208752847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d000b71a0 msgr2=0x7f8d00139790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:57.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.012+0000 7f8d0856b640 1 --2- 172.21.15.62:0/4208752847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d000b71a0 0x7f8d00139790 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f8cf8009dd0 tx=0x7f8cf800c490 comp rx=0 tx=0).stop 2023-05-15T16:39:57.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.012+0000 7f8d0856b640 1 -- 172.21.15.62:0/4208752847 shutdown_connections 2023-05-15T16:39:57.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.012+0000 7f8d0856b640 1 --2- 172.21.15.62:0/4208752847 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8ce40653b0 0x7f8ce4067860 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.012+0000 7f8d0856b640 1 --2- 172.21.15.62:0/4208752847 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8d000b71a0 0x7f8d00139790 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.012+0000 7f8d0856b640 1 --2- 172.21.15.62:0/4208752847 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8d000b2f80 0x7f8d0013ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.012+0000 7f8d0856b640 1 --2- 172.21.15.62:0/4208752847 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8d000b2bb0 0x7f8d001380d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.012+0000 7f8d0856b640 1 -- 172.21.15.62:0/4208752847 >> 172.21.15.62:0/4208752847 conn(0x7f8d000bc350 msgr2=0x7f8d000b8db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:57.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.012+0000 7f8d0856b640 1 -- 172.21.15.62:0/4208752847 shutdown_connections 2023-05-15T16:39:57.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.012+0000 7f8d0856b640 1 -- 172.21.15.62:0/4208752847 wait complete. 2023-05-15T16:39:57.038 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-15T16:39:49.394028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-15T16:39:55.208679+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-15T16:39:57.039 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-15T16:39:57.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.160+0000 7f9a4c5ed640 1 Processor -- start 2023-05-15T16:39:57.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.160+0000 7f9a4c5ed640 1 -- start start 2023-05-15T16:39:57.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.160+0000 7f9a4c5ed640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9a440b7910 0x7f9a440b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:57.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.160+0000 7f9a4c5ed640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a4414f4c0 0x7f9a441518a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:57.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.160+0000 7f9a4c5ed640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a44144880 con 0x7f9a440b5e70 2023-05-15T16:39:57.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.160+0000 7f9a4c5ed640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a440b5a50 con 0x7f9a440b7910 2023-05-15T16:39:57.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.160+0000 7f9a4c5ed640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a440b1610 con 0x7f9a4414f4c0 2023-05-15T16:39:57.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.160+0000 7f9a4a389640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9a440b7910 0x7f9a440b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:57.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.160+0000 7f9a4a389640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9a440b7910 0x7f9a440b4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50784/0 (socket says 172.21.15.62:50784) 2023-05-15T16:39:57.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.160+0000 7f9a4a389640 1 -- 172.21.15.62:0/898329339 learned_addr learned my addr 172.21.15.62:0/898329339 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:57.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.160+0000 7f9a4ab8a640 1 --2- 172.21.15.62:0/898329339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a4414f4c0 0x7f9a441518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:57.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.160+0000 7f9a4a389640 1 -- 172.21.15.62:0/898329339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a4414f4c0 msgr2=0x7f9a441518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:57.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.160+0000 7f9a4a389640 1 --2- 172.21.15.62:0/898329339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a4414f4c0 0x7f9a441518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.160+0000 7f9a4a389640 1 -- 172.21.15.62:0/898329339 >> v1:172.21.15.161:6789/0 conn(0x7f9a440b5e70 legacy=0x7f9a44144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:57.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.160+0000 7f9a4a389640 1 -- 172.21.15.62:0/898329339 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a440b3220 con 0x7f9a440b7910 2023-05-15T16:39:57.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.164+0000 7f9a4a389640 1 --2- 172.21.15.62:0/898329339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a440b7910 0x7f9a440b4b30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9a400098a0 tx=0x7f9a4001ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d93980b0b77d3579 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:57.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.164+0000 7f9a49387640 1 -- 172.21.15.62:0/898329339 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a400a8990 con 0x7f9a440b7910 2023-05-15T16:39:57.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.164+0000 7f9a49387640 1 -- 172.21.15.62:0/898329339 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a400a8af0 con 0x7f9a440b7910 2023-05-15T16:39:57.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.164+0000 7f9a49387640 1 -- 172.21.15.62:0/898329339 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a400a8e80 con 0x7f9a440b7910 2023-05-15T16:39:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.164+0000 7f9a4c5ed640 1 -- 172.21.15.62:0/898329339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a440b7910 msgr2=0x7f9a440b4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.164+0000 7f9a4c5ed640 1 --2- 172.21.15.62:0/898329339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a440b7910 0x7f9a440b4b30 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9a400098a0 tx=0x7f9a4001ecd0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.164+0000 7f9a4c5ed640 1 -- 172.21.15.62:0/898329339 shutdown_connections 2023-05-15T16:39:57.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.164+0000 7f9a4c5ed640 1 --2- 172.21.15.62:0/898329339 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a4414f4c0 0x7f9a441518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.164+0000 7f9a4c5ed640 1 --2- 172.21.15.62:0/898329339 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a440b7910 0x7f9a440b4b30 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.164+0000 7f9a4c5ed640 1 -- 172.21.15.62:0/898329339 >> 172.21.15.62:0/898329339 conn(0x7f9a440697b0 msgr2=0x7f9a44069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:57.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.164+0000 7f9a4c5ed640 1 -- 172.21.15.62:0/898329339 shutdown_connections 2023-05-15T16:39:57.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.164+0000 7f9a4c5ed640 1 -- 172.21.15.62:0/898329339 wait complete. 2023-05-15T16:39:57.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.164+0000 7f9a4c5ed640 1 Processor -- start 2023-05-15T16:39:57.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.164+0000 7f9a4c5ed640 1 -- start start 2023-05-15T16:39:57.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a4c5ed640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a440b5e70 0x7f9a44139b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:57.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a4c5ed640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a440b7910 0x7f9a441e2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:57.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a4c5ed640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a4414f4c0 0x7f9a441e2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:57.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a4c5ed640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4413b840 con 0x7f9a4414f4c0 2023-05-15T16:39:57.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a4c5ed640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a4413a050 con 0x7f9a440b7910 2023-05-15T16:39:57.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a4c5ed640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a440a17f0 con 0x7f9a440b5e70 2023-05-15T16:39:57.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a4ab8a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a4414f4c0 0x7f9a441e2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:57.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a4ab8a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a4414f4c0 0x7f9a441e2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50792/0 (socket says 172.21.15.62:50792) 2023-05-15T16:39:57.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a4ab8a640 1 -- 172.21.15.62:0/2649611470 learned_addr learned my addr 172.21.15.62:0/2649611470 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:57.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a49b88640 1 --2- 172.21.15.62:0/2649611470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a440b7910 0x7f9a441e2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:57.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a4a389640 1 --2- 172.21.15.62:0/2649611470 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a440b5e70 0x7f9a44139b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:57.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a4ab8a640 1 -- 172.21.15.62:0/2649611470 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a440b5e70 msgr2=0x7f9a44139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:57.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a4ab8a640 1 --2- 172.21.15.62:0/2649611470 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a440b5e70 0x7f9a44139b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a4ab8a640 1 -- 172.21.15.62:0/2649611470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a440b7910 msgr2=0x7f9a441e2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:57.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a4ab8a640 1 --2- 172.21.15.62:0/2649611470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a440b7910 0x7f9a441e2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a4ab8a640 1 -- 172.21.15.62:0/2649611470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a400094d0 con 0x7f9a4414f4c0 2023-05-15T16:39:57.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a4a389640 1 --2- 172.21.15.62:0/2649611470 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a440b5e70 0x7f9a44139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:39:57.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a4ab8a640 1 --2- 172.21.15.62:0/2649611470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a4414f4c0 0x7f9a441e2ca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c007d40 tx=0x7f9a3c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:57.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a3affd640 1 -- 172.21.15.62:0/2649611470 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c014420 con 0x7f9a4414f4c0 2023-05-15T16:39:57.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a3affd640 1 -- 172.21.15.62:0/2649611470 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a3c0145a0 con 0x7f9a4414f4c0 2023-05-15T16:39:57.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a4c5ed640 1 -- 172.21.15.62:0/2649611470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a440b34c0 con 0x7f9a4414f4c0 2023-05-15T16:39:57.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a3affd640 1 -- 172.21.15.62:0/2649611470 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a3c014950 con 0x7f9a4414f4c0 2023-05-15T16:39:57.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a4c5ed640 1 -- 172.21.15.62:0/2649611470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a440b4710 con 0x7f9a4414f4c0 2023-05-15T16:39:57.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a4c5ed640 1 -- 172.21.15.62:0/2649611470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a440b2a90 con 0x7f9a4414f4c0 2023-05-15T16:39:57.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a3affd640 1 -- 172.21.15.62:0/2649611470 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f9a3c014ab0 con 0x7f9a4414f4c0 2023-05-15T16:39:57.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a3affd640 1 --2- 172.21.15.62:0/2649611470 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9a28065380 0x7f9a28067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:57.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a3affd640 1 -- 172.21.15.62:0/2649611470 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f9a3c082d30 con 0x7f9a4414f4c0 2023-05-15T16:39:57.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.168+0000 7f9a4a389640 1 --2- 172.21.15.62:0/2649611470 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9a28065380 0x7f9a28067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:57.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.172+0000 7f9a4a389640 1 --2- 172.21.15.62:0/2649611470 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9a28065380 0x7f9a28067830 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9a400b2000 tx=0x7f9a400aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:57.182 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.172+0000 7f9a3affd640 1 -- 172.21.15.62:0/2649611470 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f9a3c050d90 con 0x7f9a4414f4c0 2023-05-15T16:39:57.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.328+0000 7f9a4c5ed640 1 -- 172.21.15.62:0/2649611470 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9a44067960 con 0x7f9a4414f4c0 2023-05-15T16:39:57.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.328+0000 7f9a3affd640 1 -- 172.21.15.62:0/2649611470 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9a3c0543b0 con 0x7f9a4414f4c0 2023-05-15T16:39:57.335 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-05-15T16:39:57.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.328+0000 7f9a4c5ed640 1 -- 172.21.15.62:0/2649611470 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9a28065380 msgr2=0x7f9a28067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:57.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.328+0000 7f9a4c5ed640 1 --2- 172.21.15.62:0/2649611470 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9a28065380 0x7f9a28067830 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9a400b2000 tx=0x7f9a400aa070 comp rx=0 tx=0).stop 2023-05-15T16:39:57.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.328+0000 7f9a4c5ed640 1 -- 172.21.15.62:0/2649611470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a4414f4c0 msgr2=0x7f9a441e2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:57.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.328+0000 7f9a4c5ed640 1 --2- 172.21.15.62:0/2649611470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a4414f4c0 0x7f9a441e2ca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9a3c007d40 tx=0x7f9a3c00e4b0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.328+0000 7f9a4c5ed640 1 -- 172.21.15.62:0/2649611470 shutdown_connections 2023-05-15T16:39:57.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.328+0000 7f9a4c5ed640 1 --2- 172.21.15.62:0/2649611470 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9a28065380 0x7f9a28067830 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.328+0000 7f9a4c5ed640 1 --2- 172.21.15.62:0/2649611470 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9a4414f4c0 0x7f9a441e2ca0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.328+0000 7f9a4c5ed640 1 --2- 172.21.15.62:0/2649611470 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9a440b7910 0x7f9a441e2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.328+0000 7f9a4c5ed640 1 --2- 172.21.15.62:0/2649611470 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9a440b5e70 0x7f9a44139b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.328+0000 7f9a4c5ed640 1 -- 172.21.15.62:0/2649611470 >> 172.21.15.62:0/2649611470 conn(0x7f9a440697b0 msgr2=0x7f9a440b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:57.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.332+0000 7f9a4c5ed640 1 -- 172.21.15.62:0/2649611470 shutdown_connections 2023-05-15T16:39:57.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.332+0000 7f9a4c5ed640 1 -- 172.21.15.62:0/2649611470 wait complete. 2023-05-15T16:39:57.354 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-15T16:39:57.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.468+0000 7fec920be640 1 Processor -- start 2023-05-15T16:39:57.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.468+0000 7fec920be640 1 -- start start 2023-05-15T16:39:57.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.468+0000 7fec920be640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fec8c0b5e70 0x7fec8c144170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:57.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.468+0000 7fec920be640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fec8c14f4c0 0x7fec8c1518a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:57.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.468+0000 7fec920be640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec8c0b5240 con 0x7fec8c0b7910 2023-05-15T16:39:57.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.468+0000 7fec920be640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec8c0b5a50 con 0x7fec8c0b5e70 2023-05-15T16:39:57.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.468+0000 7fec920be640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c0b1610 con 0x7fec8c14f4c0 2023-05-15T16:39:57.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.468+0000 7fec8affd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fec8c0b5e70 0x7fec8c144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:57.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.468+0000 7fec8affd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fec8c0b5e70 0x7fec8c144170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50798/0 (socket says 172.21.15.62:50798) 2023-05-15T16:39:57.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.468+0000 7fec8affd640 1 -- 172.21.15.62:0/1418236902 learned_addr learned my addr 172.21.15.62:0/1418236902 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:57.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.468+0000 7fec8bfff640 1 --2- 172.21.15.62:0/1418236902 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fec8c14f4c0 0x7fec8c1518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:57.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.468+0000 7fec8affd640 1 -- 172.21.15.62:0/1418236902 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fec8c14f4c0 msgr2=0x7fec8c1518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:57.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.468+0000 7fec8affd640 1 --2- 172.21.15.62:0/1418236902 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fec8c14f4c0 0x7fec8c1518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.468+0000 7fec8affd640 1 -- 172.21.15.62:0/1418236902 >> v1:172.21.15.161:6789/0 conn(0x7fec8c0b7910 legacy=0x7fec8c0b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:57.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.468+0000 7fec8affd640 1 -- 172.21.15.62:0/1418236902 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec8c0b3220 con 0x7fec8c0b5e70 2023-05-15T16:39:57.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec8affd640 1 --2- 172.21.15.62:0/1418236902 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec8c0b5e70 0x7fec8c144170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00bb40 tx=0x7fec7c0213a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc6e3cfc21164916 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:57.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec8a7fc640 1 -- 172.21.15.62:0/1418236902 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c0b1600 con 0x7fec8c0b5e70 2023-05-15T16:39:57.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec8a7fc640 1 -- 172.21.15.62:0/1418236902 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec7c0ad050 con 0x7fec8c0b5e70 2023-05-15T16:39:57.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec8a7fc640 1 -- 172.21.15.62:0/1418236902 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec7c0b1980 con 0x7fec8c0b5e70 2023-05-15T16:39:57.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec920be640 1 -- 172.21.15.62:0/1418236902 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec8c0b5e70 msgr2=0x7fec8c144170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:57.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec920be640 1 --2- 172.21.15.62:0/1418236902 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec8c0b5e70 0x7fec8c144170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fec7c00bb40 tx=0x7fec7c0213a0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec920be640 1 -- 172.21.15.62:0/1418236902 shutdown_connections 2023-05-15T16:39:57.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec920be640 1 --2- 172.21.15.62:0/1418236902 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fec8c14f4c0 0x7fec8c1518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec920be640 1 --2- 172.21.15.62:0/1418236902 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec8c0b5e70 0x7fec8c144170 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec920be640 1 -- 172.21.15.62:0/1418236902 >> 172.21.15.62:0/1418236902 conn(0x7fec8c0697b0 msgr2=0x7fec8c069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:57.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec920be640 1 -- 172.21.15.62:0/1418236902 shutdown_connections 2023-05-15T16:39:57.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec920be640 1 -- 172.21.15.62:0/1418236902 wait complete. 2023-05-15T16:39:57.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec920be640 1 Processor -- start 2023-05-15T16:39:57.481 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec920be640 1 -- start start 2023-05-15T16:39:57.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec920be640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fec8c0b5e70 0x7fec8c1356d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:57.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec920be640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec8c0b7910 0x7fec8c13e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:57.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec920be640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec8c14f4c0 0x7fec8c137c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:57.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec920be640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c0b9b20 con 0x7fec8c14f4c0 2023-05-15T16:39:57.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec920be640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c0ba6a0 con 0x7fec8c0b7910 2023-05-15T16:39:57.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec920be640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec8c0b9d70 con 0x7fec8c0b5e70 2023-05-15T16:39:57.482 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec8bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec8c14f4c0 0x7fec8c137c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:57.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec8bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec8c14f4c0 0x7fec8c137c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50804/0 (socket says 172.21.15.62:50804) 2023-05-15T16:39:57.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.472+0000 7fec8bfff640 1 -- 172.21.15.62:0/2137516130 learned_addr learned my addr 172.21.15.62:0/2137516130 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:57.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.476+0000 7fec8b7fe640 1 --2- 172.21.15.62:0/2137516130 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fec8c0b5e70 0x7fec8c1356d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:57.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.476+0000 7fec8affd640 1 --2- 172.21.15.62:0/2137516130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec8c0b7910 0x7fec8c13e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:57.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.476+0000 7fec8bfff640 1 -- 172.21.15.62:0/2137516130 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fec8c0b5e70 msgr2=0x7fec8c1356d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:57.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.476+0000 7fec8bfff640 1 --2- 172.21.15.62:0/2137516130 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fec8c0b5e70 0x7fec8c1356d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.483 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.476+0000 7fec8bfff640 1 -- 172.21.15.62:0/2137516130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec8c0b7910 msgr2=0x7fec8c13e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:57.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.476+0000 7fec8bfff640 1 --2- 172.21.15.62:0/2137516130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec8c0b7910 0x7fec8c13e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.476+0000 7fec8bfff640 1 -- 172.21.15.62:0/2137516130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c00b770 con 0x7fec8c14f4c0 2023-05-15T16:39:57.484 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.476+0000 7fec8affd640 1 --2- 172.21.15.62:0/2137516130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec8c0b7910 0x7fec8c13e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:39:57.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.476+0000 7fec8bfff640 1 --2- 172.21.15.62:0/2137516130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec8c14f4c0 0x7fec8c137c20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fec84007d70 tx=0x7fec8400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:57.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.476+0000 7fec73fff640 1 -- 172.21.15.62:0/2137516130 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec84014420 con 0x7fec8c14f4c0 2023-05-15T16:39:57.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.476+0000 7fec73fff640 1 -- 172.21.15.62:0/2137516130 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec840145a0 con 0x7fec8c14f4c0 2023-05-15T16:39:57.485 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.476+0000 7fec73fff640 1 -- 172.21.15.62:0/2137516130 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec84014950 con 0x7fec8c14f4c0 2023-05-15T16:39:57.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.476+0000 7fec920be640 1 -- 172.21.15.62:0/2137516130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec8c0b34c0 con 0x7fec8c14f4c0 2023-05-15T16:39:57.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.476+0000 7fec920be640 1 -- 172.21.15.62:0/2137516130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec8c0b4710 con 0x7fec8c14f4c0 2023-05-15T16:39:57.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.476+0000 7fec920be640 1 -- 172.21.15.62:0/2137516130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec8c0b2a90 con 0x7fec8c14f4c0 2023-05-15T16:39:57.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.476+0000 7fec73fff640 1 -- 172.21.15.62:0/2137516130 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fec84014ab0 con 0x7fec8c14f4c0 2023-05-15T16:39:57.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.476+0000 7fec73fff640 1 --2- 172.21.15.62:0/2137516130 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fec78065380 0x7fec78067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:57.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.476+0000 7fec73fff640 1 -- 172.21.15.62:0/2137516130 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fec84083ce0 con 0x7fec8c14f4c0 2023-05-15T16:39:57.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.476+0000 7fec8b7fe640 1 --2- 172.21.15.62:0/2137516130 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fec78065380 0x7fec78067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:57.487 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.476+0000 7fec8b7fe640 1 --2- 172.21.15.62:0/2137516130 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fec78065380 0x7fec78067830 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fec80004e30 tx=0x7fec80009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:57.488 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.480+0000 7fec73fff640 1 -- 172.21.15.62:0/2137516130 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fec84055730 con 0x7fec8c14f4c0 2023-05-15T16:39:57.637 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.632+0000 7fec920be640 1 -- 172.21.15.62:0/2137516130 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fec8c067960 con 0x7fec8c14f4c0 2023-05-15T16:39:57.638 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.632+0000 7fec73fff640 1 -- 172.21.15.62:0/2137516130 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7fec84055320 con 0x7fec8c14f4c0 2023-05-15T16:39:57.638 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-05-15T16:39:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.632+0000 7fec920be640 1 -- 172.21.15.62:0/2137516130 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fec78065380 msgr2=0x7fec78067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.632+0000 7fec920be640 1 --2- 172.21.15.62:0/2137516130 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fec78065380 0x7fec78067830 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fec80004e30 tx=0x7fec80009040 comp rx=0 tx=0).stop 2023-05-15T16:39:57.640 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.632+0000 7fec920be640 1 -- 172.21.15.62:0/2137516130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec8c14f4c0 msgr2=0x7fec8c137c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.632+0000 7fec920be640 1 --2- 172.21.15.62:0/2137516130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec8c14f4c0 0x7fec8c137c20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fec84007d70 tx=0x7fec8400e4b0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.632+0000 7fec920be640 1 -- 172.21.15.62:0/2137516130 shutdown_connections 2023-05-15T16:39:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.632+0000 7fec920be640 1 --2- 172.21.15.62:0/2137516130 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fec78065380 0x7fec78067830 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.632+0000 7fec920be640 1 --2- 172.21.15.62:0/2137516130 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fec8c14f4c0 0x7fec8c137c20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.632+0000 7fec920be640 1 --2- 172.21.15.62:0/2137516130 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fec8c0b7910 0x7fec8c13e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.632+0000 7fec920be640 1 --2- 172.21.15.62:0/2137516130 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fec8c0b5e70 0x7fec8c1356d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.632+0000 7fec920be640 1 -- 172.21.15.62:0/2137516130 >> 172.21.15.62:0/2137516130 conn(0x7fec8c0697b0 msgr2=0x7fec8c142540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:57.641 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.632+0000 7fec920be640 1 -- 172.21.15.62:0/2137516130 shutdown_connections 2023-05-15T16:39:57.642 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.632+0000 7fec920be640 1 -- 172.21.15.62:0/2137516130 wait complete. 2023-05-15T16:39:57.655 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-15T16:39:57.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.768+0000 7f92bca38640 1 Processor -- start 2023-05-15T16:39:57.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.768+0000 7f92bca38640 1 -- start start 2023-05-15T16:39:57.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.768+0000 7f92bca38640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f92b80bcd50 0x7f92b80bdd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:57.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.768+0000 7f92bca38640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92b814a8e0 0x7f92b806b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:57.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.768+0000 7f92bca38640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b80bac80 con 0x7f92b806b590 2023-05-15T16:39:57.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.768+0000 7f92bca38640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b8069ce0 con 0x7f92b80bcd50 2023-05-15T16:39:57.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.768+0000 7f92bca38640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b80be260 con 0x7f92b814a8e0 2023-05-15T16:39:57.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.768+0000 7f92b659c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f92b80bcd50 0x7f92b80bdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:57.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.768+0000 7f92b659c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f92b80bcd50 0x7f92b80bdd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50808/0 (socket says 172.21.15.62:50808) 2023-05-15T16:39:57.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.768+0000 7f92b659c640 1 -- 172.21.15.62:0/1223661728 learned_addr learned my addr 172.21.15.62:0/1223661728 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:57.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.768+0000 7f92b659c640 1 -- 172.21.15.62:0/1223661728 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92b814a8e0 msgr2=0x7f92b806b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:57.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.768+0000 7f92b5d9b640 1 --2- 172.21.15.62:0/1223661728 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92b814a8e0 0x7f92b806b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:57.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.768+0000 7f92b659c640 1 --2- 172.21.15.62:0/1223661728 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92b814a8e0 0x7f92b806b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.768+0000 7f92b659c640 1 -- 172.21.15.62:0/1223661728 >> v1:172.21.15.161:6789/0 conn(0x7f92b806b590 legacy=0x7f92b814d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:57.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.768+0000 7f92b659c640 1 -- 172.21.15.62:0/1223661728 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b80bd120 con 0x7f92b80bcd50 2023-05-15T16:39:57.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92b659c640 1 --2- 172.21.15.62:0/1223661728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92b80bcd50 0x7f92b80bdd20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009870 tx=0x7f92a001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61d60b474fa6441f server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92b559a640 1 -- 172.21.15.62:0/1223661728 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a00a89b0 con 0x7f92b80bcd50 2023-05-15T16:39:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92b559a640 1 -- 172.21.15.62:0/1223661728 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a00a8b10 con 0x7f92b80bcd50 2023-05-15T16:39:57.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92b559a640 1 -- 172.21.15.62:0/1223661728 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a00a8ea0 con 0x7f92b80bcd50 2023-05-15T16:39:57.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92bca38640 1 -- 172.21.15.62:0/1223661728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92b80bcd50 msgr2=0x7f92b80bdd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:57.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92bca38640 1 --2- 172.21.15.62:0/1223661728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92b80bcd50 0x7f92b80bdd20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f92a0009870 tx=0x7f92a001ecf0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92bca38640 1 -- 172.21.15.62:0/1223661728 shutdown_connections 2023-05-15T16:39:57.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92bca38640 1 --2- 172.21.15.62:0/1223661728 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92b814a8e0 0x7f92b806b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92bca38640 1 --2- 172.21.15.62:0/1223661728 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92b80bcd50 0x7f92b80bdd20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92bca38640 1 -- 172.21.15.62:0/1223661728 >> 172.21.15.62:0/1223661728 conn(0x7f92b80a1ad0 msgr2=0x7f92b80a1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:57.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92bca38640 1 -- 172.21.15.62:0/1223661728 shutdown_connections 2023-05-15T16:39:57.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92bca38640 1 -- 172.21.15.62:0/1223661728 wait complete. 2023-05-15T16:39:57.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92bca38640 1 Processor -- start 2023-05-15T16:39:57.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92bca38640 1 -- start start 2023-05-15T16:39:57.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92bca38640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92b806b590 0x7f92b81e2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:57.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92bca38640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92b80bcd50 0x7f92b8146c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:57.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92bca38640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92b814a8e0 0x7f92b81456e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:57.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92bca38640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b80a3f20 con 0x7f92b814a8e0 2023-05-15T16:39:57.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92bca38640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b81e29c0 con 0x7f92b806b590 2023-05-15T16:39:57.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92bca38640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b8146190 con 0x7f92b80bcd50 2023-05-15T16:39:57.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92b6d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92b814a8e0 0x7f92b81456e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:57.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92b6d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92b814a8e0 0x7f92b81456e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50820/0 (socket says 172.21.15.62:50820) 2023-05-15T16:39:57.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.772+0000 7f92b6d9d640 1 -- 172.21.15.62:0/1475574435 learned_addr learned my addr 172.21.15.62:0/1475574435 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:57.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.776+0000 7f92b5d9b640 1 --2- 172.21.15.62:0/1475574435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92b80bcd50 0x7f92b8146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:57.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.776+0000 7f92b659c640 1 --2- 172.21.15.62:0/1475574435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92b806b590 0x7f92b81e2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:57.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.776+0000 7f92b6d9d640 1 -- 172.21.15.62:0/1475574435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92b80bcd50 msgr2=0x7f92b8146c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:57.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.776+0000 7f92b6d9d640 1 --2- 172.21.15.62:0/1475574435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92b80bcd50 0x7f92b8146c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.776+0000 7f92b6d9d640 1 -- 172.21.15.62:0/1475574435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92b806b590 msgr2=0x7f92b81e2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:57.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.776+0000 7f92b6d9d640 1 --2- 172.21.15.62:0/1475574435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92b806b590 0x7f92b81e2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.776+0000 7f92b6d9d640 1 -- 172.21.15.62:0/1475574435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a00094d0 con 0x7f92b814a8e0 2023-05-15T16:39:57.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.776+0000 7f92b5d9b640 1 --2- 172.21.15.62:0/1475574435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92b80bcd50 0x7f92b8146c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:39:57.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.776+0000 7f92b659c640 1 --2- 172.21.15.62:0/1475574435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92b806b590 0x7f92b81e2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:39:57.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.776+0000 7f92b6d9d640 1 --2- 172.21.15.62:0/1475574435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92b814a8e0 0x7f92b81456e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f92b000c780 tx=0x7f92b000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:57.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.776+0000 7f92aeffd640 1 -- 172.21.15.62:0/1475574435 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b0004b70 con 0x7f92b814a8e0 2023-05-15T16:39:57.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.776+0000 7f92aeffd640 1 -- 172.21.15.62:0/1475574435 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b000ce90 con 0x7f92b814a8e0 2023-05-15T16:39:57.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.776+0000 7f92bca38640 1 -- 172.21.15.62:0/1475574435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b814a0e0 con 0x7f92b814a8e0 2023-05-15T16:39:57.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.776+0000 7f92aeffd640 1 -- 172.21.15.62:0/1475574435 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b000a850 con 0x7f92b814a8e0 2023-05-15T16:39:57.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.776+0000 7f92bca38640 1 -- 172.21.15.62:0/1475574435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b8149e00 con 0x7f92b814a8e0 2023-05-15T16:39:57.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.776+0000 7f92bca38640 1 -- 172.21.15.62:0/1475574435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b814a3c0 con 0x7f92b814a8e0 2023-05-15T16:39:57.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.776+0000 7f92aeffd640 1 -- 172.21.15.62:0/1475574435 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f92b000a9b0 con 0x7f92b814a8e0 2023-05-15T16:39:57.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.776+0000 7f92aeffd640 1 --2- 172.21.15.62:0/1475574435 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9298065380 0x7f9298067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:57.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.776+0000 7f92aeffd640 1 -- 172.21.15.62:0/1475574435 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f92b00825c0 con 0x7f92b814a8e0 2023-05-15T16:39:57.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.776+0000 7f92b659c640 1 --2- 172.21.15.62:0/1475574435 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9298065380 0x7f9298067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:57.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.776+0000 7f92b659c640 1 --2- 172.21.15.62:0/1475574435 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9298065380 0x7f9298067830 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f92a00b2000 tx=0x7f92a0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:57.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.780+0000 7f92aeffd640 1 -- 172.21.15.62:0/1475574435 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f92b0054050 con 0x7f92b814a8e0 2023-05-15T16:39:57.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.959+0000 7f92bca38640 1 -- 172.21.15.62:0/1475574435 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f92b8067960 con 0x7f92b814a8e0 2023-05-15T16:39:57.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.963+0000 7f92aeffd640 1 -- 172.21.15.62:0/1475574435 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2771 (secure 0 0 0) 0x7f92b0053c40 con 0x7f92b814a8e0 2023-05-15T16:39:57.971 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:39:57.971 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1731611654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1731611654},{"type":"v1","addr":"172.21.15.161:6835","nonce":1731611654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2563537601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2563537601},{"type":"v1","addr":"172.21.15.62:6834","nonce":2563537601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6835/2804159919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2804159919},{"type":"v1","addr":"172.21.15.62:6835","nonce":2804159919}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-05-15T16:39:57.972 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 3 2023-05-15T16:39:57.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.963+0000 7f92bca38640 1 -- 172.21.15.62:0/1475574435 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9298065380 msgr2=0x7f9298067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:57.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.963+0000 7f92bca38640 1 --2- 172.21.15.62:0/1475574435 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9298065380 0x7f9298067830 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f92a00b2000 tx=0x7f92a0008040 comp rx=0 tx=0).stop 2023-05-15T16:39:57.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.963+0000 7f92bca38640 1 -- 172.21.15.62:0/1475574435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92b814a8e0 msgr2=0x7f92b81456e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:57.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.963+0000 7f92bca38640 1 --2- 172.21.15.62:0/1475574435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92b814a8e0 0x7f92b81456e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f92b000c780 tx=0x7f92b000cc40 comp rx=0 tx=0).stop 2023-05-15T16:39:57.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.963+0000 7f92bca38640 1 -- 172.21.15.62:0/1475574435 shutdown_connections 2023-05-15T16:39:57.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.963+0000 7f92bca38640 1 --2- 172.21.15.62:0/1475574435 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9298065380 0x7f9298067830 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.963+0000 7f92bca38640 1 --2- 172.21.15.62:0/1475574435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f92b814a8e0 0x7f92b81456e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.963+0000 7f92bca38640 1 --2- 172.21.15.62:0/1475574435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f92b80bcd50 0x7f92b8146c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.963+0000 7f92bca38640 1 --2- 172.21.15.62:0/1475574435 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f92b806b590 0x7f92b81e2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:57.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.963+0000 7f92bca38640 1 -- 172.21.15.62:0/1475574435 >> 172.21.15.62:0/1475574435 conn(0x7f92b80a1ad0 msgr2=0x7f92b81d6280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:57.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.963+0000 7f92bca38640 1 -- 172.21.15.62:0/1475574435 shutdown_connections 2023-05-15T16:39:57.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:57.963+0000 7f92bca38640 1 -- 172.21.15.62:0/1475574435 wait complete. 2023-05-15T16:39:57.988 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-15T16:39:58.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.091+0000 7f0569af5640 1 Processor -- start 2023-05-15T16:39:58.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.091+0000 7f0569af5640 1 -- start start 2023-05-15T16:39:58.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f0569af5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05640b2500 0x7f05640b4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:58.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f0569af5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f05640b91d0 0x7f05640b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:58.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f0569af5640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05640b2140 con 0x7f05640b1d70 2023-05-15T16:39:58.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f0569af5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05640b2990 con 0x7f05640b91d0 2023-05-15T16:39:58.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f0569af5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05640b4ba0 con 0x7f05640b2500 2023-05-15T16:39:58.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f05637fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f05640b1d70 0x7f0564146090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48960/0 (socket says 172.21.15.62:48960) 2023-05-15T16:39:58.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f05637fe640 1 -- 172.21.15.62:0/1035309812 learned_addr learned my addr 172.21.15.62:0/1035309812 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:39:58.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f05627fc640 1 -- 172.21.15.62:0/1035309812 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1233682129 0 0) 0x7f05640b2140 con 0x7f05640b1d70 2023-05-15T16:39:58.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f05627fc640 1 -- 172.21.15.62:0/1035309812 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f054c003530 con 0x7f05640b1d70 2023-05-15T16:39:58.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f0563fff640 1 --2- 172.21.15.62:0/1035309812 >> v2:172.21.15.161:3300/0 conn(0x7f05640b91d0 0x7f05640b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:58.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f0562ffd640 1 --2- 172.21.15.62:0/1035309812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05640b2500 0x7f05640b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:58.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f05627fc640 1 -- 172.21.15.62:0/1035309812 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2983910418 0 0) 0x7f054c003530 con 0x7f05640b1d70 2023-05-15T16:39:58.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f05627fc640 1 -- 172.21.15.62:0/1035309812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05640b2500 msgr2=0x7f05640b4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:58.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f05627fc640 1 --2- 172.21.15.62:0/1035309812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05640b2500 0x7f05640b4120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f05627fc640 1 -- 172.21.15.62:0/1035309812 >> v2:172.21.15.161:3300/0 conn(0x7f05640b91d0 msgr2=0x7f05640b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:58.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f05627fc640 1 --2- 172.21.15.62:0/1035309812 >> v2:172.21.15.161:3300/0 conn(0x7f05640b91d0 0x7f05640b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f05627fc640 1 -- 172.21.15.62:0/1035309812 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05640b3060 con 0x7f05640b1d70 2023-05-15T16:39:58.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f05627fc640 1 -- 172.21.15.62:0/1035309812 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7f0554001680 con 0x7f05640b1d70 2023-05-15T16:39:58.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f05627fc640 1 -- 172.21.15.62:0/1035309812 >> v1:172.21.15.62:6789/0 conn(0x7f05640b1d70 legacy=0x7f0564146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:58.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f05627fc640 1 --2- 172.21.15.62:0/1035309812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f054c003980 0x7f054c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:58.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f05627fc640 1 --2- 172.21.15.62:0/1035309812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05640b2500 0x7f054c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:58.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f05627fc640 1 --2- 172.21.15.62:0/1035309812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f054c004d10 0x7f054c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f05627fc640 1 -- 172.21.15.62:0/1035309812 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05640b2990 con 0x7f054c004d10 2023-05-15T16:39:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f05627fc640 1 -- 172.21.15.62:0/1035309812 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05640b4ba0 con 0x7f054c003980 2023-05-15T16:39:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f05627fc640 1 -- 172.21.15.62:0/1035309812 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054c00ba40 con 0x7f05640b2500 2023-05-15T16:39:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f0563fff640 1 --2- 172.21.15.62:0/1035309812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f054c004d10 0x7f054c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f05637fe640 1 --2- 172.21.15.62:0/1035309812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f054c003980 0x7f054c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f0562ffd640 1 --2- 172.21.15.62:0/1035309812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05640b2500 0x7f054c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:58.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f0563fff640 1 -- 172.21.15.62:0/1035309812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05640b2500 msgr2=0x7f054c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f0563fff640 1 --2- 172.21.15.62:0/1035309812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05640b2500 0x7f054c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f0563fff640 1 -- 172.21.15.62:0/1035309812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f054c003980 msgr2=0x7f054c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f0563fff640 1 --2- 172.21.15.62:0/1035309812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f054c003980 0x7f054c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f0563fff640 1 -- 172.21.15.62:0/1035309812 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f054c003530 con 0x7f054c004d10 2023-05-15T16:39:58.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.095+0000 7f0562ffd640 1 --2- 172.21.15.62:0/1035309812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05640b2500 0x7f054c0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:39:58.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0563fff640 1 --2- 172.21.15.62:0/1035309812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f054c004d10 0x7f054c005180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f056406b3d0 tx=0x7f055c01ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a80013ae9a49a4 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:58.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f05627fc640 1 -- 172.21.15.62:0/1035309812 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c0a5d00 con 0x7f054c004d10 2023-05-15T16:39:58.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f05627fc640 1 -- 172.21.15.62:0/1035309812 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055c0a5e60 con 0x7f054c004d10 2023-05-15T16:39:58.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f05627fc640 1 -- 172.21.15.62:0/1035309812 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c0ad680 con 0x7f054c004d10 2023-05-15T16:39:58.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0569af5640 1 -- 172.21.15.62:0/1035309812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f054c004d10 msgr2=0x7f054c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:58.111 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0569af5640 1 --2- 172.21.15.62:0/1035309812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f054c004d10 0x7f054c005180 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f056406b3d0 tx=0x7f055c01ce00 comp rx=0 tx=0).stop 2023-05-15T16:39:58.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0563fff640 1 -- 172.21.15.62:0/1035309812 reap_dead start 2023-05-15T16:39:58.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0569af5640 1 -- 172.21.15.62:0/1035309812 shutdown_connections 2023-05-15T16:39:58.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0569af5640 1 -- 172.21.15.62:0/1035309812 >> 172.21.15.62:0/1035309812 conn(0x7f05640653f0 msgr2=0x7f05640697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:58.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0569af5640 1 -- 172.21.15.62:0/1035309812 shutdown_connections 2023-05-15T16:39:58.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0569af5640 1 -- 172.21.15.62:0/1035309812 wait complete. 2023-05-15T16:39:58.112 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0569af5640 1 Processor -- start 2023-05-15T16:39:58.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0569af5640 1 -- start start 2023-05-15T16:39:58.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0569af5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05641de340 0x7f05641dabe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:58.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0569af5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05641dedb0 0x7f05641db120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:58.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0569af5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05641db660 0x7f056406f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:58.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0569af5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056413dde0 con 0x7f05641dedb0 2023-05-15T16:39:58.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0569af5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056406ef20 con 0x7f05641de340 2023-05-15T16:39:58.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0569af5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056406f200 con 0x7f05641db660 2023-05-15T16:39:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0562ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05641dedb0 0x7f05641db120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0562ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05641dedb0 0x7f05641db120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50838/0 (socket says 172.21.15.62:50838) 2023-05-15T16:39:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0562ffd640 1 -- 172.21.15.62:0/165957353 learned_addr learned my addr 172.21.15.62:0/165957353 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0563fff640 1 --2- 172.21.15.62:0/165957353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05641db660 0x7f056406f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f05637fe640 1 --2- 172.21.15.62:0/165957353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05641de340 0x7f05641dabe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0562ffd640 1 -- 172.21.15.62:0/165957353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05641db660 msgr2=0x7f056406f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:58.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0562ffd640 1 --2- 172.21.15.62:0/165957353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05641db660 0x7f056406f9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0562ffd640 1 -- 172.21.15.62:0/165957353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05641de340 msgr2=0x7f05641dabe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:58.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0562ffd640 1 --2- 172.21.15.62:0/165957353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05641de340 0x7f05641dabe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0562ffd640 1 -- 172.21.15.62:0/165957353 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05640b3620 con 0x7f05641dedb0 2023-05-15T16:39:58.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0562ffd640 1 --2- 172.21.15.62:0/165957353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05641dedb0 0x7f05641db120 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f055800e810 tx=0x7f055800ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:58.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f054bfff640 1 -- 172.21.15.62:0/165957353 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055800c6d0 con 0x7f05641dedb0 2023-05-15T16:39:58.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f054bfff640 1 -- 172.21.15.62:0/165957353 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055800c830 con 0x7f05641dedb0 2023-05-15T16:39:58.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.099+0000 7f0569af5640 1 -- 172.21.15.62:0/165957353 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05640b3340 con 0x7f05641dedb0 2023-05-15T16:39:58.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.103+0000 7f054bfff640 1 -- 172.21.15.62:0/165957353 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055800cba0 con 0x7f05641dedb0 2023-05-15T16:39:58.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.103+0000 7f0569af5640 1 -- 172.21.15.62:0/165957353 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05640b3b40 con 0x7f05641dedb0 2023-05-15T16:39:58.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.103+0000 7f0569af5640 1 -- 172.21.15.62:0/165957353 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05640b5420 con 0x7f05641dedb0 2023-05-15T16:39:58.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.103+0000 7f054bfff640 1 -- 172.21.15.62:0/165957353 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f055800cd00 con 0x7f05641dedb0 2023-05-15T16:39:58.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.103+0000 7f054bfff640 1 --2- 172.21.15.62:0/165957353 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f05500652e0 0x7f0550067790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:58.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.103+0000 7f054bfff640 1 -- 172.21.15.62:0/165957353 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f05580823e0 con 0x7f05641dedb0 2023-05-15T16:39:58.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.103+0000 7f05637fe640 1 --2- 172.21.15.62:0/165957353 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f05500652e0 0x7f0550067790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:58.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.103+0000 7f05637fe640 1 --2- 172.21.15.62:0/165957353 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f05500652e0 0x7f0550067790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0554000c10 tx=0x7f0554009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:58.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.107+0000 7f054bfff640 1 -- 172.21.15.62:0/165957353 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f0558050390 con 0x7f05641dedb0 2023-05-15T16:39:58.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.259+0000 7f0569af5640 1 -- 172.21.15.62:0/165957353 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0564067960 con 0x7f05641dedb0 2023-05-15T16:39:58.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.259+0000 7f054bfff640 1 -- 172.21.15.62:0/165957353 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+14168 (secure 0 0 0) 0x7f05580539b0 con 0x7f05641dedb0 2023-05-15T16:39:58.269 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:39:58.269 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":19,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:39:57.676429+0000","last_up_change":"2023-05-15T16:39:48.597049+0000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-15T16:39:49.394028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-15T16:39:55.208679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37594},{"type":"v1","addr":"172.21.15.62:6825","nonce":37594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37594},{"type":"v1","addr":"172.21.15.62:6827","nonce":37594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37594},{"type":"v1","addr":"172.21.15.62:6831","nonce":37594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37594},{"type":"v1","addr":"172.21.15.62:6829","nonce":37594}]},"public_addr":"172.21.15.62:6825/37594","cluster_addr":"172.21.15.62:6827/37594","heartbeat_back_addr":"172.21.15.62:6831/37594","heartbeat_front_addr":"172.21.15.62:6829/37594","state":["exists","up"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37592},{"type":"v1","addr":"172.21.15.62:6808","nonce":37592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":37592},{"type":"v1","addr":"172.21.15.62:6814","nonce":37592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6821","nonce":37592},{"type":"v1","addr":"172.21.15.62:6823","nonce":37592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37592},{"type":"v1","addr":"172.21.15.62:6818","nonce":37592}]},"public_addr":"172.21.15.62:6808/37592","cluster_addr":"172.21.15.62:6814/37592","heartbeat_back_addr":"172.21.15.62:6823/37592","heartbeat_front_addr":"172.21.15.62:6818/37592","state":["exists","up"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":37591},{"type":"v1","addr":"172.21.15.62:6810","nonce":37591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":37591},{"type":"v1","addr":"172.21.15.62:6815","nonce":37591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37591},{"type":"v1","addr":"172.21.15.62:6822","nonce":37591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":37591},{"type":"v1","addr":"172.21.15.62:6819","nonce":37591}]},"public_addr":"172.21.15.62:6810/37591","cluster_addr":"172.21.15.62:6815/37591","heartbeat_back_addr":"172.21.15.62:6822/37591","heartbeat_front_addr":"172.21.15.62:6819/37591","state":["exists","up"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37593},{"type":"v1","addr":"172.21.15.62:6801","nonce":37593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37593},{"type":"v1","addr":"172.21.15.62:6803","nonce":37593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":37593},{"type":"v1","addr":"172.21.15.62:6812","nonce":37593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37593},{"type":"v1","addr":"172.21.15.62:6805","nonce":37593}]},"public_addr":"172.21.15.62:6801/37593","cluster_addr":"172.21.15.62:6803/37593","heartbeat_back_addr":"172.21.15.62:6812/37593","heartbeat_front_addr":"172.21.15.62:6805/37593","state":["exists","up"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37854},{"type":"v1","addr":"172.21.15.161:6801","nonce":37854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37854},{"type":"v1","addr":"172.21.15.161:6803","nonce":37854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37854},{"type":"v1","addr":"172.21.15.161:6807","nonce":37854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37854},{"type":"v1","addr":"172.21.15.161:6805","nonce":37854}]},"public_addr":"172.21.15.161:6801/37854","cluster_addr":"172.21.15.161:6803/37854","heartbeat_back_addr":"172.21.15.161:6807/37854","heartbeat_front_addr":"172.21.15.161:6805/37854","state":["exists","up"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37855},{"type":"v1","addr":"172.21.15.161:6810","nonce":37855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37855},{"type":"v1","addr":"172.21.15.161:6815","nonce":37855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37855},{"type":"v1","addr":"172.21.15.161:6824","nonce":37855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37855},{"type":"v1","addr":"172.21.15.161:6820","nonce":37855}]},"public_addr":"172.21.15.161:6810/37855","cluster_addr":"172.21.15.161:6815/37855","heartbeat_back_addr":"172.21.15.161:6824/37855","heartbeat_front_addr":"172.21.15.161:6820/37855","state":["exists","up"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":37856},{"type":"v1","addr":"172.21.15.161:6814","nonce":37856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37856},{"type":"v1","addr":"172.21.15.161:6819","nonce":37856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":37856},{"type":"v1","addr":"172.21.15.161:6830","nonce":37856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37856},{"type":"v1","addr":"172.21.15.161:6826","nonce":37856}]},"public_addr":"172.21.15.161:6814/37856","cluster_addr":"172.21.15.161:6819/37856","heartbeat_back_addr":"172.21.15.161:6830/37856","heartbeat_front_addr":"172.21.15.161:6826/37856","state":["exists","up"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":37857},{"type":"v1","addr":"172.21.15.161:6813","nonce":37857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":37857},{"type":"v1","addr":"172.21.15.161:6821","nonce":37857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":37857},{"type":"v1","addr":"172.21.15.161:6831","nonce":37857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":37857},{"type":"v1","addr":"172.21.15.161:6827","nonce":37857}]},"public_addr":"172.21.15.161:6813/37857","cluster_addr":"172.21.15.161:6821/37857","heartbeat_back_addr":"172.21.15.161:6831/37857","heartbeat_front_addr":"172.21.15.161:6827/37857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.592907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.618143+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.641533+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.614355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.579293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.718353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.730135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.792887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:39:58.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.263+0000 7f0569af5640 1 -- 172.21.15.62:0/165957353 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f05500652e0 msgr2=0x7f0550067790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:58.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.263+0000 7f0569af5640 1 --2- 172.21.15.62:0/165957353 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f05500652e0 0x7f0550067790 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f0554000c10 tx=0x7f0554009040 comp rx=0 tx=0).stop 2023-05-15T16:39:58.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.263+0000 7f0569af5640 1 -- 172.21.15.62:0/165957353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05641dedb0 msgr2=0x7f05641db120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:58.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.263+0000 7f0569af5640 1 --2- 172.21.15.62:0/165957353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05641dedb0 0x7f05641db120 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f055800e810 tx=0x7f055800ecd0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.263+0000 7f0569af5640 1 -- 172.21.15.62:0/165957353 shutdown_connections 2023-05-15T16:39:58.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.263+0000 7f0569af5640 1 --2- 172.21.15.62:0/165957353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f05641db660 0x7f056406f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.263+0000 7f0569af5640 1 --2- 172.21.15.62:0/165957353 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f05500652e0 0x7f0550067790 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.263+0000 7f0569af5640 1 --2- 172.21.15.62:0/165957353 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f05641dedb0 0x7f05641db120 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.263+0000 7f0569af5640 1 --2- 172.21.15.62:0/165957353 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05641de340 0x7f05641dabe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.263+0000 7f0569af5640 1 -- 172.21.15.62:0/165957353 >> 172.21.15.62:0/165957353 conn(0x7f05640653f0 msgr2=0x7f0564142d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:58.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.263+0000 7f0569af5640 1 -- 172.21.15.62:0/165957353 shutdown_connections 2023-05-15T16:39:58.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.263+0000 7f0569af5640 1 -- 172.21.15.62:0/165957353 wait complete. 2023-05-15T16:39:58.287 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-15T16:39:49.394028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-15T16:39:55.208679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-15T16:39:58.287 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-15T16:39:58.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.403+0000 7fd3a2baa640 1 Processor -- start 2023-05-15T16:39:58.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.403+0000 7fd3a2baa640 1 -- start start 2023-05-15T16:39:58.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.407+0000 7fd3a2baa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd39c0703f0 0x7fd39c070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:58.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.407+0000 7fd3a2baa640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd39c0b7e30 0x7fd39c0b82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:58.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.407+0000 7fd3a2baa640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd39c071d10 con 0x7fd39c069a10 2023-05-15T16:39:58.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.407+0000 7fd3a2baa640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd39c0b87f0 con 0x7fd39c0b7e30 2023-05-15T16:39:58.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.407+0000 7fd3a2baa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c071470 con 0x7fd39c0703f0 2023-05-15T16:39:58.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.407+0000 7fd3a1147640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd39c0b7e30 0x7fd39c0b82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:58.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.407+0000 7fd3a1147640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd39c0b7e30 0x7fd39c0b82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50840/0 (socket says 172.21.15.62:50840) 2023-05-15T16:39:58.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.407+0000 7fd3a1147640 1 -- 172.21.15.62:0/2824563108 learned_addr learned my addr 172.21.15.62:0/2824563108 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:58.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.407+0000 7fd39bfff640 1 --2- 172.21.15.62:0/2824563108 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd39c0703f0 0x7fd39c070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:58.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.407+0000 7fd3a1147640 1 -- 172.21.15.62:0/2824563108 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd39c0703f0 msgr2=0x7fd39c070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:58.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.407+0000 7fd3a1147640 1 --2- 172.21.15.62:0/2824563108 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd39c0703f0 0x7fd39c070e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.407+0000 7fd3a1147640 1 -- 172.21.15.62:0/2824563108 >> v1:172.21.15.161:6789/0 conn(0x7fd39c069a10 legacy=0x7fd39c143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:58.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.407+0000 7fd3a1147640 1 -- 172.21.15.62:0/2824563108 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd39c071750 con 0x7fd39c0b7e30 2023-05-15T16:39:58.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.407+0000 7fd3a1147640 1 --2- 172.21.15.62:0/2824563108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd39c0b7e30 0x7fd39c0b82b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd39c06fe30 tx=0x7fd39401c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e00232f1e0c8f31 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:58.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.407+0000 7fd39b7fe640 1 -- 172.21.15.62:0/2824563108 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3940a5690 con 0x7fd39c0b7e30 2023-05-15T16:39:58.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.407+0000 7fd39b7fe640 1 -- 172.21.15.62:0/2824563108 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3940a57f0 con 0x7fd39c0b7e30 2023-05-15T16:39:58.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.407+0000 7fd39b7fe640 1 -- 172.21.15.62:0/2824563108 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3940a5b80 con 0x7fd39c0b7e30 2023-05-15T16:39:58.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a2baa640 1 -- 172.21.15.62:0/2824563108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd39c0b7e30 msgr2=0x7fd39c0b82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:58.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a2baa640 1 --2- 172.21.15.62:0/2824563108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd39c0b7e30 0x7fd39c0b82b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd39c06fe30 tx=0x7fd39401c900 comp rx=0 tx=0).stop 2023-05-15T16:39:58.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a2baa640 1 -- 172.21.15.62:0/2824563108 shutdown_connections 2023-05-15T16:39:58.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a2baa640 1 --2- 172.21.15.62:0/2824563108 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd39c0b7e30 0x7fd39c0b82b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a2baa640 1 --2- 172.21.15.62:0/2824563108 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd39c0703f0 0x7fd39c070e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a2baa640 1 -- 172.21.15.62:0/2824563108 >> 172.21.15.62:0/2824563108 conn(0x7fd39c06a8c0 msgr2=0x7fd39c06acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:58.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a2baa640 1 -- 172.21.15.62:0/2824563108 shutdown_connections 2023-05-15T16:39:58.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a2baa640 1 -- 172.21.15.62:0/2824563108 wait complete. 2023-05-15T16:39:58.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a2baa640 1 Processor -- start 2023-05-15T16:39:58.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a2baa640 1 -- start start 2023-05-15T16:39:58.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a2baa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd39c069a10 0x7fd39c1e1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:58.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a2baa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd39c0703f0 0x7fd39c13f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:58.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a2baa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd39c0b7e30 0x7fd39c0b4570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:58.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a2baa640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c1464d0 con 0x7fd39c0b7e30 2023-05-15T16:39:58.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a2baa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c0b40e0 con 0x7fd39c069a10 2023-05-15T16:39:58.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a2baa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd39c1461f0 con 0x7fd39c0703f0 2023-05-15T16:39:58.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a1147640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd39c0b7e30 0x7fd39c0b4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:58.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a1147640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd39c0b7e30 0x7fd39c0b4570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50844/0 (socket says 172.21.15.62:50844) 2023-05-15T16:39:58.422 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a1147640 1 -- 172.21.15.62:0/3655167329 learned_addr learned my addr 172.21.15.62:0/3655167329 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:58.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a0946640 1 --2- 172.21.15.62:0/3655167329 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd39c069a10 0x7fd39c1e1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:58.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd39bfff640 1 --2- 172.21.15.62:0/3655167329 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd39c0703f0 0x7fd39c13f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:58.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a1147640 1 -- 172.21.15.62:0/3655167329 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd39c0703f0 msgr2=0x7fd39c13f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:58.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a1147640 1 --2- 172.21.15.62:0/3655167329 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd39c0703f0 0x7fd39c13f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a1147640 1 -- 172.21.15.62:0/3655167329 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd39c069a10 msgr2=0x7fd39c1e1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:58.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a1147640 1 --2- 172.21.15.62:0/3655167329 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd39c069a10 0x7fd39c1e1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.423 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a1147640 1 -- 172.21.15.62:0/3655167329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd394009b30 con 0x7fd39c0b7e30 2023-05-15T16:39:58.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a0946640 1 --2- 172.21.15.62:0/3655167329 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd39c069a10 0x7fd39c1e1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:39:58.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd39bfff640 1 --2- 172.21.15.62:0/3655167329 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd39c0703f0 0x7fd39c13f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:39:58.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a1147640 1 --2- 172.21.15.62:0/3655167329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd39c0b7e30 0x7fd39c0b4570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd39401afb0 tx=0x7fd3940196a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:58.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3997fa640 1 -- 172.21.15.62:0/3655167329 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3940b8670 con 0x7fd39c0b7e30 2023-05-15T16:39:58.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a2baa640 1 -- 172.21.15.62:0/3655167329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd39c144190 con 0x7fd39c0b7e30 2023-05-15T16:39:58.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3997fa640 1 -- 172.21.15.62:0/3655167329 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3940b87d0 con 0x7fd39c0b7e30 2023-05-15T16:39:58.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3a2baa640 1 -- 172.21.15.62:0/3655167329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd39c0b9320 con 0x7fd39c0b7e30 2023-05-15T16:39:58.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.411+0000 7fd3997fa640 1 -- 172.21.15.62:0/3655167329 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3940b8b40 con 0x7fd39c0b7e30 2023-05-15T16:39:58.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.415+0000 7fd3a2baa640 1 -- 172.21.15.62:0/3655167329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39c144320 con 0x7fd39c0b7e30 2023-05-15T16:39:58.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.415+0000 7fd3997fa640 1 -- 172.21.15.62:0/3655167329 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fd3940b8ca0 con 0x7fd39c0b7e30 2023-05-15T16:39:58.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.415+0000 7fd3997fa640 1 --2- 172.21.15.62:0/3655167329 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd388065380 0x7fd388067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:58.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.415+0000 7fd3997fa640 1 -- 172.21.15.62:0/3655167329 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fd39411dab0 con 0x7fd39c0b7e30 2023-05-15T16:39:58.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.415+0000 7fd3a0946640 1 --2- 172.21.15.62:0/3655167329 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd388065380 0x7fd388067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:58.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.415+0000 7fd3a0946640 1 --2- 172.21.15.62:0/3655167329 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd388065380 0x7fd388067830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd38c003e40 tx=0x7fd38c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:58.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.419+0000 7fd3997fa640 1 -- 172.21.15.62:0/3655167329 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fd3940eba90 con 0x7fd39c0b7e30 2023-05-15T16:39:58.579 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.571+0000 7fd3a2baa640 1 -- 172.21.15.62:0/3655167329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd39c067960 con 0x7fd39c0b7e30 2023-05-15T16:39:58.580 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.571+0000 7fd3997fa640 1 -- 172.21.15.62:0/3655167329 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v19) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd3940ef0b0 con 0x7fd39c0b7e30 2023-05-15T16:39:58.580 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-05-15T16:39:58.582 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.575+0000 7fd3a2baa640 1 -- 172.21.15.62:0/3655167329 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd388065380 msgr2=0x7fd388067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:58.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.575+0000 7fd3a2baa640 1 --2- 172.21.15.62:0/3655167329 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd388065380 0x7fd388067830 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fd38c003e40 tx=0x7fd38c009040 comp rx=0 tx=0).stop 2023-05-15T16:39:58.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.575+0000 7fd3a2baa640 1 -- 172.21.15.62:0/3655167329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd39c0b7e30 msgr2=0x7fd39c0b4570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:58.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.575+0000 7fd3a2baa640 1 --2- 172.21.15.62:0/3655167329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd39c0b7e30 0x7fd39c0b4570 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fd39401afb0 tx=0x7fd3940196a0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.575+0000 7fd3a2baa640 1 -- 172.21.15.62:0/3655167329 shutdown_connections 2023-05-15T16:39:58.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.575+0000 7fd3a2baa640 1 --2- 172.21.15.62:0/3655167329 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd388065380 0x7fd388067830 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.583 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.575+0000 7fd3a2baa640 1 --2- 172.21.15.62:0/3655167329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd39c0b7e30 0x7fd39c0b4570 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.575+0000 7fd3a2baa640 1 --2- 172.21.15.62:0/3655167329 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd39c0703f0 0x7fd39c13f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.575+0000 7fd3a2baa640 1 --2- 172.21.15.62:0/3655167329 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd39c069a10 0x7fd39c1e1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.575+0000 7fd3a2baa640 1 -- 172.21.15.62:0/3655167329 >> 172.21.15.62:0/3655167329 conn(0x7fd39c06a8c0 msgr2=0x7fd39c0baed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:58.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.575+0000 7fd3a2baa640 1 -- 172.21.15.62:0/3655167329 shutdown_connections 2023-05-15T16:39:58.584 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.575+0000 7fd3a2baa640 1 -- 172.21.15.62:0/3655167329 wait complete. 2023-05-15T16:39:58.599 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-15T16:39:58.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.723+0000 7f42da68a640 1 Processor -- start 2023-05-15T16:39:58.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.723+0000 7f42da68a640 1 -- start start 2023-05-15T16:39:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.723+0000 7f42da68a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42d406aa20 0x7f42d4070840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.723+0000 7f42da68a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42d41407e0 0x7f42d4140c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.723+0000 7f42da68a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d4070d80 con 0x7f42d4146e20 2023-05-15T16:39:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.723+0000 7f42da68a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42d40b38f0 con 0x7f42d41407e0 2023-05-15T16:39:58.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.723+0000 7f42da68a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40b83d0 con 0x7f42d406aa20 2023-05-15T16:39:58.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.723+0000 7f42cb7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42d41407e0 0x7f42d4140c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:58.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.723+0000 7f42cb7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f42d41407e0 0x7f42d4140c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50850/0 (socket says 172.21.15.62:50850) 2023-05-15T16:39:58.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.723+0000 7f42cb7fe640 1 -- 172.21.15.62:0/3712869499 learned_addr learned my addr 172.21.15.62:0/3712869499 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:58.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.723+0000 7f42d3fff640 1 --2- 172.21.15.62:0/3712869499 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42d406aa20 0x7f42d4070840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:58.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.723+0000 7f42cb7fe640 1 -- 172.21.15.62:0/3712869499 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42d406aa20 msgr2=0x7f42d4070840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:58.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.723+0000 7f42cb7fe640 1 --2- 172.21.15.62:0/3712869499 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42d406aa20 0x7f42d4070840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.723+0000 7f42cb7fe640 1 -- 172.21.15.62:0/3712869499 >> v1:172.21.15.161:6789/0 conn(0x7f42d4146e20 legacy=0x7f42d4147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:58.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.723+0000 7f42cb7fe640 1 -- 172.21.15.62:0/3712869499 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d40b86b0 con 0x7f42d41407e0 2023-05-15T16:39:58.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.723+0000 7f42d3fff640 1 --2- 172.21.15.62:0/3712869499 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42d406aa20 0x7f42d4070840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-15T16:39:58.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.727+0000 7f42cb7fe640 1 --2- 172.21.15.62:0/3712869499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d41407e0 0x7f42d4140c30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009870 tx=0x7f42bc01c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ecdfbfe4f7e7451 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:58.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.727+0000 7f42d37fe640 1 -- 172.21.15.62:0/3712869499 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0aa670 con 0x7f42d41407e0 2023-05-15T16:39:58.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.727+0000 7f42d37fe640 1 -- 172.21.15.62:0/3712869499 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc0aa7d0 con 0x7f42d41407e0 2023-05-15T16:39:58.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.727+0000 7f42d37fe640 1 -- 172.21.15.62:0/3712869499 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0aab60 con 0x7f42d41407e0 2023-05-15T16:39:58.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.727+0000 7f42da68a640 1 -- 172.21.15.62:0/3712869499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d41407e0 msgr2=0x7f42d4140c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:58.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.727+0000 7f42da68a640 1 --2- 172.21.15.62:0/3712869499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d41407e0 0x7f42d4140c30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f42bc009870 tx=0x7f42bc01c510 comp rx=0 tx=0).stop 2023-05-15T16:39:58.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.727+0000 7f42da68a640 1 -- 172.21.15.62:0/3712869499 shutdown_connections 2023-05-15T16:39:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.727+0000 7f42da68a640 1 --2- 172.21.15.62:0/3712869499 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d41407e0 0x7f42d4140c30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.727+0000 7f42da68a640 1 --2- 172.21.15.62:0/3712869499 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42d406aa20 0x7f42d4070840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.727+0000 7f42da68a640 1 -- 172.21.15.62:0/3712869499 >> 172.21.15.62:0/3712869499 conn(0x7f42d40bd120 msgr2=0x7f42d40b8f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.727+0000 7f42da68a640 1 -- 172.21.15.62:0/3712869499 shutdown_connections 2023-05-15T16:39:58.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.727+0000 7f42da68a640 1 -- 172.21.15.62:0/3712869499 wait complete. 2023-05-15T16:39:58.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.727+0000 7f42da68a640 1 Processor -- start 2023-05-15T16:39:58.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.727+0000 7f42da68a640 1 -- start start 2023-05-15T16:39:58.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.727+0000 7f42da68a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42d406aa20 0x7f42d40b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:58.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.727+0000 7f42da68a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d41407e0 0x7f42d41e1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:58.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.727+0000 7f42da68a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42d4146e20 0x7f42d41e2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:58.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.727+0000 7f42da68a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40b4940 con 0x7f42d41407e0 2023-05-15T16:39:58.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.727+0000 7f42da68a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40ba9d0 con 0x7f42d4146e20 2023-05-15T16:39:58.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.727+0000 7f42da68a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d40bb270 con 0x7f42d406aa20 2023-05-15T16:39:58.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42cb7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d41407e0 0x7f42d41e1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:58.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42cb7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d41407e0 0x7f42d41e1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50854/0 (socket says 172.21.15.62:50854) 2023-05-15T16:39:58.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42cb7fe640 1 -- 172.21.15.62:0/2415412588 learned_addr learned my addr 172.21.15.62:0/2415412588 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:58.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42d3fff640 1 --2- 172.21.15.62:0/2415412588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42d406aa20 0x7f42d40b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:58.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42d8c27640 1 --2- 172.21.15.62:0/2415412588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42d4146e20 0x7f42d41e2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:58.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42cb7fe640 1 -- 172.21.15.62:0/2415412588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42d406aa20 msgr2=0x7f42d40b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:58.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42cb7fe640 1 --2- 172.21.15.62:0/2415412588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42d406aa20 0x7f42d40b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42cb7fe640 1 -- 172.21.15.62:0/2415412588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42d4146e20 msgr2=0x7f42d41e2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:58.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42cb7fe640 1 --2- 172.21.15.62:0/2415412588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42d4146e20 0x7f42d41e2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42cb7fe640 1 -- 172.21.15.62:0/2415412588 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42bc0094d0 con 0x7f42d41407e0 2023-05-15T16:39:58.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42cb7fe640 1 --2- 172.21.15.62:0/2415412588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d41407e0 0x7f42d41e1fe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0ac040 tx=0x7f42bc01ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:58.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42d17fa640 1 -- 172.21.15.62:0/2415412588 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0b3800 con 0x7f42d41407e0 2023-05-15T16:39:58.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42d17fa640 1 -- 172.21.15.62:0/2415412588 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42bc0b3960 con 0x7f42d41407e0 2023-05-15T16:39:58.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42da68a640 1 -- 172.21.15.62:0/2415412588 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d4071900 con 0x7f42d41407e0 2023-05-15T16:39:58.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42d17fa640 1 -- 172.21.15.62:0/2415412588 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42bc0b3d10 con 0x7f42d41407e0 2023-05-15T16:39:58.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42da68a640 1 -- 172.21.15.62:0/2415412588 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d406adf0 con 0x7f42d41407e0 2023-05-15T16:39:58.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42da68a640 1 -- 172.21.15.62:0/2415412588 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d4071a90 con 0x7f42d41407e0 2023-05-15T16:39:58.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42d17fa640 1 -- 172.21.15.62:0/2415412588 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f42bc0bd3f0 con 0x7f42d41407e0 2023-05-15T16:39:58.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42d17fa640 1 --2- 172.21.15.62:0/2415412588 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f42b40653b0 0x7f42b4067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:58.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42d17fa640 1 -- 172.21.15.62:0/2415412588 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f42bc11d1c0 con 0x7f42d41407e0 2023-05-15T16:39:58.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42d3fff640 1 --2- 172.21.15.62:0/2415412588 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f42b40653b0 0x7f42b4067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:58.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.731+0000 7f42d3fff640 1 --2- 172.21.15.62:0/2415412588 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f42b40653b0 0x7f42b4067860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f42c400c900 tx=0x7f42c4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:58.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.735+0000 7f42d17fa640 1 -- 172.21.15.62:0/2415412588 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f42bc0eb1e0 con 0x7f42d41407e0 2023-05-15T16:39:58.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.887+0000 7f42da68a640 1 -- 172.21.15.62:0/2415412588 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f42d40712f0 con 0x7f42d41407e0 2023-05-15T16:39:58.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.891+0000 7f42d17fa640 1 -- 172.21.15.62:0/2415412588 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f42bc0ee800 con 0x7f42d41407e0 2023-05-15T16:39:58.898 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-05-15T16:39:58.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.891+0000 7f42da68a640 1 -- 172.21.15.62:0/2415412588 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f42b40653b0 msgr2=0x7f42b4067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:58.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.891+0000 7f42da68a640 1 --2- 172.21.15.62:0/2415412588 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f42b40653b0 0x7f42b4067860 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f42c400c900 tx=0x7f42c4008040 comp rx=0 tx=0).stop 2023-05-15T16:39:58.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.891+0000 7f42da68a640 1 -- 172.21.15.62:0/2415412588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d41407e0 msgr2=0x7f42d41e1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:58.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.891+0000 7f42da68a640 1 --2- 172.21.15.62:0/2415412588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d41407e0 0x7f42d41e1fe0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f42bc0ac040 tx=0x7f42bc01ad50 comp rx=0 tx=0).stop 2023-05-15T16:39:58.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.891+0000 7f42da68a640 1 -- 172.21.15.62:0/2415412588 shutdown_connections 2023-05-15T16:39:58.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.891+0000 7f42da68a640 1 --2- 172.21.15.62:0/2415412588 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f42d4146e20 0x7f42d41e2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.891+0000 7f42da68a640 1 --2- 172.21.15.62:0/2415412588 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f42b40653b0 0x7f42b4067860 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.891+0000 7f42da68a640 1 --2- 172.21.15.62:0/2415412588 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f42d41407e0 0x7f42d41e1fe0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.891+0000 7f42da68a640 1 --2- 172.21.15.62:0/2415412588 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f42d406aa20 0x7f42d40b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:58.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.891+0000 7f42da68a640 1 -- 172.21.15.62:0/2415412588 >> 172.21.15.62:0/2415412588 conn(0x7f42d40bd120 msgr2=0x7f42d406eb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:58.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.891+0000 7f42da68a640 1 -- 172.21.15.62:0/2415412588 shutdown_connections 2023-05-15T16:39:58.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:58.891+0000 7f42da68a640 1 -- 172.21.15.62:0/2415412588 wait complete. 2023-05-15T16:39:58.917 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-15T16:39:59.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.031+0000 7fe15ff1d640 1 Processor -- start 2023-05-15T16:39:59.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.031+0000 7fe15ff1d640 1 -- start start 2023-05-15T16:39:59.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.031+0000 7fe15ff1d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe158143990 0x7fe158143dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:59.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.031+0000 7fe15ff1d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe158071190 con 0x7fe1580b95c0 2023-05-15T16:39:59.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.031+0000 7fe15ff1d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe158071470 con 0x7fe158069a10 2023-05-15T16:39:59.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.031+0000 7fe15ff1d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe15806fb20 con 0x7fe158143990 2023-05-15T16:39:59.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.031+0000 7fe15d4b8640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe158143990 0x7fe158143dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:59.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.031+0000 7fe15d4b8640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe158143990 0x7fe158143dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50856/0 (socket says 172.21.15.62:50856) 2023-05-15T16:39:59.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.031+0000 7fe15e4ba640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe1580b95c0 0x7fe1580b9a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48962/0 (socket says 172.21.15.62:48962) 2023-05-15T16:39:59.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.031+0000 7fe15d4b8640 1 -- 172.21.15.62:0/4254810060 learned_addr learned my addr 172.21.15.62:0/4254810060 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:59.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.031+0000 7fe15d4b8640 1 -- 172.21.15.62:0/4254810060 >> v1:172.21.15.161:6789/0 conn(0x7fe158069a10 legacy=0x7fe15806f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:59.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.031+0000 7fe15d4b8640 1 -- 172.21.15.62:0/4254810060 >> v1:172.21.15.62:6789/0 conn(0x7fe1580b95c0 legacy=0x7fe1580b9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:59.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.031+0000 7fe15ccb7640 1 -- 172.21.15.62:0/4254810060 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4282110055 0 0) 0x7fe158071190 con 0x7fe1580b95c0 2023-05-15T16:39:59.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.031+0000 7fe15d4b8640 1 -- 172.21.15.62:0/4254810060 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe158071750 con 0x7fe158143990 2023-05-15T16:39:59.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15d4b8640 1 --2- 172.21.15.62:0/4254810060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe158143990 0x7fe158143dd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009870 tx=0x7fe14c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8f83f1f204cf27 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:59.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15ccb7640 1 -- 172.21.15.62:0/4254810060 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0a8a30 con 0x7fe158143990 2023-05-15T16:39:59.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15ccb7640 1 -- 172.21.15.62:0/4254810060 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c0a8b90 con 0x7fe158143990 2023-05-15T16:39:59.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15ccb7640 1 -- 172.21.15.62:0/4254810060 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0b0440 con 0x7fe158143990 2023-05-15T16:39:59.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15ff1d640 1 -- 172.21.15.62:0/4254810060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe158143990 msgr2=0x7fe158143dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:59.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15ff1d640 1 --2- 172.21.15.62:0/4254810060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe158143990 0x7fe158143dd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe14c009870 tx=0x7fe14c01ed30 comp rx=0 tx=0).stop 2023-05-15T16:39:59.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15ff1d640 1 -- 172.21.15.62:0/4254810060 shutdown_connections 2023-05-15T16:39:59.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15ff1d640 1 --2- 172.21.15.62:0/4254810060 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe158143990 0x7fe158143dd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15ff1d640 1 -- 172.21.15.62:0/4254810060 >> 172.21.15.62:0/4254810060 conn(0x7fe15806a8c0 msgr2=0x7fe15806acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:59.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15ff1d640 1 -- 172.21.15.62:0/4254810060 shutdown_connections 2023-05-15T16:39:59.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15ff1d640 1 -- 172.21.15.62:0/4254810060 wait complete. 2023-05-15T16:39:59.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15ff1d640 1 Processor -- start 2023-05-15T16:39:59.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15ff1d640 1 -- start start 2023-05-15T16:39:59.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15ff1d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe158069a10 0x7fe158144b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:59.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15ff1d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1580b95c0 0x7fe1581d4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:59.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15ff1d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe158143990 0x7fe1580b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:59.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15ff1d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580b4130 con 0x7fe1580b95c0 2023-05-15T16:39:59.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15ff1d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580b65f0 con 0x7fe158143990 2023-05-15T16:39:59.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15ff1d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1580b51a0 con 0x7fe158069a10 2023-05-15T16:39:59.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15d4b8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1580b95c0 0x7fe1581d4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:59.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15d4b8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1580b95c0 0x7fe1581d4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50870/0 (socket says 172.21.15.62:50870) 2023-05-15T16:39:59.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15d4b8640 1 -- 172.21.15.62:0/4194701540 learned_addr learned my addr 172.21.15.62:0/4194701540 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:59.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15e4ba640 1 --2- 172.21.15.62:0/4194701540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe158143990 0x7fe1580b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:59.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15d4b8640 1 -- 172.21.15.62:0/4194701540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe158069a10 msgr2=0x7fe158144b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:59.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15d4b8640 1 --2- 172.21.15.62:0/4194701540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe158069a10 0x7fe158144b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15d4b8640 1 -- 172.21.15.62:0/4194701540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe158143990 msgr2=0x7fe1580b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:59.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.035+0000 7fe15d4b8640 1 --2- 172.21.15.62:0/4194701540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe158143990 0x7fe1580b60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.039+0000 7fe15d4b8640 1 -- 172.21.15.62:0/4194701540 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe14c0094d0 con 0x7fe1580b95c0 2023-05-15T16:39:59.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.039+0000 7fe15d4b8640 1 --2- 172.21.15.62:0/4194701540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1580b95c0 0x7fe1581d4500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0b3040 tx=0x7fe14c01bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:59.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.039+0000 7fe1567fc640 1 -- 172.21.15.62:0/4194701540 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0a8a30 con 0x7fe1580b95c0 2023-05-15T16:39:59.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.039+0000 7fe1567fc640 1 -- 172.21.15.62:0/4194701540 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe14c0bb480 con 0x7fe1580b95c0 2023-05-15T16:39:59.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.039+0000 7fe15ff1d640 1 -- 172.21.15.62:0/4194701540 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe158069de0 con 0x7fe1580b95c0 2023-05-15T16:39:59.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.039+0000 7fe1567fc640 1 -- 172.21.15.62:0/4194701540 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe14c0bb850 con 0x7fe1580b95c0 2023-05-15T16:39:59.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.039+0000 7fe15ff1d640 1 -- 172.21.15.62:0/4194701540 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe158071a30 con 0x7fe1580b95c0 2023-05-15T16:39:59.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.039+0000 7fe15ff1d640 1 -- 172.21.15.62:0/4194701540 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1580b49b0 con 0x7fe1580b95c0 2023-05-15T16:39:59.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.039+0000 7fe1567fc640 1 -- 172.21.15.62:0/4194701540 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fe14c0bb9b0 con 0x7fe1580b95c0 2023-05-15T16:39:59.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.039+0000 7fe1567fc640 1 --2- 172.21.15.62:0/4194701540 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe1440653b0 0x7fe144067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:59.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.039+0000 7fe1567fc640 1 -- 172.21.15.62:0/4194701540 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fe14c120a10 con 0x7fe1580b95c0 2023-05-15T16:39:59.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.039+0000 7fe15dcb9640 1 --2- 172.21.15.62:0/4194701540 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe1440653b0 0x7fe144067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:59.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.039+0000 7fe15dcb9640 1 --2- 172.21.15.62:0/4194701540 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe1440653b0 0x7fe144067860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe150007fd0 tx=0x7fe150007d40 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:59.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.043+0000 7fe1567fc640 1 -- 172.21.15.62:0/4194701540 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fe1580b49b0 con 0x7fe1580b95c0 2023-05-15T16:39:59.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.199+0000 7fe15ff1d640 1 -- 172.21.15.62:0/4194701540 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe1580b49b0 con 0x7fe1580b95c0 2023-05-15T16:39:59.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.199+0000 7fe1567fc640 1 -- 172.21.15.62:0/4194701540 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) v1 ==== 84+0+126 (secure 0 0 0) 0x7fe1580b49b0 con 0x7fe1580b95c0 2023-05-15T16:39:59.207 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:39:59.207 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2023-05-15T16:39:59.208 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:39:59.208 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2023-05-15T16:39:59.208 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": ".mgr" 2023-05-15T16:39:59.208 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:39:59.208 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:39:59.209 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 2, 2023-05-15T16:39:59.209 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "rbd" 2023-05-15T16:39:59.209 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:39:59.209 INFO:teuthology.orchestra.run.smithi062.stdout:] 2023-05-15T16:39:59.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.199+0000 7fe15ff1d640 1 -- 172.21.15.62:0/4194701540 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe1440653b0 msgr2=0x7fe144067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:59.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.199+0000 7fe15ff1d640 1 --2- 172.21.15.62:0/4194701540 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe1440653b0 0x7fe144067860 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe150007fd0 tx=0x7fe150007d40 comp rx=0 tx=0).stop 2023-05-15T16:39:59.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.199+0000 7fe15ff1d640 1 -- 172.21.15.62:0/4194701540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1580b95c0 msgr2=0x7fe1581d4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:59.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.199+0000 7fe15ff1d640 1 --2- 172.21.15.62:0/4194701540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1580b95c0 0x7fe1581d4500 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe14c0b3040 tx=0x7fe14c01bad0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.199+0000 7fe15ff1d640 1 -- 172.21.15.62:0/4194701540 shutdown_connections 2023-05-15T16:39:59.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.199+0000 7fe15ff1d640 1 --2- 172.21.15.62:0/4194701540 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe158143990 0x7fe1580b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.199+0000 7fe15ff1d640 1 --2- 172.21.15.62:0/4194701540 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe1440653b0 0x7fe144067860 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.199+0000 7fe15ff1d640 1 --2- 172.21.15.62:0/4194701540 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe1580b95c0 0x7fe1581d4500 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.199+0000 7fe15ff1d640 1 --2- 172.21.15.62:0/4194701540 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe158069a10 0x7fe158144b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.199+0000 7fe15ff1d640 1 -- 172.21.15.62:0/4194701540 >> 172.21.15.62:0/4194701540 conn(0x7fe15806a8c0 msgr2=0x7fe158140910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:59.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.199+0000 7fe15ff1d640 1 -- 172.21.15.62:0/4194701540 shutdown_connections 2023-05-15T16:39:59.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.199+0000 7fe15ff1d640 1 -- 172.21.15.62:0/4194701540 wait complete. 2023-05-15T16:39:59.226 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-15T16:39:59.228 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-05-15T16:39:59.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877ce64640 1 Processor -- start 2023-05-15T16:39:59.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877ce64640 1 -- start start 2023-05-15T16:39:59.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877ce64640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f87780bdd60 0x7f877814d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:59.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877ce64640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8778149d30 con 0x7f877814d4e0 2023-05-15T16:39:59.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877ce64640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8778149fd0 con 0x7f877814ddf0 2023-05-15T16:39:59.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877ce64640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87780befc0 con 0x7f87780bdd60 2023-05-15T16:39:59.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877659c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f877814d4e0 0x7f87780be8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48968/0 (socket says 172.21.15.62:48968) 2023-05-15T16:39:59.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877659c640 1 -- 172.21.15.62:0/4149540321 learned_addr learned my addr 172.21.15.62:0/4149540321 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:39:59.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f8775d9b640 1 --2- 172.21.15.62:0/4149540321 >> v2:172.21.15.161:3300/0 conn(0x7f87780bdd60 0x7f877814d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:59.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877559a640 1 -- 172.21.15.62:0/4149540321 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2145584366 0 0) 0x7f8778149d30 con 0x7f877814d4e0 2023-05-15T16:39:59.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877559a640 1 -- 172.21.15.62:0/4149540321 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8764003530 con 0x7f877814d4e0 2023-05-15T16:39:59.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877559a640 1 -- 172.21.15.62:0/4149540321 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2387058801 0 0) 0x7f8764003530 con 0x7f877814d4e0 2023-05-15T16:39:59.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877559a640 1 -- 172.21.15.62:0/4149540321 >> v2:172.21.15.161:3300/0 conn(0x7f87780bdd60 msgr2=0x7f877814d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:59.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877559a640 1 --2- 172.21.15.62:0/4149540321 >> v2:172.21.15.161:3300/0 conn(0x7f87780bdd60 0x7f877814d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877559a640 1 -- 172.21.15.62:0/4149540321 >> v1:172.21.15.161:6789/0 conn(0x7f877814ddf0 legacy=0x7f87780bf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:59.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877559a640 1 -- 172.21.15.62:0/4149540321 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877814a2b0 con 0x7f877814d4e0 2023-05-15T16:39:59.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877559a640 1 -- 172.21.15.62:0/4149540321 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7f8760001680 con 0x7f877814d4e0 2023-05-15T16:39:59.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877559a640 1 -- 172.21.15.62:0/4149540321 >> v1:172.21.15.62:6789/0 conn(0x7f877814d4e0 legacy=0x7f87780be8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:59.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877559a640 1 --2- 172.21.15.62:0/4149540321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8764003980 0x7f8764003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:59.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877559a640 1 --2- 172.21.15.62:0/4149540321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87640047d0 0x7f8764004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:59.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877559a640 1 --2- 172.21.15.62:0/4149540321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8764005180 0x7f876400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:59.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877559a640 1 -- 172.21.15.62:0/4149540321 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876400bfd0 con 0x7f8764005180 2023-05-15T16:39:59.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877559a640 1 -- 172.21.15.62:0/4149540321 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f876400c140 con 0x7f87640047d0 2023-05-15T16:39:59.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.339+0000 7f877559a640 1 -- 172.21.15.62:0/4149540321 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f876400c300 con 0x7f8764003980 2023-05-15T16:39:59.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.343+0000 7f8776d9d640 1 --2- 172.21.15.62:0/4149540321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8764005180 0x7f876400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:59.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.343+0000 7f8775d9b640 1 --2- 172.21.15.62:0/4149540321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87640047d0 0x7f8764004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:59.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.343+0000 7f877659c640 1 --2- 172.21.15.62:0/4149540321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8764003980 0x7f8764003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:59.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.343+0000 7f8776d9d640 1 -- 172.21.15.62:0/4149540321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8764003980 msgr2=0x7f8764003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:59.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.343+0000 7f8776d9d640 1 --2- 172.21.15.62:0/4149540321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8764003980 0x7f8764003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.343+0000 7f8776d9d640 1 -- 172.21.15.62:0/4149540321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87640047d0 msgr2=0x7f8764004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:59.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.343+0000 7f8776d9d640 1 --2- 172.21.15.62:0/4149540321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87640047d0 0x7f8764004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.343+0000 7f8776d9d640 1 -- 172.21.15.62:0/4149540321 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8764003530 con 0x7f8764005180 2023-05-15T16:39:59.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.343+0000 7f8776d9d640 1 -- 172.21.15.62:0/4149540321 reap_dead start 2023-05-15T16:39:59.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.343+0000 7f8776d9d640 1 --2- 172.21.15.62:0/4149540321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8764005180 0x7f876400b990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8770001e70 tx=0x7f877001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=952268a83782deba server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:59.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.343+0000 7f877559a640 1 -- 172.21.15.62:0/4149540321 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8770003b80 con 0x7f8764005180 2023-05-15T16:39:59.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.343+0000 7f877559a640 1 -- 172.21.15.62:0/4149540321 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8770003d00 con 0x7f8764005180 2023-05-15T16:39:59.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.343+0000 7f877559a640 1 -- 172.21.15.62:0/4149540321 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8770005260 con 0x7f8764005180 2023-05-15T16:39:59.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.343+0000 7f877ce64640 1 -- 172.21.15.62:0/4149540321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8764005180 msgr2=0x7f876400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:59.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.343+0000 7f877ce64640 1 --2- 172.21.15.62:0/4149540321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8764005180 0x7f876400b990 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8770001e70 tx=0x7f877001c760 comp rx=0 tx=0).stop 2023-05-15T16:39:59.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f877ce64640 1 -- 172.21.15.62:0/4149540321 shutdown_connections 2023-05-15T16:39:59.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f877ce64640 1 --2- 172.21.15.62:0/4149540321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8764005180 0x7f876400b990 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f877ce64640 1 -- 172.21.15.62:0/4149540321 >> 172.21.15.62:0/4149540321 conn(0x7f87780a1a00 msgr2=0x7f87780a1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:59.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f877ce64640 1 -- 172.21.15.62:0/4149540321 shutdown_connections 2023-05-15T16:39:59.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f877ce64640 1 -- 172.21.15.62:0/4149540321 wait complete. 2023-05-15T16:39:59.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f877ce64640 1 Processor -- start 2023-05-15T16:39:59.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f877ce64640 1 -- start start 2023-05-15T16:39:59.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f877ce64640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8764005180 0x7f877814c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:59.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f877ce64640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87780b9e20 0x7f87781467e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:59.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f877ce64640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87781e2a50 0x7f87781e2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:59.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f877ce64640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87780ba290 con 0x7f87781e2a50 2023-05-15T16:39:59.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f877ce64640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8778146d20 con 0x7f87780b9e20 2023-05-15T16:39:59.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f877ce64640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87780b4190 con 0x7f8764005180 2023-05-15T16:39:59.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f8776d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87781e2a50 0x7f87781e2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:59.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f8776d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87781e2a50 0x7f87781e2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50882/0 (socket says 172.21.15.62:50882) 2023-05-15T16:39:59.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f8776d9d640 1 -- 172.21.15.62:0/2406902790 learned_addr learned my addr 172.21.15.62:0/2406902790 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:59.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f877659c640 1 --2- 172.21.15.62:0/2406902790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8764005180 0x7f877814c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:59.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f8775d9b640 1 --2- 172.21.15.62:0/2406902790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87780b9e20 0x7f87781467e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:59.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f8776d9d640 1 -- 172.21.15.62:0/2406902790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8764005180 msgr2=0x7f877814c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:59.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f8776d9d640 1 --2- 172.21.15.62:0/2406902790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8764005180 0x7f877814c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f8776d9d640 1 -- 172.21.15.62:0/2406902790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87780b9e20 msgr2=0x7f87781467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:59.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f8776d9d640 1 --2- 172.21.15.62:0/2406902790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87780b9e20 0x7f87781467e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f8776d9d640 1 -- 172.21.15.62:0/2406902790 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877814aab0 con 0x7f87781e2a50 2023-05-15T16:39:59.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f8776d9d640 1 --2- 172.21.15.62:0/2406902790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87781e2a50 0x7f87781e2ec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8770098170 tx=0x7f8764005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:59.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f876effd640 1 -- 172.21.15.62:0/2406902790 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87700ac070 con 0x7f87781e2a50 2023-05-15T16:39:59.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f876effd640 1 -- 172.21.15.62:0/2406902790 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8770005070 con 0x7f87781e2a50 2023-05-15T16:39:59.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f877ce64640 1 -- 172.21.15.62:0/2406902790 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f877814a590 con 0x7f87781e2a50 2023-05-15T16:39:59.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f876effd640 1 -- 172.21.15.62:0/2406902790 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87700053e0 con 0x7f87781e2a50 2023-05-15T16:39:59.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f877ce64640 1 -- 172.21.15.62:0/2406902790 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877814d8b0 con 0x7f87781e2a50 2023-05-15T16:39:59.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.347+0000 7f877ce64640 1 -- 172.21.15.62:0/2406902790 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877804dbe0 con 0x7f87781e2a50 2023-05-15T16:39:59.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.351+0000 7f876effd640 1 -- 172.21.15.62:0/2406902790 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f8770005540 con 0x7f87781e2a50 2023-05-15T16:39:59.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.351+0000 7f876effd640 1 --2- 172.21.15.62:0/2406902790 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8758065380 0x7f8758067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:59.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.351+0000 7f876effd640 1 -- 172.21.15.62:0/2406902790 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f877011b440 con 0x7f87781e2a50 2023-05-15T16:39:59.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.351+0000 7f877659c640 1 --2- 172.21.15.62:0/2406902790 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8758065380 0x7f8758067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:59.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.351+0000 7f877659c640 1 --2- 172.21.15.62:0/2406902790 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8758065380 0x7f8758067830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8760000c10 tx=0x7f8760009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:59.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.355+0000 7f876effd640 1 -- 172.21.15.62:0/2406902790 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f87700e94a0 con 0x7f87781e2a50 2023-05-15T16:39:59.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.503+0000 7f877ce64640 1 -- 172.21.15.62:0/2406902790 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f87780a0950 con 0x7f87781e2a50 2023-05-15T16:39:59.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.699+0000 7f876effd640 1 -- 172.21.15.62:0/2406902790 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) v1 ==== 138+0+0 (secure 0 0 0) 0x7f87700ecac0 con 0x7f87781e2a50 2023-05-15T16:39:59.710 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2023-05-15T16:39:59.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.707+0000 7f877ce64640 1 -- 172.21.15.62:0/2406902790 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8758065380 msgr2=0x7f8758067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:59.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.707+0000 7f877ce64640 1 --2- 172.21.15.62:0/2406902790 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8758065380 0x7f8758067830 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8760000c10 tx=0x7f8760009040 comp rx=0 tx=0).stop 2023-05-15T16:39:59.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.707+0000 7f877ce64640 1 -- 172.21.15.62:0/2406902790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87781e2a50 msgr2=0x7f87781e2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:59.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.707+0000 7f877ce64640 1 --2- 172.21.15.62:0/2406902790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87781e2a50 0x7f87781e2ec0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8770098170 tx=0x7f8764005800 comp rx=0 tx=0).stop 2023-05-15T16:39:59.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.707+0000 7f877ce64640 1 -- 172.21.15.62:0/2406902790 shutdown_connections 2023-05-15T16:39:59.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.707+0000 7f877ce64640 1 --2- 172.21.15.62:0/2406902790 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8758065380 0x7f8758067830 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.707+0000 7f877ce64640 1 --2- 172.21.15.62:0/2406902790 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f87781e2a50 0x7f87781e2ec0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.707+0000 7f877ce64640 1 --2- 172.21.15.62:0/2406902790 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f87780b9e20 0x7f87781467e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.707+0000 7f877ce64640 1 --2- 172.21.15.62:0/2406902790 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8764005180 0x7f877814c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.707+0000 7f877ce64640 1 -- 172.21.15.62:0/2406902790 >> 172.21.15.62:0/2406902790 conn(0x7f87780a1a00 msgr2=0x7f87780b4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:59.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.711+0000 7f877ce64640 1 -- 172.21.15.62:0/2406902790 shutdown_connections 2023-05-15T16:39:59.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.711+0000 7f877ce64640 1 -- 172.21.15.62:0/2406902790 wait complete. 2023-05-15T16:39:59.735 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-15T16:39:59.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.851+0000 7f5518276640 1 Processor -- start 2023-05-15T16:39:59.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.851+0000 7f5518276640 1 -- start start 2023-05-15T16:39:59.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.851+0000 7f5518276640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f55100ba180 0x7f5510070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:59.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.851+0000 7f5518276640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f551006f6c0 0x7f551006fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:59.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.851+0000 7f5518276640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551006d610 con 0x7f5510143ba0 2023-05-15T16:39:59.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.851+0000 7f5518276640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f551006e0f0 con 0x7f55100ba180 2023-05-15T16:39:59.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.851+0000 7f5518276640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f551006d8f0 con 0x7f551006f6c0 2023-05-15T16:39:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.851+0000 7f5516012640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f55100ba180 0x7f5510070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.851+0000 7f5516012640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f55100ba180 0x7f5510070fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50884/0 (socket says 172.21.15.62:50884) 2023-05-15T16:39:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.851+0000 7f5516012640 1 -- 172.21.15.62:0/3759053476 learned_addr learned my addr 172.21.15.62:0/3759053476 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.851+0000 7f5516012640 1 -- 172.21.15.62:0/3759053476 >> v2:172.21.15.161:3300/0 conn(0x7f551006f6c0 msgr2=0x7f551006fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.851+0000 7f5515811640 1 --2- 172.21.15.62:0/3759053476 >> v2:172.21.15.161:3300/0 conn(0x7f551006f6c0 0x7f551006fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.851+0000 7f5516012640 1 --2- 172.21.15.62:0/3759053476 >> v2:172.21.15.161:3300/0 conn(0x7f551006f6c0 0x7f551006fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.851+0000 7f5516012640 1 -- 172.21.15.62:0/3759053476 >> v1:172.21.15.161:6789/0 conn(0x7f5510143ba0 legacy=0x7f5510143fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:39:59.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.851+0000 7f5516012640 1 -- 172.21.15.62:0/3759053476 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551006dbd0 con 0x7f55100ba180 2023-05-15T16:39:59.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5516012640 1 --2- 172.21.15.62:0/3759053476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55100ba180 0x7f5510070fd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f55100705d0 tx=0x7f550801c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10606b9592ecec2a server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:59.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5515010640 1 -- 172.21.15.62:0/3759053476 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55080ab600 con 0x7f55100ba180 2023-05-15T16:39:59.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5515010640 1 -- 172.21.15.62:0/3759053476 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55080a7050 con 0x7f55100ba180 2023-05-15T16:39:59.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5515010640 1 -- 172.21.15.62:0/3759053476 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55080ab980 con 0x7f55100ba180 2023-05-15T16:39:59.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5518276640 1 -- 172.21.15.62:0/3759053476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55100ba180 msgr2=0x7f5510070fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:59.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5518276640 1 --2- 172.21.15.62:0/3759053476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55100ba180 0x7f5510070fd0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f55100705d0 tx=0x7f550801c430 comp rx=0 tx=0).stop 2023-05-15T16:39:59.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5518276640 1 -- 172.21.15.62:0/3759053476 shutdown_connections 2023-05-15T16:39:59.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5518276640 1 --2- 172.21.15.62:0/3759053476 >> v2:172.21.15.161:3300/0 conn(0x7f551006f6c0 0x7f551006fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5518276640 1 --2- 172.21.15.62:0/3759053476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f55100ba180 0x7f5510070fd0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5518276640 1 -- 172.21.15.62:0/3759053476 >> 172.21.15.62:0/3759053476 conn(0x7f55100bdab0 msgr2=0x7f55100b98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:39:59.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5518276640 1 -- 172.21.15.62:0/3759053476 shutdown_connections 2023-05-15T16:39:59.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5518276640 1 -- 172.21.15.62:0/3759053476 wait complete. 2023-05-15T16:39:59.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5518276640 1 Processor -- start 2023-05-15T16:39:59.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5518276640 1 -- start start 2023-05-15T16:39:59.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5518276640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f551006f6c0 0x7f55101e58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:59.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5518276640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55100ba180 0x7f5510148ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:59.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5518276640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5510143ba0 0x7f551013e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:59.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5518276640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55101e65d0 con 0x7f551006f6c0 2023-05-15T16:39:59.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5518276640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551014ad10 con 0x7f55100ba180 2023-05-15T16:39:59.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5518276640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55101e5e30 con 0x7f5510143ba0 2023-05-15T16:39:59.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5516012640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f551006f6c0 0x7f55101e58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:59.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5516012640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f551006f6c0 0x7f55101e58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50890/0 (socket says 172.21.15.62:50890) 2023-05-15T16:39:59.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5516012640 1 -- 172.21.15.62:0/362615845 learned_addr learned my addr 172.21.15.62:0/362615845 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:39:59.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5515811640 1 --2- 172.21.15.62:0/362615845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55100ba180 0x7f5510148ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:59.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5516813640 1 --2- 172.21.15.62:0/362615845 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5510143ba0 0x7f551013e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:59.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5516012640 1 -- 172.21.15.62:0/362615845 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5510143ba0 msgr2=0x7f551013e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:59.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5516012640 1 --2- 172.21.15.62:0/362615845 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5510143ba0 0x7f551013e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5516012640 1 -- 172.21.15.62:0/362615845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55100ba180 msgr2=0x7f5510148ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:39:59.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5516012640 1 --2- 172.21.15.62:0/362615845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55100ba180 0x7f5510148ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:39:59.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5516012640 1 -- 172.21.15.62:0/362615845 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55080094d0 con 0x7f551006f6c0 2023-05-15T16:39:59.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5516012640 1 --2- 172.21.15.62:0/362615845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f551006f6c0 0x7f55101e58f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f55080ae040 tx=0x7f550801ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:59.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5506ffd640 1 -- 172.21.15.62:0/362615845 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55080b6620 con 0x7f551006f6c0 2023-05-15T16:39:59.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5506ffd640 1 -- 172.21.15.62:0/362615845 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55080b67a0 con 0x7f551006f6c0 2023-05-15T16:39:59.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.855+0000 7f5518276640 1 -- 172.21.15.62:0/362615845 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551006d250 con 0x7f551006f6c0 2023-05-15T16:39:59.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.859+0000 7f5506ffd640 1 -- 172.21.15.62:0/362615845 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55080b6b50 con 0x7f551006f6c0 2023-05-15T16:39:59.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.859+0000 7f5518276640 1 -- 172.21.15.62:0/362615845 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55100b3e70 con 0x7f551006f6c0 2023-05-15T16:39:59.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.859+0000 7f5518276640 1 -- 172.21.15.62:0/362615845 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551006d3e0 con 0x7f551006f6c0 2023-05-15T16:39:59.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.859+0000 7f5506ffd640 1 -- 172.21.15.62:0/362615845 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f55080b2040 con 0x7f551006f6c0 2023-05-15T16:39:59.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.859+0000 7f5506ffd640 1 --2- 172.21.15.62:0/362615845 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f54f4065380 0x7f54f4067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:39:59.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.859+0000 7f5506ffd640 1 -- 172.21.15.62:0/362615845 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f550811cdb0 con 0x7f551006f6c0 2023-05-15T16:39:59.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.859+0000 7f5515811640 1 --2- 172.21.15.62:0/362615845 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f54f4065380 0x7f54f4067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:39:59.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.859+0000 7f5515811640 1 --2- 172.21.15.62:0/362615845 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f54f4065380 0x7f54f4067830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5510149e00 tx=0x7f5500008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:39:59.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:39:59.863+0000 7f5506ffd640 1 -- 172.21.15.62:0/362615845 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f5508121070 con 0x7f551006f6c0 2023-05-15T16:40:00.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.011+0000 7f5518276640 1 -- 172.21.15.62:0/362615845 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f551004dbe0 con 0x7f551006f6c0 2023-05-15T16:40:00.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.707+0000 7f5506ffd640 1 -- 172.21.15.62:0/362615845 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) v1 ==== 170+0+0 (secure 0 0 0) 0x7f55080ee5a0 con 0x7f551006f6c0 2023-05-15T16:40:00.718 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2023-05-15T16:40:00.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.723+0000 7f5518276640 1 -- 172.21.15.62:0/362615845 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f54f4065380 msgr2=0x7f54f4067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:00.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.723+0000 7f5518276640 1 --2- 172.21.15.62:0/362615845 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f54f4065380 0x7f54f4067830 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5510149e00 tx=0x7f5500008040 comp rx=0 tx=0).stop 2023-05-15T16:40:00.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.723+0000 7f5518276640 1 -- 172.21.15.62:0/362615845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f551006f6c0 msgr2=0x7f55101e58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:00.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.723+0000 7f5518276640 1 --2- 172.21.15.62:0/362615845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f551006f6c0 0x7f55101e58f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f55080ae040 tx=0x7f550801ac70 comp rx=0 tx=0).stop 2023-05-15T16:40:00.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.723+0000 7f5518276640 1 -- 172.21.15.62:0/362615845 shutdown_connections 2023-05-15T16:40:00.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.723+0000 7f5518276640 1 --2- 172.21.15.62:0/362615845 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5510143ba0 0x7f551013e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:00.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.723+0000 7f5518276640 1 --2- 172.21.15.62:0/362615845 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f55100ba180 0x7f5510148ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:00.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.723+0000 7f5518276640 1 --2- 172.21.15.62:0/362615845 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f54f4065380 0x7f54f4067830 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5510149e00 tx=0x7f5500008040 comp rx=0 tx=0).stop 2023-05-15T16:40:00.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.723+0000 7f5518276640 1 --2- 172.21.15.62:0/362615845 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f551006f6c0 0x7f55101e58f0 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f55080ae040 tx=0x7f550801ac70 comp rx=0 tx=0).stop 2023-05-15T16:40:00.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.723+0000 7f5518276640 1 -- 172.21.15.62:0/362615845 >> 172.21.15.62:0/362615845 conn(0x7f55100bdab0 msgr2=0x7f55100b7490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:00.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.723+0000 7f5518276640 1 -- 172.21.15.62:0/362615845 shutdown_connections 2023-05-15T16:40:00.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.731+0000 7f5518276640 1 -- 172.21.15.62:0/362615845 wait complete. 2023-05-15T16:40:00.763 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-15T16:40:00.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.879+0000 7f7c7db59640 1 Processor -- start 2023-05-15T16:40:00.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.879+0000 7f7c7db59640 1 -- start start 2023-05-15T16:40:00.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.879+0000 7f7c7db59640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7c780b1bf0 0x7f7c780b1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:00.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.879+0000 7f7c7db59640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7c78147110 0x7f7c781546e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.879+0000 7f7c7db59640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c780b0b70 con 0x7f7c780b3080 2023-05-15T16:40:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.879+0000 7f7c7db59640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c780b2500 con 0x7f7c780b1bf0 2023-05-15T16:40:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.879+0000 7f7c7db59640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7814adc0 con 0x7f7c78147110 2023-05-15T16:40:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.879+0000 7f7c777fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7c780b1bf0 0x7f7c780b1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.879+0000 7f7c777fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7c780b1bf0 0x7f7c780b1fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50900/0 (socket says 172.21.15.62:50900) 2023-05-15T16:40:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.879+0000 7f7c777fe640 1 -- 172.21.15.62:0/3018381520 learned_addr learned my addr 172.21.15.62:0/3018381520 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:00.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.879+0000 7f7c77fff640 1 --2- 172.21.15.62:0/3018381520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7c78147110 0x7f7c781546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:00.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.879+0000 7f7c777fe640 1 -- 172.21.15.62:0/3018381520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7c78147110 msgr2=0x7f7c781546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:00.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.879+0000 7f7c777fe640 1 --2- 172.21.15.62:0/3018381520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7c78147110 0x7f7c781546e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:00.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.879+0000 7f7c777fe640 1 -- 172.21.15.62:0/3018381520 >> v1:172.21.15.161:6789/0 conn(0x7f7c780b3080 legacy=0x7f7c7814a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:00.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.879+0000 7f7c777fe640 1 -- 172.21.15.62:0/3018381520 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c780b2d50 con 0x7f7c780b1bf0 2023-05-15T16:40:00.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c777fe640 1 --2- 172.21.15.62:0/3018381520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c780b1bf0 0x7f7c780b1fc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009870 tx=0x7f7c6c01c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7764679e640dd207 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:00.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c767fc640 1 -- 172.21.15.62:0/3018381520 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c0ac640 con 0x7f7c780b1bf0 2023-05-15T16:40:00.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c767fc640 1 -- 172.21.15.62:0/3018381520 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6c0ac7a0 con 0x7f7c780b1bf0 2023-05-15T16:40:00.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c767fc640 1 -- 172.21.15.62:0/3018381520 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c0acb30 con 0x7f7c780b1bf0 2023-05-15T16:40:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c7db59640 1 -- 172.21.15.62:0/3018381520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c780b1bf0 msgr2=0x7f7c780b1fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c7db59640 1 --2- 172.21.15.62:0/3018381520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c780b1bf0 0x7f7c780b1fc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c009870 tx=0x7f7c6c01c440 comp rx=0 tx=0).stop 2023-05-15T16:40:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c7db59640 1 -- 172.21.15.62:0/3018381520 shutdown_connections 2023-05-15T16:40:00.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c7db59640 1 --2- 172.21.15.62:0/3018381520 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7c78147110 0x7f7c781546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:00.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c7db59640 1 --2- 172.21.15.62:0/3018381520 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c780b1bf0 0x7f7c780b1fc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:00.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c7db59640 1 -- 172.21.15.62:0/3018381520 >> 172.21.15.62:0/3018381520 conn(0x7f7c780697b0 msgr2=0x7f7c78069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:00.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c7db59640 1 -- 172.21.15.62:0/3018381520 shutdown_connections 2023-05-15T16:40:00.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c7db59640 1 -- 172.21.15.62:0/3018381520 wait complete. 2023-05-15T16:40:00.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c7db59640 1 Processor -- start 2023-05-15T16:40:00.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c7db59640 1 -- start start 2023-05-15T16:40:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c7db59640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c780b1bf0 0x7f7c78148f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c7db59640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7c780b3080 0x7f7c781e60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c7db59640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c78147110 0x7f7c7813b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c7db59640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c781462d0 con 0x7f7c78147110 2023-05-15T16:40:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c7db59640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c781494c0 con 0x7f7c780b1bf0 2023-05-15T16:40:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c7db59640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c781e5c10 con 0x7f7c780b3080 2023-05-15T16:40:00.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c77fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c78147110 0x7f7c7813b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c77fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c78147110 0x7f7c7813b570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50906/0 (socket says 172.21.15.62:50906) 2023-05-15T16:40:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c77fff640 1 -- 172.21.15.62:0/3565506118 learned_addr learned my addr 172.21.15.62:0/3565506118 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c777fe640 1 --2- 172.21.15.62:0/3565506118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c780b1bf0 0x7f7c78148f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c76ffd640 1 --2- 172.21.15.62:0/3565506118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7c780b3080 0x7f7c781e60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c77fff640 1 -- 172.21.15.62:0/3565506118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7c780b3080 msgr2=0x7f7c781e60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c77fff640 1 --2- 172.21.15.62:0/3565506118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7c780b3080 0x7f7c781e60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:00.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c77fff640 1 -- 172.21.15.62:0/3565506118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c780b1bf0 msgr2=0x7f7c78148f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c77fff640 1 --2- 172.21.15.62:0/3565506118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c780b1bf0 0x7f7c78148f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c77fff640 1 -- 172.21.15.62:0/3565506118 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c6c0094d0 con 0x7f7c78147110 2023-05-15T16:40:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.883+0000 7f7c77fff640 1 --2- 172.21.15.62:0/3565506118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c78147110 0x7f7c7813b570 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000cc30 tx=0x7f7c7000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.887+0000 7f7c5ffff640 1 -- 172.21.15.62:0/3565506118 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7000ce40 con 0x7f7c78147110 2023-05-15T16:40:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.887+0000 7f7c5ffff640 1 -- 172.21.15.62:0/3565506118 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c700039a0 con 0x7f7c78147110 2023-05-15T16:40:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.887+0000 7f7c7db59640 1 -- 172.21.15.62:0/3565506118 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c780b7e00 con 0x7f7c78147110 2023-05-15T16:40:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.887+0000 7f7c5ffff640 1 -- 172.21.15.62:0/3565506118 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c70003d30 con 0x7f7c78147110 2023-05-15T16:40:00.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.887+0000 7f7c7db59640 1 -- 172.21.15.62:0/3565506118 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7814a190 con 0x7f7c78147110 2023-05-15T16:40:00.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.887+0000 7f7c7db59640 1 -- 172.21.15.62:0/3565506118 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c780b5e10 con 0x7f7c78147110 2023-05-15T16:40:00.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.887+0000 7f7c5ffff640 1 -- 172.21.15.62:0/3565506118 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f7c70003e90 con 0x7f7c78147110 2023-05-15T16:40:00.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.887+0000 7f7c5ffff640 1 --2- 172.21.15.62:0/3565506118 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7c64065380 0x7f7c64067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:00.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.887+0000 7f7c5ffff640 1 -- 172.21.15.62:0/3565506118 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f7c70082c30 con 0x7f7c78147110 2023-05-15T16:40:00.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.887+0000 7f7c777fe640 1 --2- 172.21.15.62:0/3565506118 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7c64065380 0x7f7c64067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:00.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.887+0000 7f7c777fe640 1 --2- 172.21.15.62:0/3565506118 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7c64065380 0x7f7c64067830 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c0ae000 tx=0x7f7c6c0a6070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:00.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:00.891+0000 7f7c5ffff640 1 -- 172.21.15.62:0/3565506118 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f7c70050820 con 0x7f7c78147110 2023-05-15T16:40:01.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.079+0000 7f7c7db59640 1 -- 172.21.15.62:0/3565506118 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f7c781e5dc0 con 0x7f7c78147110 2023-05-15T16:40:01.098 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 3 and data pool 4 2023-05-15T16:40:01.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.091+0000 7f7c5ffff640 1 -- 172.21.15.62:0/3565506118 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f7c781e5dc0 con 0x7f7c78147110 2023-05-15T16:40:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.095+0000 7f7c7db59640 1 -- 172.21.15.62:0/3565506118 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7c64065380 msgr2=0x7f7c64067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.095+0000 7f7c7db59640 1 --2- 172.21.15.62:0/3565506118 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7c64065380 0x7f7c64067830 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c0ae000 tx=0x7f7c6c0a6070 comp rx=0 tx=0).stop 2023-05-15T16:40:01.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.095+0000 7f7c7db59640 1 -- 172.21.15.62:0/3565506118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c78147110 msgr2=0x7f7c7813b570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.095+0000 7f7c7db59640 1 --2- 172.21.15.62:0/3565506118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c78147110 0x7f7c7813b570 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7c7000cc30 tx=0x7f7c7000a5c0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.095+0000 7f7c7db59640 1 -- 172.21.15.62:0/3565506118 shutdown_connections 2023-05-15T16:40:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.095+0000 7f7c7db59640 1 --2- 172.21.15.62:0/3565506118 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7c64065380 0x7f7c64067830 secure :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c0ae000 tx=0x7f7c6c0a6070 comp rx=0 tx=0).stop 2023-05-15T16:40:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.095+0000 7f7c7db59640 1 --2- 172.21.15.62:0/3565506118 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7c78147110 0x7f7c7813b570 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.095+0000 7f7c7db59640 1 --2- 172.21.15.62:0/3565506118 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7c780b3080 0x7f7c781e60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.095+0000 7f7c7db59640 1 --2- 172.21.15.62:0/3565506118 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7c780b1bf0 0x7f7c78148f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.095+0000 7f7c7db59640 1 -- 172.21.15.62:0/3565506118 >> 172.21.15.62:0/3565506118 conn(0x7f7c780697b0 msgr2=0x7f7c780ba960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:01.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.099+0000 7f7c7db59640 1 -- 172.21.15.62:0/3565506118 shutdown_connections 2023-05-15T16:40:01.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.099+0000 7f7c7db59640 1 -- 172.21.15.62:0/3565506118 wait complete. 2023-05-15T16:40:01.131 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-15T16:40:01.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.239+0000 7fdadaf9c640 1 Processor -- start 2023-05-15T16:40:01.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.239+0000 7fdadaf9c640 1 -- start start 2023-05-15T16:40:01.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.239+0000 7fdadaf9c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fdad4144190 0x7fdad414d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:01.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.239+0000 7fdadaf9c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdad40ba480 0x7fdad40705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:01.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.239+0000 7fdadaf9c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad40b16f0 con 0x7fdad406b6a0 2023-05-15T16:40:01.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.239+0000 7fdadaf9c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad414d730 con 0x7fdad4144190 2023-05-15T16:40:01.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.239+0000 7fdadaf9c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad414d910 con 0x7fdad40ba480 2023-05-15T16:40:01.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.239+0000 7fdad9539640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fdad406b6a0 0x7fdad406bb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48978/0 (socket says 172.21.15.62:48978) 2023-05-15T16:40:01.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.239+0000 7fdad9539640 1 -- 172.21.15.62:0/1747555832 learned_addr learned my addr 172.21.15.62:0/1747555832 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:01.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.239+0000 7fdad8d38640 1 --2- 172.21.15.62:0/1747555832 >> v2:172.21.15.62:3300/0 conn(0x7fdad4144190 0x7fdad414d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:01.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.239+0000 7fdad3fff640 1 --2- 172.21.15.62:0/1747555832 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdad40ba480 0x7fdad40705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:01.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.239+0000 7fdad37fe640 1 -- 172.21.15.62:0/1747555832 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2389499134 0 0) 0x7fdad40b16f0 con 0x7fdad406b6a0 2023-05-15T16:40:01.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.239+0000 7fdad37fe640 1 -- 172.21.15.62:0/1747555832 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdac4003530 con 0x7fdad406b6a0 2023-05-15T16:40:01.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.239+0000 7fdad8d38640 1 -- 172.21.15.62:0/1747555832 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdad40ba480 msgr2=0x7fdad40705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:01.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.239+0000 7fdad8d38640 1 --2- 172.21.15.62:0/1747555832 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdad40ba480 0x7fdad40705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.239+0000 7fdad8d38640 1 -- 172.21.15.62:0/1747555832 >> v1:172.21.15.62:6789/0 conn(0x7fdad406b6a0 legacy=0x7fdad406bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:01.249 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.239+0000 7fdad8d38640 1 -- 172.21.15.62:0/1747555832 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad414dbf0 con 0x7fdad4144190 2023-05-15T16:40:01.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.239+0000 7fdad8d38640 1 --2- 172.21.15.62:0/1747555832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdad4144190 0x7fdad414d1f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdac80097c0 tx=0x7fdac801c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a43c2d584827a5 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:01.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.239+0000 7fdad37fe640 1 -- 172.21.15.62:0/1747555832 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac80ab670 con 0x7fdad4144190 2023-05-15T16:40:01.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.239+0000 7fdad37fe640 1 -- 172.21.15.62:0/1747555832 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac80ab7d0 con 0x7fdad4144190 2023-05-15T16:40:01.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.239+0000 7fdad37fe640 1 -- 172.21.15.62:0/1747555832 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac80abb60 con 0x7fdad4144190 2023-05-15T16:40:01.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdadaf9c640 1 -- 172.21.15.62:0/1747555832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdad4144190 msgr2=0x7fdad414d1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:01.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdadaf9c640 1 --2- 172.21.15.62:0/1747555832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdad4144190 0x7fdad414d1f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fdac80097c0 tx=0x7fdac801c450 comp rx=0 tx=0).stop 2023-05-15T16:40:01.251 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdadaf9c640 1 -- 172.21.15.62:0/1747555832 shutdown_connections 2023-05-15T16:40:01.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdadaf9c640 1 --2- 172.21.15.62:0/1747555832 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdad40ba480 0x7fdad40705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdadaf9c640 1 --2- 172.21.15.62:0/1747555832 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdad4144190 0x7fdad414d1f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdadaf9c640 1 -- 172.21.15.62:0/1747555832 >> 172.21.15.62:0/1747555832 conn(0x7fdad40bde20 msgr2=0x7fdad40be220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:01.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdadaf9c640 1 -- 172.21.15.62:0/1747555832 shutdown_connections 2023-05-15T16:40:01.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdadaf9c640 1 -- 172.21.15.62:0/1747555832 wait complete. 2023-05-15T16:40:01.252 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdadaf9c640 1 Processor -- start 2023-05-15T16:40:01.253 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdadaf9c640 1 -- start start 2023-05-15T16:40:01.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdadaf9c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdad406b6a0 0x7fdad41e5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:01.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdadaf9c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdad40ba480 0x7fdad413f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:01.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdadaf9c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdad4144190 0x7fdad413fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:01.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdadaf9c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad41492e0 con 0x7fdad4144190 2023-05-15T16:40:01.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdadaf9c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad41e6000 con 0x7fdad406b6a0 2023-05-15T16:40:01.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdadaf9c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad41e62e0 con 0x7fdad40ba480 2023-05-15T16:40:01.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdad9539640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdad4144190 0x7fdad413fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:01.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdad9539640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdad4144190 0x7fdad413fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50930/0 (socket says 172.21.15.62:50930) 2023-05-15T16:40:01.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdad9539640 1 -- 172.21.15.62:0/1659211229 learned_addr learned my addr 172.21.15.62:0/1659211229 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:01.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdad3fff640 1 --2- 172.21.15.62:0/1659211229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdad40ba480 0x7fdad413f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:01.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdad8d38640 1 --2- 172.21.15.62:0/1659211229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdad406b6a0 0x7fdad41e5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:01.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdad9539640 1 -- 172.21.15.62:0/1659211229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdad40ba480 msgr2=0x7fdad413f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:01.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdad9539640 1 --2- 172.21.15.62:0/1659211229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdad40ba480 0x7fdad413f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdad9539640 1 -- 172.21.15.62:0/1659211229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdad406b6a0 msgr2=0x7fdad41e5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:01.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdad9539640 1 --2- 172.21.15.62:0/1659211229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdad406b6a0 0x7fdad41e5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdad9539640 1 -- 172.21.15.62:0/1659211229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac8009420 con 0x7fdad4144190 2023-05-15T16:40:01.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdad8d38640 1 --2- 172.21.15.62:0/1659211229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdad406b6a0 0x7fdad41e5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:01.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdad9539640 1 --2- 172.21.15.62:0/1659211229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdad4144190 0x7fdad413fd10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00cbb0 tx=0x7fdacc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:01.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdad17fa640 1 -- 172.21.15.62:0/1659211229 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc00ad40 con 0x7fdad4144190 2023-05-15T16:40:01.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdad17fa640 1 -- 172.21.15.62:0/1659211229 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdacc012400 con 0x7fdad4144190 2023-05-15T16:40:01.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdadaf9c640 1 -- 172.21.15.62:0/1659211229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad4156f30 con 0x7fdad4144190 2023-05-15T16:40:01.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdad17fa640 1 -- 172.21.15.62:0/1659211229 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdacc00aea0 con 0x7fdad4144190 2023-05-15T16:40:01.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdadaf9c640 1 -- 172.21.15.62:0/1659211229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad4156da0 con 0x7fdad4144190 2023-05-15T16:40:01.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.243+0000 7fdadaf9c640 1 -- 172.21.15.62:0/1659211229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad41570c0 con 0x7fdad4144190 2023-05-15T16:40:01.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.247+0000 7fdad17fa640 1 -- 172.21.15.62:0/1659211229 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fdacc0127b0 con 0x7fdad4144190 2023-05-15T16:40:01.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.247+0000 7fdad17fa640 1 --2- 172.21.15.62:0/1659211229 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fdab8065380 0x7fdab8067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:01.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.247+0000 7fdad17fa640 1 -- 172.21.15.62:0/1659211229 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fdacc082650 con 0x7fdad4144190 2023-05-15T16:40:01.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.247+0000 7fdad8d38640 1 --2- 172.21.15.62:0/1659211229 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fdab8065380 0x7fdab8067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:01.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.247+0000 7fdad8d38640 1 --2- 172.21.15.62:0/1659211229 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fdab8065380 0x7fdab8067830 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdac80af000 tx=0x7fdac8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:01.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.251+0000 7fdad17fa640 1 -- 172.21.15.62:0/1659211229 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fdacc04a620 con 0x7fdad4144190 2023-05-15T16:40:01.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.399+0000 7fdadaf9c640 1 -- 172.21.15.62:0/1659211229 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdad4067960 con 0x7fdad4144190 2023-05-15T16:40:01.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.399+0000 7fdad17fa640 1 -- 172.21.15.62:0/1659211229 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17824 (secure 0 0 0) 0x7fdacc050410 con 0x7fdad4144190 2023-05-15T16:40:01.409 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:01.410 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":22,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:40:01.085040+0000","last_up_change":"2023-05-15T16:39:48.597049+0000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-15T16:39:49.394028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-15T16:39:55.208679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-15T16:39:59.547414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-15T16:40:00.055526+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37594},{"type":"v1","addr":"172.21.15.62:6825","nonce":37594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37594},{"type":"v1","addr":"172.21.15.62:6827","nonce":37594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37594},{"type":"v1","addr":"172.21.15.62:6831","nonce":37594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37594},{"type":"v1","addr":"172.21.15.62:6829","nonce":37594}]},"public_addr":"172.21.15.62:6825/37594","cluster_addr":"172.21.15.62:6827/37594","heartbeat_back_addr":"172.21.15.62:6831/37594","heartbeat_front_addr":"172.21.15.62:6829/37594","state":["exists","up"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37592},{"type":"v1","addr":"172.21.15.62:6808","nonce":37592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":37592},{"type":"v1","addr":"172.21.15.62:6814","nonce":37592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6821","nonce":37592},{"type":"v1","addr":"172.21.15.62:6823","nonce":37592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37592},{"type":"v1","addr":"172.21.15.62:6818","nonce":37592}]},"public_addr":"172.21.15.62:6808/37592","cluster_addr":"172.21.15.62:6814/37592","heartbeat_back_addr":"172.21.15.62:6823/37592","heartbeat_front_addr":"172.21.15.62:6818/37592","state":["exists","up"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":37591},{"type":"v1","addr":"172.21.15.62:6810","nonce":37591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":37591},{"type":"v1","addr":"172.21.15.62:6815","nonce":37591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37591},{"type":"v1","addr":"172.21.15.62:6822","nonce":37591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":37591},{"type":"v1","addr":"172.21.15.62:6819","nonce":37591}]},"public_addr":"172.21.15.62:6810/37591","cluster_addr":"172.21.15.62:6815/37591","heartbeat_back_addr":"172.21.15.62:6822/37591","heartbeat_front_addr":"172.21.15.62:6819/37591","state":["exists","up"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37593},{"type":"v1","addr":"172.21.15.62:6801","nonce":37593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37593},{"type":"v1","addr":"172.21.15.62:6803","nonce":37593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":37593},{"type":"v1","addr":"172.21.15.62:6812","nonce":37593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37593},{"type":"v1","addr":"172.21.15.62:6805","nonce":37593}]},"public_addr":"172.21.15.62:6801/37593","cluster_addr":"172.21.15.62:6803/37593","heartbeat_back_addr":"172.21.15.62:6812/37593","heartbeat_front_addr":"172.21.15.62:6805/37593","state":["exists","up"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37854},{"type":"v1","addr":"172.21.15.161:6801","nonce":37854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37854},{"type":"v1","addr":"172.21.15.161:6803","nonce":37854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37854},{"type":"v1","addr":"172.21.15.161:6807","nonce":37854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37854},{"type":"v1","addr":"172.21.15.161:6805","nonce":37854}]},"public_addr":"172.21.15.161:6801/37854","cluster_addr":"172.21.15.161:6803/37854","heartbeat_back_addr":"172.21.15.161:6807/37854","heartbeat_front_addr":"172.21.15.161:6805/37854","state":["exists","up"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37855},{"type":"v1","addr":"172.21.15.161:6810","nonce":37855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37855},{"type":"v1","addr":"172.21.15.161:6815","nonce":37855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37855},{"type":"v1","addr":"172.21.15.161:6824","nonce":37855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37855},{"type":"v1","addr":"172.21.15.161:6820","nonce":37855}]},"public_addr":"172.21.15.161:6810/37855","cluster_addr":"172.21.15.161:6815/37855","heartbeat_back_addr":"172.21.15.161:6824/37855","heartbeat_front_addr":"172.21.15.161:6820/37855","state":["exists","up"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":37856},{"type":"v1","addr":"172.21.15.161:6814","nonce":37856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37856},{"type":"v1","addr":"172.21.15.161:6819","nonce":37856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":37856},{"type":"v1","addr":"172.21.15.161:6830","nonce":37856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37856},{"type":"v1","addr":"172.21.15.161:6826","nonce":37856}]},"public_addr":"172.21.15.161:6814/37856","cluster_addr":"172.21.15.161:6819/37856","heartbeat_back_addr":"172.21.15.161:6830/37856","heartbeat_front_addr":"172.21.15.161:6826/37856","state":["exists","up"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":37857},{"type":"v1","addr":"172.21.15.161:6813","nonce":37857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":37857},{"type":"v1","addr":"172.21.15.161:6821","nonce":37857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":37857},{"type":"v1","addr":"172.21.15.161:6831","nonce":37857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":37857},{"type":"v1","addr":"172.21.15.161:6827","nonce":37857}]},"public_addr":"172.21.15.161:6813/37857","cluster_addr":"172.21.15.161:6821/37857","heartbeat_back_addr":"172.21.15.161:6831/37857","heartbeat_front_addr":"172.21.15.161:6827/37857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.592907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.618143+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.641533+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.614355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.579293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.718353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.730135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.792887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:40:01.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.403+0000 7fdadaf9c640 1 -- 172.21.15.62:0/1659211229 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fdab8065380 msgr2=0x7fdab8067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:01.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.403+0000 7fdadaf9c640 1 --2- 172.21.15.62:0/1659211229 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fdab8065380 0x7fdab8067830 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdac80af000 tx=0x7fdac8008040 comp rx=0 tx=0).stop 2023-05-15T16:40:01.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.403+0000 7fdadaf9c640 1 -- 172.21.15.62:0/1659211229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdad4144190 msgr2=0x7fdad413fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:01.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.403+0000 7fdadaf9c640 1 --2- 172.21.15.62:0/1659211229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdad4144190 0x7fdad413fd10 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdacc00cbb0 tx=0x7fdacc00a430 comp rx=0 tx=0).stop 2023-05-15T16:40:01.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.403+0000 7fdadaf9c640 1 -- 172.21.15.62:0/1659211229 shutdown_connections 2023-05-15T16:40:01.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.403+0000 7fdadaf9c640 1 --2- 172.21.15.62:0/1659211229 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fdab8065380 0x7fdab8067830 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.403+0000 7fdadaf9c640 1 --2- 172.21.15.62:0/1659211229 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdad4144190 0x7fdad413fd10 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.403+0000 7fdadaf9c640 1 --2- 172.21.15.62:0/1659211229 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdad40ba480 0x7fdad413f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.403+0000 7fdadaf9c640 1 --2- 172.21.15.62:0/1659211229 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdad406b6a0 0x7fdad41e5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.403+0000 7fdadaf9c640 1 -- 172.21.15.62:0/1659211229 >> 172.21.15.62:0/1659211229 conn(0x7fdad40bde20 msgr2=0x7fdad40bbd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:01.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.403+0000 7fdadaf9c640 1 -- 172.21.15.62:0/1659211229 shutdown_connections 2023-05-15T16:40:01.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.403+0000 7fdadaf9c640 1 -- 172.21.15.62:0/1659211229 wait complete. 2023-05-15T16:40:01.427 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-15T16:40:01.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.547+0000 7f84638d1640 1 Processor -- start 2023-05-15T16:40:01.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.547+0000 7f84638d1640 1 -- start start 2023-05-15T16:40:01.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.547+0000 7f84638d1640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f845c147410 0x7f845c06f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:01.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.547+0000 7f84638d1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f845c0717e0 0x7f845c0b95b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:01.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.547+0000 7f84638d1640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845c0b26e0 con 0x7f845c06fc10 2023-05-15T16:40:01.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.547+0000 7f84638d1640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845c0b20b0 con 0x7f845c0717e0 2023-05-15T16:40:01.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.547+0000 7f84638d1640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845c071c70 con 0x7f845c147410 2023-05-15T16:40:01.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.547+0000 7f8460e6c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f845c0717e0 0x7f845c0b95b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:01.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.547+0000 7f8461e6e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f845c06fc10 0x7f845c0b9af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:48994/0 (socket says 172.21.15.62:48994) 2023-05-15T16:40:01.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.547+0000 7f8461e6e640 1 -- 172.21.15.62:0/512890501 learned_addr learned my addr 172.21.15.62:0/512890501 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:01.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.547+0000 7f846166d640 1 --2- 172.21.15.62:0/512890501 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f845c147410 0x7f845c06f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:01.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.547+0000 7f8460e6c640 1 -- 172.21.15.62:0/512890501 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f845c147410 msgr2=0x7f845c06f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:01.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.547+0000 7f8460e6c640 1 --2- 172.21.15.62:0/512890501 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f845c147410 0x7f845c06f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.547+0000 7f8460e6c640 1 -- 172.21.15.62:0/512890501 >> v1:172.21.15.62:6789/0 conn(0x7f845c06fc10 legacy=0x7f845c0b9af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:01.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.547+0000 7f8453fff640 1 -- 172.21.15.62:0/512890501 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387221170 0 0) 0x7f845c0b26e0 con 0x7f845c06fc10 2023-05-15T16:40:01.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.547+0000 7f8460e6c640 1 -- 172.21.15.62:0/512890501 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845c0b2370 con 0x7f845c0717e0 2023-05-15T16:40:01.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.547+0000 7f846166d640 1 --2- 172.21.15.62:0/512890501 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f845c147410 0x7f845c06f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:01.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.551+0000 7f8460e6c640 1 --2- 172.21.15.62:0/512890501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f845c0717e0 0x7f845c0b95b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f844c00ba60 tx=0x7f844c01f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e3ad9f77ae030 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:01.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.551+0000 7f8453fff640 1 -- 172.21.15.62:0/512890501 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c0a7b00 con 0x7f845c0717e0 2023-05-15T16:40:01.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.551+0000 7f8453fff640 1 -- 172.21.15.62:0/512890501 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c0a7c60 con 0x7f845c0717e0 2023-05-15T16:40:01.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.551+0000 7f8453fff640 1 -- 172.21.15.62:0/512890501 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c0af440 con 0x7f845c0717e0 2023-05-15T16:40:01.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.551+0000 7f84638d1640 1 -- 172.21.15.62:0/512890501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f845c0717e0 msgr2=0x7f845c0b95b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:01.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.551+0000 7f84638d1640 1 --2- 172.21.15.62:0/512890501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f845c0717e0 0x7f845c0b95b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f844c00ba60 tx=0x7f844c01f5b0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.551+0000 7f84638d1640 1 -- 172.21.15.62:0/512890501 shutdown_connections 2023-05-15T16:40:01.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.551+0000 7f84638d1640 1 --2- 172.21.15.62:0/512890501 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f845c0717e0 0x7f845c0b95b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.551+0000 7f84638d1640 1 --2- 172.21.15.62:0/512890501 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f845c147410 0x7f845c06f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.551+0000 7f84638d1640 1 -- 172.21.15.62:0/512890501 >> 172.21.15.62:0/512890501 conn(0x7f845c06cf80 msgr2=0x7f845c06d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:01.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.551+0000 7f84638d1640 1 -- 172.21.15.62:0/512890501 shutdown_connections 2023-05-15T16:40:01.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.551+0000 7f84638d1640 1 -- 172.21.15.62:0/512890501 wait complete. 2023-05-15T16:40:01.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f84638d1640 1 Processor -- start 2023-05-15T16:40:01.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f84638d1640 1 -- start start 2023-05-15T16:40:01.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f84638d1640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f845c06fc10 0x7f845c09ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:01.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f84638d1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f845c0717e0 0x7f845c0a0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:01.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f84638d1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f845c147410 0x7f845c0a0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:01.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f84638d1640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c09db30 con 0x7f845c0717e0 2023-05-15T16:40:01.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f84638d1640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845c09ef90 con 0x7f845c147410 2023-05-15T16:40:01.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f84638d1640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f845c0b6190 con 0x7f845c06fc10 2023-05-15T16:40:01.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f8460e6c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f845c0717e0 0x7f845c0a0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:01.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f8460e6c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f845c0717e0 0x7f845c0a0710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50950/0 (socket says 172.21.15.62:50950) 2023-05-15T16:40:01.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f8460e6c640 1 -- 172.21.15.62:0/1985986827 learned_addr learned my addr 172.21.15.62:0/1985986827 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:01.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f846166d640 1 --2- 172.21.15.62:0/1985986827 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f845c06fc10 0x7f845c09ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:01.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f8461e6e640 1 --2- 172.21.15.62:0/1985986827 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f845c147410 0x7f845c0a0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:01.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f8460e6c640 1 -- 172.21.15.62:0/1985986827 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f845c06fc10 msgr2=0x7f845c09ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:01.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f8460e6c640 1 --2- 172.21.15.62:0/1985986827 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f845c06fc10 0x7f845c09ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f8460e6c640 1 -- 172.21.15.62:0/1985986827 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f845c147410 msgr2=0x7f845c0a0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:01.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f8460e6c640 1 --2- 172.21.15.62:0/1985986827 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f845c147410 0x7f845c0a0c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f8460e6c640 1 -- 172.21.15.62:0/1985986827 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c00b6c0 con 0x7f845c0717e0 2023-05-15T16:40:01.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f8460e6c640 1 --2- 172.21.15.62:0/1985986827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f845c0717e0 0x7f845c0a0710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f844c01f3f0 tx=0x7f844c01d390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:01.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f8451ffb640 1 -- 172.21.15.62:0/1985986827 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c0a7b00 con 0x7f845c0717e0 2023-05-15T16:40:01.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f8451ffb640 1 -- 172.21.15.62:0/1985986827 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844c0ba480 con 0x7f845c0717e0 2023-05-15T16:40:01.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f84638d1640 1 -- 172.21.15.62:0/1985986827 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845c0b2b50 con 0x7f845c0717e0 2023-05-15T16:40:01.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f8451ffb640 1 -- 172.21.15.62:0/1985986827 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c0ba850 con 0x7f845c0717e0 2023-05-15T16:40:01.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f84638d1640 1 -- 172.21.15.62:0/1985986827 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845c0b3640 con 0x7f845c0717e0 2023-05-15T16:40:01.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f84638d1640 1 -- 172.21.15.62:0/1985986827 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845c0b2ce0 con 0x7f845c0717e0 2023-05-15T16:40:01.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.555+0000 7f8451ffb640 1 -- 172.21.15.62:0/1985986827 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f844c0ba9b0 con 0x7f845c0717e0 2023-05-15T16:40:01.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.559+0000 7f8451ffb640 1 --2- 172.21.15.62:0/1985986827 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8440065380 0x7f8440067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:01.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.559+0000 7f8451ffb640 1 -- 172.21.15.62:0/1985986827 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f844c11dfb0 con 0x7f845c0717e0 2023-05-15T16:40:01.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.559+0000 7f846166d640 1 --2- 172.21.15.62:0/1985986827 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8440065380 0x7f8440067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:01.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.559+0000 7f846166d640 1 --2- 172.21.15.62:0/1985986827 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8440065380 0x7f8440067830 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8458006fd0 tx=0x7f8458008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:01.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.563+0000 7f8451ffb640 1 -- 172.21.15.62:0/1985986827 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f844c14e620 con 0x7f845c0717e0 2023-05-15T16:40:01.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.715+0000 7f84638d1640 1 -- 172.21.15.62:0/1985986827 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f845c04dbe0 con 0x7f845c0717e0 2023-05-15T16:40:01.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.719+0000 7f8451ffb640 1 -- 172.21.15.62:0/1985986827 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+17824 (secure 0 0 0) 0x7f844c0b4020 con 0x7f845c0717e0 2023-05-15T16:40:01.727 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:01.727 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":22,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:40:01.085040+0000","last_up_change":"2023-05-15T16:39:48.597049+0000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-15T16:39:49.394028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-15T16:39:55.208679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-15T16:39:59.547414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-15T16:40:00.055526+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37594},{"type":"v1","addr":"172.21.15.62:6825","nonce":37594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37594},{"type":"v1","addr":"172.21.15.62:6827","nonce":37594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37594},{"type":"v1","addr":"172.21.15.62:6831","nonce":37594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37594},{"type":"v1","addr":"172.21.15.62:6829","nonce":37594}]},"public_addr":"172.21.15.62:6825/37594","cluster_addr":"172.21.15.62:6827/37594","heartbeat_back_addr":"172.21.15.62:6831/37594","heartbeat_front_addr":"172.21.15.62:6829/37594","state":["exists","up"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37592},{"type":"v1","addr":"172.21.15.62:6808","nonce":37592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":37592},{"type":"v1","addr":"172.21.15.62:6814","nonce":37592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6821","nonce":37592},{"type":"v1","addr":"172.21.15.62:6823","nonce":37592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37592},{"type":"v1","addr":"172.21.15.62:6818","nonce":37592}]},"public_addr":"172.21.15.62:6808/37592","cluster_addr":"172.21.15.62:6814/37592","heartbeat_back_addr":"172.21.15.62:6823/37592","heartbeat_front_addr":"172.21.15.62:6818/37592","state":["exists","up"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":37591},{"type":"v1","addr":"172.21.15.62:6810","nonce":37591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":37591},{"type":"v1","addr":"172.21.15.62:6815","nonce":37591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37591},{"type":"v1","addr":"172.21.15.62:6822","nonce":37591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":37591},{"type":"v1","addr":"172.21.15.62:6819","nonce":37591}]},"public_addr":"172.21.15.62:6810/37591","cluster_addr":"172.21.15.62:6815/37591","heartbeat_back_addr":"172.21.15.62:6822/37591","heartbeat_front_addr":"172.21.15.62:6819/37591","state":["exists","up"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37593},{"type":"v1","addr":"172.21.15.62:6801","nonce":37593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37593},{"type":"v1","addr":"172.21.15.62:6803","nonce":37593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":37593},{"type":"v1","addr":"172.21.15.62:6812","nonce":37593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37593},{"type":"v1","addr":"172.21.15.62:6805","nonce":37593}]},"public_addr":"172.21.15.62:6801/37593","cluster_addr":"172.21.15.62:6803/37593","heartbeat_back_addr":"172.21.15.62:6812/37593","heartbeat_front_addr":"172.21.15.62:6805/37593","state":["exists","up"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37854},{"type":"v1","addr":"172.21.15.161:6801","nonce":37854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37854},{"type":"v1","addr":"172.21.15.161:6803","nonce":37854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37854},{"type":"v1","addr":"172.21.15.161:6807","nonce":37854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37854},{"type":"v1","addr":"172.21.15.161:6805","nonce":37854}]},"public_addr":"172.21.15.161:6801/37854","cluster_addr":"172.21.15.161:6803/37854","heartbeat_back_addr":"172.21.15.161:6807/37854","heartbeat_front_addr":"172.21.15.161:6805/37854","state":["exists","up"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37855},{"type":"v1","addr":"172.21.15.161:6810","nonce":37855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37855},{"type":"v1","addr":"172.21.15.161:6815","nonce":37855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37855},{"type":"v1","addr":"172.21.15.161:6824","nonce":37855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37855},{"type":"v1","addr":"172.21.15.161:6820","nonce":37855}]},"public_addr":"172.21.15.161:6810/37855","cluster_addr":"172.21.15.161:6815/37855","heartbeat_back_addr":"172.21.15.161:6824/37855","heartbeat_front_addr":"172.21.15.161:6820/37855","state":["exists","up"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":37856},{"type":"v1","addr":"172.21.15.161:6814","nonce":37856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37856},{"type":"v1","addr":"172.21.15.161:6819","nonce":37856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":37856},{"type":"v1","addr":"172.21.15.161:6830","nonce":37856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37856},{"type":"v1","addr":"172.21.15.161:6826","nonce":37856}]},"public_addr":"172.21.15.161:6814/37856","cluster_addr":"172.21.15.161:6819/37856","heartbeat_back_addr":"172.21.15.161:6830/37856","heartbeat_front_addr":"172.21.15.161:6826/37856","state":["exists","up"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":37857},{"type":"v1","addr":"172.21.15.161:6813","nonce":37857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":37857},{"type":"v1","addr":"172.21.15.161:6821","nonce":37857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":37857},{"type":"v1","addr":"172.21.15.161:6831","nonce":37857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":37857},{"type":"v1","addr":"172.21.15.161:6827","nonce":37857}]},"public_addr":"172.21.15.161:6813/37857","cluster_addr":"172.21.15.161:6821/37857","heartbeat_back_addr":"172.21.15.161:6831/37857","heartbeat_front_addr":"172.21.15.161:6827/37857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.592907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.618143+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.641533+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.614355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.579293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.718353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.730135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.792887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:40:01.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.719+0000 7f84638d1640 1 -- 172.21.15.62:0/1985986827 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8440065380 msgr2=0x7f8440067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:01.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.719+0000 7f84638d1640 1 --2- 172.21.15.62:0/1985986827 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8440065380 0x7f8440067830 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8458006fd0 tx=0x7f8458008040 comp rx=0 tx=0).stop 2023-05-15T16:40:01.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.719+0000 7f84638d1640 1 -- 172.21.15.62:0/1985986827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f845c0717e0 msgr2=0x7f845c0a0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:01.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.719+0000 7f84638d1640 1 --2- 172.21.15.62:0/1985986827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f845c0717e0 0x7f845c0a0710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f844c01f3f0 tx=0x7f844c01d390 comp rx=0 tx=0).stop 2023-05-15T16:40:01.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.719+0000 7f84638d1640 1 -- 172.21.15.62:0/1985986827 shutdown_connections 2023-05-15T16:40:01.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.719+0000 7f84638d1640 1 --2- 172.21.15.62:0/1985986827 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f845c147410 0x7f845c0a0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.719+0000 7f84638d1640 1 --2- 172.21.15.62:0/1985986827 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8440065380 0x7f8440067830 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.719+0000 7f84638d1640 1 --2- 172.21.15.62:0/1985986827 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f845c0717e0 0x7f845c0a0710 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.719+0000 7f84638d1640 1 --2- 172.21.15.62:0/1985986827 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f845c06fc10 0x7f845c09ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.719+0000 7f84638d1640 1 -- 172.21.15.62:0/1985986827 >> 172.21.15.62:0/1985986827 conn(0x7f845c06cf80 msgr2=0x7f845c0b84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:01.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.719+0000 7f84638d1640 1 -- 172.21.15.62:0/1985986827 shutdown_connections 2023-05-15T16:40:01.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.719+0000 7f84638d1640 1 -- 172.21.15.62:0/1985986827 wait complete. 2023-05-15T16:40:01.748 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-15T16:40:01.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22dc056640 1 Processor -- start 2023-05-15T16:40:01.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22dc056640 1 -- start start 2023-05-15T16:40:01.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22dc056640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d40b4100 0x7f22d40b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:01.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22dc056640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f22d4147c30 0x7f22d41524f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:01.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22dc056640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22d40b7400 con 0x7f22d40b3080 2023-05-15T16:40:01.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22dc056640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22d40b4e70 con 0x7f22d4147c30 2023-05-15T16:40:01.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22dc056640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d4142380 con 0x7f22d40b4100 2023-05-15T16:40:01.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d95f1640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f22d40b3080 0x7f22d4141c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:49000/0 (socket says 172.21.15.62:49000) 2023-05-15T16:40:01.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d95f1640 1 -- 172.21.15.62:0/176445469 learned_addr learned my addr 172.21.15.62:0/176445469 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:01.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d9df2640 1 --2- 172.21.15.62:0/176445469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d40b4100 0x7f22d40b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:01.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22da5f3640 1 --2- 172.21.15.62:0/176445469 >> v2:172.21.15.161:3300/0 conn(0x7f22d4147c30 0x7f22d41524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:01.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d8df0640 1 -- 172.21.15.62:0/176445469 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767689909 0 0) 0x7f22d40b7400 con 0x7f22d40b3080 2023-05-15T16:40:01.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d8df0640 1 -- 172.21.15.62:0/176445469 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f22c0003530 con 0x7f22d40b3080 2023-05-15T16:40:01.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d8df0640 1 -- 172.21.15.62:0/176445469 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2956112262 0 0) 0x7f22c0003530 con 0x7f22d40b3080 2023-05-15T16:40:01.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d8df0640 1 -- 172.21.15.62:0/176445469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d40b4100 msgr2=0x7f22d40b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:01.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d8df0640 1 --2- 172.21.15.62:0/176445469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d40b4100 0x7f22d40b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d8df0640 1 -- 172.21.15.62:0/176445469 >> v2:172.21.15.161:3300/0 conn(0x7f22d4147c30 msgr2=0x7f22d41524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:01.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d8df0640 1 --2- 172.21.15.62:0/176445469 >> v2:172.21.15.161:3300/0 conn(0x7f22d4147c30 0x7f22d41524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d8df0640 1 -- 172.21.15.62:0/176445469 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d40b6640 con 0x7f22d40b3080 2023-05-15T16:40:01.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d8df0640 1 -- 172.21.15.62:0/176445469 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7f22d0001680 con 0x7f22d40b3080 2023-05-15T16:40:01.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d8df0640 1 -- 172.21.15.62:0/176445469 >> v1:172.21.15.62:6789/0 conn(0x7f22d40b3080 legacy=0x7f22d4141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:01.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d8df0640 1 --2- 172.21.15.62:0/176445469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d40b4100 0x7f22c0003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:01.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d8df0640 1 --2- 172.21.15.62:0/176445469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22c0003f00 0x7f22c00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:01.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d8df0640 1 --2- 172.21.15.62:0/176445469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22c0004d10 0x7f22c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:01.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d8df0640 1 -- 172.21.15.62:0/176445469 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d40b4e70 con 0x7f22c0004d10 2023-05-15T16:40:01.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d8df0640 1 -- 172.21.15.62:0/176445469 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d4142380 con 0x7f22c0003f00 2023-05-15T16:40:01.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d8df0640 1 -- 172.21.15.62:0/176445469 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c000b990 con 0x7f22d40b4100 2023-05-15T16:40:01.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22da5f3640 1 --2- 172.21.15.62:0/176445469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22c0004d10 0x7f22c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:01.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d95f1640 1 --2- 172.21.15.62:0/176445469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22c0003f00 0x7f22c00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:01.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d9df2640 1 --2- 172.21.15.62:0/176445469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d40b4100 0x7f22c0003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:01.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22da5f3640 1 -- 172.21.15.62:0/176445469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d40b4100 msgr2=0x7f22c0003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:01.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22da5f3640 1 --2- 172.21.15.62:0/176445469 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d40b4100 0x7f22c0003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22da5f3640 1 -- 172.21.15.62:0/176445469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22c0003f00 msgr2=0x7f22c00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:01.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22da5f3640 1 --2- 172.21.15.62:0/176445469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22c0003f00 0x7f22c00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22da5f3640 1 -- 172.21.15.62:0/176445469 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c0003530 con 0x7f22c0004d10 2023-05-15T16:40:01.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.867+0000 7f22d95f1640 1 --2- 172.21.15.62:0/176445469 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22c0003f00 0x7f22c00047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-15T16:40:01.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.871+0000 7f22da5f3640 1 --2- 172.21.15.62:0/176445469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22c0004d10 0x7f22c0005180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f22cc009fc0 tx=0x7f22cc01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0e1c9834b96dbc server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:01.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.871+0000 7f22d8df0640 1 -- 172.21.15.62:0/176445469 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc0a5cb0 con 0x7f22c0004d10 2023-05-15T16:40:01.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.871+0000 7f22d8df0640 1 -- 172.21.15.62:0/176445469 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22cc00f040 con 0x7f22c0004d10 2023-05-15T16:40:01.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.871+0000 7f22d8df0640 1 -- 172.21.15.62:0/176445469 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22cc0ad680 con 0x7f22c0004d10 2023-05-15T16:40:01.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.871+0000 7f22dc056640 1 -- 172.21.15.62:0/176445469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22c0004d10 msgr2=0x7f22c0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:01.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.871+0000 7f22dc056640 1 --2- 172.21.15.62:0/176445469 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22c0004d10 0x7f22c0005180 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f22cc009fc0 tx=0x7f22cc01cca0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.871+0000 7f22da5f3640 1 -- 172.21.15.62:0/176445469 reap_dead start 2023-05-15T16:40:01.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.871+0000 7f22dc056640 1 -- 172.21.15.62:0/176445469 shutdown_connections 2023-05-15T16:40:01.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.871+0000 7f22dc056640 1 -- 172.21.15.62:0/176445469 >> 172.21.15.62:0/176445469 conn(0x7f22d40697b0 msgr2=0x7f22d4069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:01.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.871+0000 7f22dc056640 1 -- 172.21.15.62:0/176445469 shutdown_connections 2023-05-15T16:40:01.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.871+0000 7f22dc056640 1 -- 172.21.15.62:0/176445469 wait complete. 2023-05-15T16:40:01.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.871+0000 7f22dc056640 1 Processor -- start 2023-05-15T16:40:01.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.871+0000 7f22dc056640 1 -- start start 2023-05-15T16:40:01.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22dc056640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22d41430e0 0x7f22d4144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:01.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22dc056640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22d40b26e0 0x7f22d41dec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:01.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22dc056640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d41df160 0x7f22d41df5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:01.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22dc056640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d41450e0 con 0x7f22d41430e0 2023-05-15T16:40:01.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22dc056640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22d41dfb10 con 0x7f22d40b26e0 2023-05-15T16:40:01.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22dc056640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22d4144530 con 0x7f22d41df160 2023-05-15T16:40:01.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22d9df2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22d41430e0 0x7f22d4144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:01.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22d9df2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22d41430e0 0x7f22d4144ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50966/0 (socket says 172.21.15.62:50966) 2023-05-15T16:40:01.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22d9df2640 1 -- 172.21.15.62:0/3646413120 learned_addr learned my addr 172.21.15.62:0/3646413120 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22d95f1640 1 --2- 172.21.15.62:0/3646413120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22d40b26e0 0x7f22d41dec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22da5f3640 1 --2- 172.21.15.62:0/3646413120 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d41df160 0x7f22d41df5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22d9df2640 1 -- 172.21.15.62:0/3646413120 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d41df160 msgr2=0x7f22d41df5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22d9df2640 1 --2- 172.21.15.62:0/3646413120 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d41df160 0x7f22d41df5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22d9df2640 1 -- 172.21.15.62:0/3646413120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22d40b26e0 msgr2=0x7f22d41dec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22d9df2640 1 --2- 172.21.15.62:0/3646413120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22d40b26e0 0x7f22d41dec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:01.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22d9df2640 1 -- 172.21.15.62:0/3646413120 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22d40b6c00 con 0x7f22d41430e0 2023-05-15T16:40:01.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22d95f1640 1 --2- 172.21.15.62:0/3646413120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22d40b26e0 0x7f22d41dec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:01.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22d9df2640 1 --2- 172.21.15.62:0/3646413120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22d41430e0 0x7f22d4144ba0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f22c40115e0 tx=0x7f22c4011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:01.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22ca7fc640 1 -- 172.21.15.62:0/3646413120 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c400f8f0 con 0x7f22d41430e0 2023-05-15T16:40:01.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22ca7fc640 1 -- 172.21.15.62:0/3646413120 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c400fa50 con 0x7f22d41430e0 2023-05-15T16:40:01.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22dc056640 1 -- 172.21.15.62:0/3646413120 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22d40b6920 con 0x7f22d41430e0 2023-05-15T16:40:01.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22ca7fc640 1 -- 172.21.15.62:0/3646413120 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c400fdc0 con 0x7f22d41430e0 2023-05-15T16:40:01.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22dc056640 1 -- 172.21.15.62:0/3646413120 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22d40b6ee0 con 0x7f22d41430e0 2023-05-15T16:40:01.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22dc056640 1 -- 172.21.15.62:0/3646413120 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22d4067960 con 0x7f22d41430e0 2023-05-15T16:40:01.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22ca7fc640 1 -- 172.21.15.62:0/3646413120 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f22c4015460 con 0x7f22d41430e0 2023-05-15T16:40:01.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22ca7fc640 1 --2- 172.21.15.62:0/3646413120 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f22b8065380 0x7f22b8067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:01.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22ca7fc640 1 -- 172.21.15.62:0/3646413120 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f22c4083110 con 0x7f22d41430e0 2023-05-15T16:40:01.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.875+0000 7f22d95f1640 1 --2- 172.21.15.62:0/3646413120 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f22b8065380 0x7f22b8067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:01.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.879+0000 7f22d95f1640 1 --2- 172.21.15.62:0/3646413120 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f22b8065380 0x7f22b8067830 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f22d0001c20 tx=0x7f22d0001bb0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:01.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:01.879+0000 7f22ca7fc640 1 -- 172.21.15.62:0/3646413120 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f22c4050dc0 con 0x7f22d41430e0 2023-05-15T16:40:02.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.067+0000 7f22dc056640 1 -- 172.21.15.62:0/3646413120 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f22d404dbe0 con 0x7f22d41430e0 2023-05-15T16:40:02.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.743+0000 7f22ca7fc640 1 -- 172.21.15.62:0/3646413120 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) v1 ==== 118+0+0 (secure 0 0 0) 0x7f22c40543e0 con 0x7f22d41430e0 2023-05-15T16:40:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.747+0000 7f22dc056640 1 -- 172.21.15.62:0/3646413120 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f22b8065380 msgr2=0x7f22b8067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.747+0000 7f22dc056640 1 --2- 172.21.15.62:0/3646413120 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f22b8065380 0x7f22b8067830 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f22d0001c20 tx=0x7f22d0001bb0 comp rx=0 tx=0).stop 2023-05-15T16:40:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.747+0000 7f22dc056640 1 -- 172.21.15.62:0/3646413120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22d41430e0 msgr2=0x7f22d4144ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:02.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.747+0000 7f22dc056640 1 --2- 172.21.15.62:0/3646413120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22d41430e0 0x7f22d4144ba0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f22c40115e0 tx=0x7f22c4011aa0 comp rx=0 tx=0).stop 2023-05-15T16:40:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.747+0000 7f22dc056640 1 -- 172.21.15.62:0/3646413120 shutdown_connections 2023-05-15T16:40:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.747+0000 7f22dc056640 1 --2- 172.21.15.62:0/3646413120 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f22d41df160 0x7f22d41df5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.747+0000 7f22dc056640 1 --2- 172.21.15.62:0/3646413120 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f22d40b26e0 0x7f22d41dec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.747+0000 7f22dc056640 1 --2- 172.21.15.62:0/3646413120 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f22b8065380 0x7f22b8067830 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:02.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.747+0000 7f22dc056640 1 --2- 172.21.15.62:0/3646413120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f22d41430e0 0x7f22d4144ba0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:02.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.747+0000 7f22dc056640 1 -- 172.21.15.62:0/3646413120 >> 172.21.15.62:0/3646413120 conn(0x7f22d40697b0 msgr2=0x7f22d4146310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:02.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.747+0000 7f22dc056640 1 -- 172.21.15.62:0/3646413120 shutdown_connections 2023-05-15T16:40:02.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.747+0000 7f22dc056640 1 -- 172.21.15.62:0/3646413120 wait complete. 2023-05-15T16:40:02.781 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-05-15T16:40:02.788 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-15T16:40:02.818 INFO:tasks.ceph.mds.a.smithi062.stderr:2023-05-15T16:40:02.815+0000 7f64d26cd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-15T16:40:02.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.915+0000 7ff8af43c640 1 Processor -- start 2023-05-15T16:40:02.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.915+0000 7ff8af43c640 1 -- start start 2023-05-15T16:40:02.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.915+0000 7ff8af43c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8a80b4100 0x7ff8a80b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:02.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.915+0000 7ff8af43c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff8a80b3080 0x7ff8a8141c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:02.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.915+0000 7ff8af43c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff8a81421b0 0x7ff8a8147c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:02.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.915+0000 7ff8af43c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a80b4e70 con 0x7ff8a81421b0 2023-05-15T16:40:02.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.915+0000 7ff8af43c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8a80b7400 con 0x7ff8a80b3080 2023-05-15T16:40:02.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.915+0000 7ff8af43c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a80b6640 con 0x7ff8a80b4100 2023-05-15T16:40:02.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.915+0000 7ff8ad9d9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff8a81421b0 0x7ff8a8147c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:02.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.915+0000 7ff8ad9d9640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff8a81421b0 0x7ff8a8147c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50980/0 (socket says 172.21.15.62:50980) 2023-05-15T16:40:02.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.915+0000 7ff8ad9d9640 1 -- 172.21.15.62:0/761280825 learned_addr learned my addr 172.21.15.62:0/761280825 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:02.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.915+0000 7ff8ad1d8640 1 --2- 172.21.15.62:0/761280825 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8a80b4100 0x7ff8a80b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:02.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.915+0000 7ff8ac9d7640 1 --2- 172.21.15.62:0/761280825 >> v2:172.21.15.161:3300/0 conn(0x7ff8a80b3080 0x7ff8a8141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:02.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.915+0000 7ff8ad9d9640 1 -- 172.21.15.62:0/761280825 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8a80b4100 msgr2=0x7ff8a80b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:02.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.915+0000 7ff8ad9d9640 1 --2- 172.21.15.62:0/761280825 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8a80b4100 0x7ff8a80b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:02.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.915+0000 7ff8ad9d9640 1 -- 172.21.15.62:0/761280825 >> v2:172.21.15.161:3300/0 conn(0x7ff8a80b3080 msgr2=0x7ff8a8141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:02.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.915+0000 7ff8ad9d9640 1 --2- 172.21.15.62:0/761280825 >> v2:172.21.15.161:3300/0 conn(0x7ff8a80b3080 0x7ff8a8141c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:02.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.915+0000 7ff8ad9d9640 1 -- 172.21.15.62:0/761280825 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a80b6920 con 0x7ff8a81421b0 2023-05-15T16:40:02.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8ad9d9640 1 --2- 172.21.15.62:0/761280825 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8a81421b0 0x7ff8a8147c30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80b2ef0 tx=0x7ff8a001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8a086bb635ca574 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:02.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff89ffff640 1 -- 172.21.15.62:0/761280825 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00a5820 con 0x7ff8a81421b0 2023-05-15T16:40:02.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff89ffff640 1 -- 172.21.15.62:0/761280825 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a00a5980 con 0x7ff8a81421b0 2023-05-15T16:40:02.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff89ffff640 1 -- 172.21.15.62:0/761280825 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a00a5d10 con 0x7ff8a81421b0 2023-05-15T16:40:02.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8af43c640 1 -- 172.21.15.62:0/761280825 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8a81421b0 msgr2=0x7ff8a8147c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:02.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8af43c640 1 --2- 172.21.15.62:0/761280825 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8a81421b0 0x7ff8a8147c30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7ff8a80b2ef0 tx=0x7ff8a001c9a0 comp rx=0 tx=0).stop 2023-05-15T16:40:02.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8af43c640 1 -- 172.21.15.62:0/761280825 shutdown_connections 2023-05-15T16:40:02.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8af43c640 1 --2- 172.21.15.62:0/761280825 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8a81421b0 0x7ff8a8147c30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:02.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8af43c640 1 --2- 172.21.15.62:0/761280825 >> v2:172.21.15.161:3300/0 conn(0x7ff8a80b3080 0x7ff8a8141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:02.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8af43c640 1 --2- 172.21.15.62:0/761280825 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8a80b4100 0x7ff8a80b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:02.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8af43c640 1 -- 172.21.15.62:0/761280825 >> 172.21.15.62:0/761280825 conn(0x7ff8a80697b0 msgr2=0x7ff8a8069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:02.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8af43c640 1 -- 172.21.15.62:0/761280825 shutdown_connections 2023-05-15T16:40:02.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8af43c640 1 -- 172.21.15.62:0/761280825 wait complete. 2023-05-15T16:40:02.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8af43c640 1 Processor -- start 2023-05-15T16:40:02.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8af43c640 1 -- start start 2023-05-15T16:40:02.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8af43c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8a80b3080 0x7ff8a813b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:02.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8af43c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8a80b4100 0x7ff8a813d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:02.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8af43c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8a81421b0 0x7ff8a8139da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:02.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8af43c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a813dc90 con 0x7ff8a80b3080 2023-05-15T16:40:02.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8af43c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a8139810 con 0x7ff8a81421b0 2023-05-15T16:40:02.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8af43c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a813bba0 con 0x7ff8a80b4100 2023-05-15T16:40:02.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8ad1d8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8a80b3080 0x7ff8a813b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:02.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8ad1d8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8a80b3080 0x7ff8a813b4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50990/0 (socket says 172.21.15.62:50990) 2023-05-15T16:40:02.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8ad1d8640 1 -- 172.21.15.62:0/594851041 learned_addr learned my addr 172.21.15.62:0/594851041 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:02.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8ad9d9640 1 --2- 172.21.15.62:0/594851041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8a81421b0 0x7ff8a8139da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:02.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8ad1d8640 1 -- 172.21.15.62:0/594851041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8a80b4100 msgr2=0x7ff8a813d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:02.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8ad1d8640 1 --2- 172.21.15.62:0/594851041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8a80b4100 0x7ff8a813d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:02.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8ad1d8640 1 -- 172.21.15.62:0/594851041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8a81421b0 msgr2=0x7ff8a8139da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:02.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8ad1d8640 1 --2- 172.21.15.62:0/594851041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8a81421b0 0x7ff8a8139da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:02.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8ad1d8640 1 -- 172.21.15.62:0/594851041 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a0009b30 con 0x7ff8a80b3080 2023-05-15T16:40:02.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8ad9d9640 1 --2- 172.21.15.62:0/594851041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8a81421b0 0x7ff8a8139da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:02.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8ad1d8640 1 --2- 172.21.15.62:0/594851041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8a80b3080 0x7ff8a813b4b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff8a400e930 tx=0x7ff8a400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:02.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff89dffb640 1 -- 172.21.15.62:0/594851041 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4009690 con 0x7ff8a80b3080 2023-05-15T16:40:02.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff89dffb640 1 -- 172.21.15.62:0/594851041 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a400ca00 con 0x7ff8a80b3080 2023-05-15T16:40:02.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.919+0000 7ff8af43c640 1 -- 172.21.15.62:0/594851041 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8a80a1dc0 con 0x7ff8a80b3080 2023-05-15T16:40:02.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.923+0000 7ff89dffb640 1 -- 172.21.15.62:0/594851041 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a400cd70 con 0x7ff8a80b3080 2023-05-15T16:40:02.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.923+0000 7ff8af43c640 1 -- 172.21.15.62:0/594851041 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8a80b44d0 con 0x7ff8a80b3080 2023-05-15T16:40:02.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.923+0000 7ff8af43c640 1 -- 172.21.15.62:0/594851041 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8a80a1f50 con 0x7ff8a80b3080 2023-05-15T16:40:02.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.923+0000 7ff89dffb640 1 -- 172.21.15.62:0/594851041 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7ff8a4013470 con 0x7ff8a80b3080 2023-05-15T16:40:02.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.923+0000 7ff89dffb640 1 --2- 172.21.15.62:0/594851041 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff88c0653b0 0x7ff88c067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:02.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.923+0000 7ff89dffb640 1 -- 172.21.15.62:0/594851041 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff8a4082990 con 0x7ff8a80b3080 2023-05-15T16:40:02.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.923+0000 7ff8ac9d7640 1 --2- 172.21.15.62:0/594851041 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff88c0653b0 0x7ff88c067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:02.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.923+0000 7ff8ac9d7640 1 --2- 172.21.15.62:0/594851041 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff88c0653b0 0x7ff88c067860 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8135650 tx=0x7ff8980095c0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:02.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:02.927+0000 7ff89dffb640 1 -- 172.21.15.62:0/594851041 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7ff8a4050700 con 0x7ff8a80b3080 2023-05-15T16:40:03.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.119+0000 7ff8af43c640 1 -- 172.21.15.62:0/594851041 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7ff8a81399e0 con 0x7ff8a80b3080 2023-05-15T16:40:03.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.751+0000 7ff89dffb640 1 -- 172.21.15.62:0/594851041 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff8a4053d20 con 0x7ff8a80b3080 2023-05-15T16:40:03.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.755+0000 7ff8af43c640 1 -- 172.21.15.62:0/594851041 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff88c0653b0 msgr2=0x7ff88c067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:03.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.755+0000 7ff8af43c640 1 --2- 172.21.15.62:0/594851041 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff88c0653b0 0x7ff88c067860 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8135650 tx=0x7ff8980095c0 comp rx=0 tx=0).stop 2023-05-15T16:40:03.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.755+0000 7ff8af43c640 1 -- 172.21.15.62:0/594851041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8a80b3080 msgr2=0x7ff8a813b4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:03.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.755+0000 7ff8af43c640 1 --2- 172.21.15.62:0/594851041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8a80b3080 0x7ff8a813b4b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff8a400e930 tx=0x7ff8a400edf0 comp rx=0 tx=0).stop 2023-05-15T16:40:03.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.755+0000 7ff8af43c640 1 -- 172.21.15.62:0/594851041 shutdown_connections 2023-05-15T16:40:03.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.755+0000 7ff8af43c640 1 --2- 172.21.15.62:0/594851041 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff8a81421b0 0x7ff8a8139da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:03.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.755+0000 7ff8af43c640 1 --2- 172.21.15.62:0/594851041 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8a80b4100 0x7ff8a813d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:03.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.755+0000 7ff8af43c640 1 --2- 172.21.15.62:0/594851041 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff88c0653b0 0x7ff88c067860 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:03.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.755+0000 7ff8af43c640 1 --2- 172.21.15.62:0/594851041 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8a80b3080 0x7ff8a813b4b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:03.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.755+0000 7ff8af43c640 1 -- 172.21.15.62:0/594851041 >> 172.21.15.62:0/594851041 conn(0x7ff8a80697b0 msgr2=0x7ff8a8069b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:03.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.755+0000 7ff8af43c640 1 -- 172.21.15.62:0/594851041 shutdown_connections 2023-05-15T16:40:03.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.755+0000 7ff8af43c640 1 -- 172.21.15.62:0/594851041 wait complete. 2023-05-15T16:40:03.784 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-05-15T16:40:03.784 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-15T16:40:03.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 Processor -- start 2023-05-15T16:40:03.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 -- start start 2023-05-15T16:40:03.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f77b81450d0 0x7f77b80ba030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:03.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b80b8950 0x7f77b80b8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:03.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77b8148950 con 0x7f77b8147af0 2023-05-15T16:40:03.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77b80b5570 con 0x7f77b81450d0 2023-05-15T16:40:03.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b8070cd0 con 0x7f77b80b8950 2023-05-15T16:40:03.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77b659c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f77b81450d0 0x7f77b80ba030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:03.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77b659c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f77b81450d0 0x7f77b80ba030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50996/0 (socket says 172.21.15.62:50996) 2023-05-15T16:40:03.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77b659c640 1 -- 172.21.15.62:0/663675393 learned_addr learned my addr 172.21.15.62:0/663675393 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:03.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77affff640 1 --1- 172.21.15.62:0/663675393 >> v1:172.21.15.62:6789/0 conn(0x7f77b8147af0 0x7f77b80705c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:49014/0 (socket says 172.21.15.62:49014) 2023-05-15T16:40:03.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77b659c640 1 -- 172.21.15.62:0/663675393 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b80b8950 msgr2=0x7f77b80b8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:03.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77b6d9d640 1 --2- 172.21.15.62:0/663675393 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b80b8950 0x7f77b80b8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:03.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77b659c640 1 --2- 172.21.15.62:0/663675393 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b80b8950 0x7f77b80b8dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:03.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77b659c640 1 -- 172.21.15.62:0/663675393 >> v1:172.21.15.62:6789/0 conn(0x7f77b8147af0 legacy=0x7f77b80705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:03.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77b659c640 1 -- 172.21.15.62:0/663675393 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77b80b9310 con 0x7f77b81450d0 2023-05-15T16:40:03.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77b5d9b640 1 -- 172.21.15.62:0/663675393 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1547324476 0 0) 0x7f77b8148950 con 0x7f77b8147af0 2023-05-15T16:40:03.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77b6d9d640 1 --2- 172.21.15.62:0/663675393 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b80b8950 0x7f77b80b8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:03.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77b659c640 1 --2- 172.21.15.62:0/663675393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77b81450d0 0x7f77b80ba030 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f77a8009870 tx=0x7f77a801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a18db78237e24b2 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:03.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77b5d9b640 1 -- 172.21.15.62:0/663675393 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a80ab680 con 0x7f77b81450d0 2023-05-15T16:40:03.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77b5d9b640 1 -- 172.21.15.62:0/663675393 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a80ab7e0 con 0x7f77b81450d0 2023-05-15T16:40:03.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77b5d9b640 1 -- 172.21.15.62:0/663675393 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a80abb70 con 0x7f77b81450d0 2023-05-15T16:40:03.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 -- 172.21.15.62:0/663675393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77b81450d0 msgr2=0x7f77b80ba030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:03.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 --2- 172.21.15.62:0/663675393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77b81450d0 0x7f77b80ba030 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f77a8009870 tx=0x7f77a801c480 comp rx=0 tx=0).stop 2023-05-15T16:40:03.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 -- 172.21.15.62:0/663675393 shutdown_connections 2023-05-15T16:40:03.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 --2- 172.21.15.62:0/663675393 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b80b8950 0x7f77b80b8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:03.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 --2- 172.21.15.62:0/663675393 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77b81450d0 0x7f77b80ba030 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:03.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 -- 172.21.15.62:0/663675393 >> 172.21.15.62:0/663675393 conn(0x7f77b80bde20 msgr2=0x7f77b80be220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:03.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 -- 172.21.15.62:0/663675393 shutdown_connections 2023-05-15T16:40:03.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 -- 172.21.15.62:0/663675393 wait complete. 2023-05-15T16:40:03.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 Processor -- start 2023-05-15T16:40:03.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 -- start start 2023-05-15T16:40:03.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b80b8950 0x7f77b81499a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:03.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77b81450d0 0x7f77b8141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:03.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77b8147af0 0x7f77b814a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:03.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b8143780 con 0x7f77b81450d0 2023-05-15T16:40:03.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77b8143960 con 0x7f77b8147af0 2023-05-15T16:40:03.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77bc8ec640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77b81491e0 con 0x7f77b80b8950 2023-05-15T16:40:03.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77affff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77b81450d0 0x7f77b8141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:03.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77affff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77b81450d0 0x7f77b8141c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:50998/0 (socket says 172.21.15.62:50998) 2023-05-15T16:40:03.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77affff640 1 -- 172.21.15.62:0/2921076837 learned_addr learned my addr 172.21.15.62:0/2921076837 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:03.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77b659c640 1 --2- 172.21.15.62:0/2921076837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b80b8950 0x7f77b81499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:03.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77b6d9d640 1 --2- 172.21.15.62:0/2921076837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77b8147af0 0x7f77b814a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:03.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77affff640 1 -- 172.21.15.62:0/2921076837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b80b8950 msgr2=0x7f77b81499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:03.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77affff640 1 --2- 172.21.15.62:0/2921076837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b80b8950 0x7f77b81499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:03.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77affff640 1 -- 172.21.15.62:0/2921076837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77b8147af0 msgr2=0x7f77b814a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:03.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77affff640 1 --2- 172.21.15.62:0/2921076837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77b8147af0 0x7f77b814a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:03.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77affff640 1 -- 172.21.15.62:0/2921076837 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77a80094d0 con 0x7f77b81450d0 2023-05-15T16:40:03.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77b659c640 1 --2- 172.21.15.62:0/2921076837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b80b8950 0x7f77b81499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:03.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.955+0000 7f77affff640 1 --2- 172.21.15.62:0/2921076837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77b81450d0 0x7f77b8141c70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f77a000c4b0 tx=0x7f77a000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:03.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.959+0000 7f77aeffd640 1 -- 172.21.15.62:0/2921076837 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a00074e0 con 0x7f77b81450d0 2023-05-15T16:40:03.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.959+0000 7f77aeffd640 1 -- 172.21.15.62:0/2921076837 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77a0007660 con 0x7f77b81450d0 2023-05-15T16:40:03.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.959+0000 7f77bc8ec640 1 -- 172.21.15.62:0/2921076837 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77b806ce50 con 0x7f77b81450d0 2023-05-15T16:40:03.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.959+0000 7f77aeffd640 1 -- 172.21.15.62:0/2921076837 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77a0004a30 con 0x7f77b81450d0 2023-05-15T16:40:03.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.959+0000 7f77bc8ec640 1 -- 172.21.15.62:0/2921076837 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77b81485e0 con 0x7f77b81450d0 2023-05-15T16:40:03.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.959+0000 7f77bc8ec640 1 -- 172.21.15.62:0/2921076837 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77b81454a0 con 0x7f77b81450d0 2023-05-15T16:40:03.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.959+0000 7f77aeffd640 1 -- 172.21.15.62:0/2921076837 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f77a001c3b0 con 0x7f77b81450d0 2023-05-15T16:40:03.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.959+0000 7f77aeffd640 1 --2- 172.21.15.62:0/2921076837 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7798065380 0x7f7798067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:03.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.959+0000 7f77aeffd640 1 -- 172.21.15.62:0/2921076837 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f77a0081f80 con 0x7f77b81450d0 2023-05-15T16:40:03.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.959+0000 7f77b659c640 1 --2- 172.21.15.62:0/2921076837 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7798065380 0x7f7798067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:03.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.959+0000 7f77b659c640 1 --2- 172.21.15.62:0/2921076837 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7798065380 0x7f7798067830 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f77a80af000 tx=0x7f77a8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:03.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:03.963+0000 7f77aeffd640 1 -- 172.21.15.62:0/2921076837 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f77a004fd10 con 0x7f77b81450d0 2023-05-15T16:40:04.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.151+0000 7f77bc8ec640 1 -- 172.21.15.62:0/2921076837 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77b8067960 con 0x7f77b81450d0 2023-05-15T16:40:04.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.151+0000 7f77aeffd640 1 -- 172.21.15.62:0/2921076837 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3889 (secure 0 0 0) 0x7f77a0018090 con 0x7f77b81450d0 2023-05-15T16:40:04.160 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:04.160 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1731611654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1731611654},{"type":"v1","addr":"172.21.15.161:6835","nonce":1731611654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2563537601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2563537601},{"type":"v1","addr":"172.21.15.62:6834","nonce":2563537601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-15T16:40:01.085500+0000","modified":"2023-05-15T16:40:03.744733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/2804159919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2804159919},{"type":"v1","addr":"172.21.15.62:6835","nonce":2804159919}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-15T16:40:04.161 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 7 2023-05-15T16:40:04.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.155+0000 7f77bc8ec640 1 -- 172.21.15.62:0/2921076837 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7798065380 msgr2=0x7f7798067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:04.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.155+0000 7f77bc8ec640 1 --2- 172.21.15.62:0/2921076837 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7798065380 0x7f7798067830 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f77a80af000 tx=0x7f77a8008040 comp rx=0 tx=0).stop 2023-05-15T16:40:04.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.155+0000 7f77bc8ec640 1 -- 172.21.15.62:0/2921076837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77b81450d0 msgr2=0x7f77b8141c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:04.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.155+0000 7f77bc8ec640 1 --2- 172.21.15.62:0/2921076837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77b81450d0 0x7f77b8141c70 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f77a000c4b0 tx=0x7f77a000c970 comp rx=0 tx=0).stop 2023-05-15T16:40:04.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.155+0000 7f77bc8ec640 1 -- 172.21.15.62:0/2921076837 shutdown_connections 2023-05-15T16:40:04.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.155+0000 7f77bc8ec640 1 --2- 172.21.15.62:0/2921076837 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f77b8147af0 0x7f77b814a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.155+0000 7f77bc8ec640 1 --2- 172.21.15.62:0/2921076837 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7798065380 0x7f7798067830 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.155+0000 7f77bc8ec640 1 --2- 172.21.15.62:0/2921076837 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f77b81450d0 0x7f77b8141c70 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.155+0000 7f77bc8ec640 1 --2- 172.21.15.62:0/2921076837 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f77b80b8950 0x7f77b81499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.155+0000 7f77bc8ec640 1 -- 172.21.15.62:0/2921076837 >> 172.21.15.62:0/2921076837 conn(0x7f77b80bde20 msgr2=0x7f77b8146490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:04.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.155+0000 7f77bc8ec640 1 -- 172.21.15.62:0/2921076837 shutdown_connections 2023-05-15T16:40:04.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.155+0000 7f77bc8ec640 1 -- 172.21.15.62:0/2921076837 wait complete. 2023-05-15T16:40:04.179 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-15T16:40:04.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 Processor -- start 2023-05-15T16:40:04.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 -- start start 2023-05-15T16:40:04.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1684143e60 0x7f1684149b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:04.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f16840b1b80 0x7f1684154470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:04.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1684144230 con 0x7f16840b91a0 2023-05-15T16:40:04.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f168414a050 con 0x7f1684143e60 2023-05-15T16:40:04.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f168414d7d0 con 0x7f16840b1b80 2023-05-15T16:40:04.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f16837fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1684143e60 0x7f1684149b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:04.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f16837fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1684143e60 0x7f1684149b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51014/0 (socket says 172.21.15.62:51014) 2023-05-15T16:40:04.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f16837fe640 1 -- 172.21.15.62:0/971457860 learned_addr learned my addr 172.21.15.62:0/971457860 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:04.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1683fff640 1 --2- 172.21.15.62:0/971457860 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f16840b1b80 0x7f1684154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:04.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f16837fe640 1 -- 172.21.15.62:0/971457860 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f16840b1b80 msgr2=0x7f1684154470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:04.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f16837fe640 1 --2- 172.21.15.62:0/971457860 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f16840b1b80 0x7f1684154470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f16837fe640 1 -- 172.21.15.62:0/971457860 >> v1:172.21.15.161:6789/0 conn(0x7f16840b91a0 legacy=0x7f16840b9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:04.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f16837fe640 1 -- 172.21.15.62:0/971457860 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16840ba440 con 0x7f1684143e60 2023-05-15T16:40:04.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f16837fe640 1 --2- 172.21.15.62:0/971457860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1684143e60 0x7f1684149b10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1674009870 tx=0x7f167401ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a27bf333654a1999 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:04.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f16827fc640 1 -- 172.21.15.62:0/971457860 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16740a89b0 con 0x7f1684143e60 2023-05-15T16:40:04.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f16827fc640 1 -- 172.21.15.62:0/971457860 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16740a8b10 con 0x7f1684143e60 2023-05-15T16:40:04.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f16827fc640 1 -- 172.21.15.62:0/971457860 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16740a8ea0 con 0x7f1684143e60 2023-05-15T16:40:04.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 -- 172.21.15.62:0/971457860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1684143e60 msgr2=0x7f1684149b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:04.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 --2- 172.21.15.62:0/971457860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1684143e60 0x7f1684149b10 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1674009870 tx=0x7f167401ecf0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 -- 172.21.15.62:0/971457860 shutdown_connections 2023-05-15T16:40:04.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 --2- 172.21.15.62:0/971457860 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f16840b1b80 0x7f1684154470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 --2- 172.21.15.62:0/971457860 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1684143e60 0x7f1684149b10 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 -- 172.21.15.62:0/971457860 >> 172.21.15.62:0/971457860 conn(0x7f16840bd830 msgr2=0x7f16840b9620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:04.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 -- 172.21.15.62:0/971457860 shutdown_connections 2023-05-15T16:40:04.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 -- 172.21.15.62:0/971457860 wait complete. 2023-05-15T16:40:04.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 Processor -- start 2023-05-15T16:40:04.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 -- start start 2023-05-15T16:40:04.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16840b1b80 0x7f1684070a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:04.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f16840b91a0 0x7f16840b5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:04.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1684143e60 0x7f16840b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:04.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16840b5230 con 0x7f1684143e60 2023-05-15T16:40:04.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1684070fd0 con 0x7f16840b1b80 2023-05-15T16:40:04.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16840b7060 con 0x7f16840b91a0 2023-05-15T16:40:04.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1683fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1684143e60 0x7f16840b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:04.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1683fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1684143e60 0x7f16840b4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51030/0 (socket says 172.21.15.62:51030) 2023-05-15T16:40:04.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1683fff640 1 -- 172.21.15.62:0/32126850 learned_addr learned my addr 172.21.15.62:0/32126850 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:04.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f16837fe640 1 --2- 172.21.15.62:0/32126850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16840b1b80 0x7f1684070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:04.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1682ffd640 1 --2- 172.21.15.62:0/32126850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f16840b91a0 0x7f16840b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:04.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1683fff640 1 -- 172.21.15.62:0/32126850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f16840b91a0 msgr2=0x7f16840b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:04.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1683fff640 1 --2- 172.21.15.62:0/32126850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f16840b91a0 0x7f16840b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1683fff640 1 -- 172.21.15.62:0/32126850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16840b1b80 msgr2=0x7f1684070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:04.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1683fff640 1 --2- 172.21.15.62:0/32126850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16840b1b80 0x7f1684070a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1683fff640 1 -- 172.21.15.62:0/32126850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16740094d0 con 0x7f1684143e60 2023-05-15T16:40:04.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1683fff640 1 --2- 172.21.15.62:0/32126850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1684143e60 0x7f16840b4580 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f167c007e40 tx=0x7f167c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:04.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f167bfff640 1 -- 172.21.15.62:0/32126850 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167c014620 con 0x7f1684143e60 2023-05-15T16:40:04.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f167bfff640 1 -- 172.21.15.62:0/32126850 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f167c00ee90 con 0x7f1684143e60 2023-05-15T16:40:04.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 -- 172.21.15.62:0/32126850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f168414d180 con 0x7f1684143e60 2023-05-15T16:40:04.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f167bfff640 1 -- 172.21.15.62:0/32126850 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f167c0149e0 con 0x7f1684143e60 2023-05-15T16:40:04.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 -- 172.21.15.62:0/32126850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16840b2130 con 0x7f1684143e60 2023-05-15T16:40:04.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.295+0000 7f1689ded640 1 -- 172.21.15.62:0/32126850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f168414d460 con 0x7f1684143e60 2023-05-15T16:40:04.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.299+0000 7f167bfff640 1 -- 172.21.15.62:0/32126850 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f167c014b40 con 0x7f1684143e60 2023-05-15T16:40:04.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.299+0000 7f167bfff640 1 --2- 172.21.15.62:0/32126850 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1664065380 0x7f1664067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:04.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.299+0000 7f167bfff640 1 -- 172.21.15.62:0/32126850 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f167c084010 con 0x7f1684143e60 2023-05-15T16:40:04.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.299+0000 7f16837fe640 1 --2- 172.21.15.62:0/32126850 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1664065380 0x7f1664067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:04.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.299+0000 7f16837fe640 1 --2- 172.21.15.62:0/32126850 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1664065380 0x7f1664067830 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f16740b2000 tx=0x7f1674008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:04.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.303+0000 7f167bfff640 1 -- 172.21.15.62:0/32126850 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f167c051e00 con 0x7f1684143e60 2023-05-15T16:40:04.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.455+0000 7f1689ded640 1 -- 172.21.15.62:0/32126850 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16840b42a0 con 0x7f1684143e60 2023-05-15T16:40:04.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.459+0000 7f167bfff640 1 -- 172.21.15.62:0/32126850 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17811 (secure 0 0 0) 0x7f167c055420 con 0x7f1684143e60 2023-05-15T16:40:04.468 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:04.468 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:40:02.088078+0000","last_up_change":"2023-05-15T16:39:48.597049+0000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-15T16:39:49.394028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-15T16:39:55.208679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-15T16:39:59.547414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-15T16:40:00.055526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37594},{"type":"v1","addr":"172.21.15.62:6825","nonce":37594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37594},{"type":"v1","addr":"172.21.15.62:6827","nonce":37594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37594},{"type":"v1","addr":"172.21.15.62:6831","nonce":37594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37594},{"type":"v1","addr":"172.21.15.62:6829","nonce":37594}]},"public_addr":"172.21.15.62:6825/37594","cluster_addr":"172.21.15.62:6827/37594","heartbeat_back_addr":"172.21.15.62:6831/37594","heartbeat_front_addr":"172.21.15.62:6829/37594","state":["exists","up"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37592},{"type":"v1","addr":"172.21.15.62:6808","nonce":37592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":37592},{"type":"v1","addr":"172.21.15.62:6814","nonce":37592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6821","nonce":37592},{"type":"v1","addr":"172.21.15.62:6823","nonce":37592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37592},{"type":"v1","addr":"172.21.15.62:6818","nonce":37592}]},"public_addr":"172.21.15.62:6808/37592","cluster_addr":"172.21.15.62:6814/37592","heartbeat_back_addr":"172.21.15.62:6823/37592","heartbeat_front_addr":"172.21.15.62:6818/37592","state":["exists","up"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":37591},{"type":"v1","addr":"172.21.15.62:6810","nonce":37591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":37591},{"type":"v1","addr":"172.21.15.62:6815","nonce":37591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37591},{"type":"v1","addr":"172.21.15.62:6822","nonce":37591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":37591},{"type":"v1","addr":"172.21.15.62:6819","nonce":37591}]},"public_addr":"172.21.15.62:6810/37591","cluster_addr":"172.21.15.62:6815/37591","heartbeat_back_addr":"172.21.15.62:6822/37591","heartbeat_front_addr":"172.21.15.62:6819/37591","state":["exists","up"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37593},{"type":"v1","addr":"172.21.15.62:6801","nonce":37593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37593},{"type":"v1","addr":"172.21.15.62:6803","nonce":37593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":37593},{"type":"v1","addr":"172.21.15.62:6812","nonce":37593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37593},{"type":"v1","addr":"172.21.15.62:6805","nonce":37593}]},"public_addr":"172.21.15.62:6801/37593","cluster_addr":"172.21.15.62:6803/37593","heartbeat_back_addr":"172.21.15.62:6812/37593","heartbeat_front_addr":"172.21.15.62:6805/37593","state":["exists","up"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37854},{"type":"v1","addr":"172.21.15.161:6801","nonce":37854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37854},{"type":"v1","addr":"172.21.15.161:6803","nonce":37854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37854},{"type":"v1","addr":"172.21.15.161:6807","nonce":37854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37854},{"type":"v1","addr":"172.21.15.161:6805","nonce":37854}]},"public_addr":"172.21.15.161:6801/37854","cluster_addr":"172.21.15.161:6803/37854","heartbeat_back_addr":"172.21.15.161:6807/37854","heartbeat_front_addr":"172.21.15.161:6805/37854","state":["exists","up"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37855},{"type":"v1","addr":"172.21.15.161:6810","nonce":37855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37855},{"type":"v1","addr":"172.21.15.161:6815","nonce":37855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37855},{"type":"v1","addr":"172.21.15.161:6824","nonce":37855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37855},{"type":"v1","addr":"172.21.15.161:6820","nonce":37855}]},"public_addr":"172.21.15.161:6810/37855","cluster_addr":"172.21.15.161:6815/37855","heartbeat_back_addr":"172.21.15.161:6824/37855","heartbeat_front_addr":"172.21.15.161:6820/37855","state":["exists","up"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":37856},{"type":"v1","addr":"172.21.15.161:6814","nonce":37856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37856},{"type":"v1","addr":"172.21.15.161:6819","nonce":37856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":37856},{"type":"v1","addr":"172.21.15.161:6830","nonce":37856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37856},{"type":"v1","addr":"172.21.15.161:6826","nonce":37856}]},"public_addr":"172.21.15.161:6814/37856","cluster_addr":"172.21.15.161:6819/37856","heartbeat_back_addr":"172.21.15.161:6830/37856","heartbeat_front_addr":"172.21.15.161:6826/37856","state":["exists","up"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":37857},{"type":"v1","addr":"172.21.15.161:6813","nonce":37857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":37857},{"type":"v1","addr":"172.21.15.161:6821","nonce":37857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":37857},{"type":"v1","addr":"172.21.15.161:6831","nonce":37857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":37857},{"type":"v1","addr":"172.21.15.161:6827","nonce":37857}]},"public_addr":"172.21.15.161:6813/37857","cluster_addr":"172.21.15.161:6821/37857","heartbeat_back_addr":"172.21.15.161:6831/37857","heartbeat_front_addr":"172.21.15.161:6827/37857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.592907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.618143+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.641533+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.614355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.579293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.718353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.730135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.792887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:40:04.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.463+0000 7f1689ded640 1 -- 172.21.15.62:0/32126850 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1664065380 msgr2=0x7f1664067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:04.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.463+0000 7f1689ded640 1 --2- 172.21.15.62:0/32126850 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1664065380 0x7f1664067830 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f16740b2000 tx=0x7f1674008040 comp rx=0 tx=0).stop 2023-05-15T16:40:04.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.463+0000 7f1689ded640 1 -- 172.21.15.62:0/32126850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1684143e60 msgr2=0x7f16840b4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:04.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.463+0000 7f1689ded640 1 --2- 172.21.15.62:0/32126850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1684143e60 0x7f16840b4580 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f167c007e40 tx=0x7f167c00e4b0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.463+0000 7f1689ded640 1 -- 172.21.15.62:0/32126850 shutdown_connections 2023-05-15T16:40:04.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.463+0000 7f1689ded640 1 --2- 172.21.15.62:0/32126850 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1664065380 0x7f1664067830 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.463+0000 7f1689ded640 1 --2- 172.21.15.62:0/32126850 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1684143e60 0x7f16840b4580 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.463+0000 7f1689ded640 1 --2- 172.21.15.62:0/32126850 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f16840b91a0 0x7f16840b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.463+0000 7f1689ded640 1 --2- 172.21.15.62:0/32126850 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f16840b1b80 0x7f1684070a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.463+0000 7f1689ded640 1 -- 172.21.15.62:0/32126850 >> 172.21.15.62:0/32126850 conn(0x7f16840bd830 msgr2=0x7f16840bb330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:04.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.463+0000 7f1689ded640 1 -- 172.21.15.62:0/32126850 shutdown_connections 2023-05-15T16:40:04.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.463+0000 7f1689ded640 1 -- 172.21.15.62:0/32126850 wait complete. 2023-05-15T16:40:04.486 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-15T16:40:04.486 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-15T16:40:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.591+0000 7fc8ac9c4640 1 Processor -- start 2023-05-15T16:40:04.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.591+0000 7fc8ac9c4640 1 -- start start 2023-05-15T16:40:04.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.591+0000 7fc8ac9c4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc8a80b5330 0x7fc8a80b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:04.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.591+0000 7fc8ac9c4640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc8a8071a90 0x7fc8a80b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:04.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.591+0000 7fc8ac9c4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8a8144e90 0x7fc8a8145310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:04.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.591+0000 7fc8ac9c4640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a80b2280 con 0x7fc8a80b5330 2023-05-15T16:40:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.591+0000 7fc8ac9c4640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8a80716b0 con 0x7fc8a8071a90 2023-05-15T16:40:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.591+0000 7fc8ac9c4640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80afa90 con 0x7fc8a8144e90 2023-05-15T16:40:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.591+0000 7fc8a659c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc8a80b5330 0x7fc8a80b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.591+0000 7fc8a659c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc8a80b5330 0x7fc8a80b5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51042/0 (socket says 172.21.15.62:51042) 2023-05-15T16:40:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.591+0000 7fc8a659c640 1 -- 172.21.15.62:0/999374579 learned_addr learned my addr 172.21.15.62:0/999374579 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.591+0000 7fc8a5d9b640 1 --2- 172.21.15.62:0/999374579 >> v2:172.21.15.161:3300/0 conn(0x7fc8a8071a90 0x7fc8a80b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:04.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.591+0000 7fc8a6d9d640 1 --2- 172.21.15.62:0/999374579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8a8144e90 0x7fc8a8145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.591+0000 7fc8a659c640 1 -- 172.21.15.62:0/999374579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8a8144e90 msgr2=0x7fc8a8145310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.591+0000 7fc8a659c640 1 --2- 172.21.15.62:0/999374579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8a8144e90 0x7fc8a8145310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.591+0000 7fc8a659c640 1 -- 172.21.15.62:0/999374579 >> v2:172.21.15.161:3300/0 conn(0x7fc8a8071a90 msgr2=0x7fc8a80b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:04.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.591+0000 7fc8a659c640 1 --2- 172.21.15.62:0/999374579 >> v2:172.21.15.161:3300/0 conn(0x7fc8a8071a90 0x7fc8a80b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.591+0000 7fc8a659c640 1 -- 172.21.15.62:0/999374579 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a80b0f00 con 0x7fc8a80b5330 2023-05-15T16:40:04.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8a659c640 1 --2- 172.21.15.62:0/999374579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8a80b5330 0x7fc8a80b5700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80b06b0 tx=0x7fc89801c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=106a91b1475c444d server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:04.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8a559a640 1 -- 172.21.15.62:0/999374579 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8980aa5f0 con 0x7fc8a80b5330 2023-05-15T16:40:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8a559a640 1 -- 172.21.15.62:0/999374579 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8980aa750 con 0x7fc8a80b5330 2023-05-15T16:40:04.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8a559a640 1 -- 172.21.15.62:0/999374579 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8980aaae0 con 0x7fc8a80b5330 2023-05-15T16:40:04.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8ac9c4640 1 -- 172.21.15.62:0/999374579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8a80b5330 msgr2=0x7fc8a80b5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:04.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8ac9c4640 1 --2- 172.21.15.62:0/999374579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8a80b5330 0x7fc8a80b5700 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc8a80b06b0 tx=0x7fc89801c4d0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8ac9c4640 1 -- 172.21.15.62:0/999374579 shutdown_connections 2023-05-15T16:40:04.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8ac9c4640 1 --2- 172.21.15.62:0/999374579 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8a8144e90 0x7fc8a8145310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8ac9c4640 1 --2- 172.21.15.62:0/999374579 >> v2:172.21.15.161:3300/0 conn(0x7fc8a8071a90 0x7fc8a80b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8ac9c4640 1 --2- 172.21.15.62:0/999374579 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8a80b5330 0x7fc8a80b5700 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8ac9c4640 1 -- 172.21.15.62:0/999374579 >> 172.21.15.62:0/999374579 conn(0x7fc8a80653f0 msgr2=0x7fc8a80697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:04.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8ac9c4640 1 -- 172.21.15.62:0/999374579 shutdown_connections 2023-05-15T16:40:04.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8ac9c4640 1 -- 172.21.15.62:0/999374579 wait complete. 2023-05-15T16:40:04.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8ac9c4640 1 Processor -- start 2023-05-15T16:40:04.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8ac9c4640 1 -- start start 2023-05-15T16:40:04.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8ac9c4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8a8071a90 0x7fc8a8070400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:04.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8ac9c4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8a80b5330 0x7fc8a813f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:04.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8ac9c4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8a8144e90 0x7fc8a81504b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:04.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8ac9c4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a8151b80 con 0x7fc8a8144e90 2023-05-15T16:40:04.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8ac9c4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80b3160 con 0x7fc8a8071a90 2023-05-15T16:40:04.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8ac9c4640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a80b4f30 con 0x7fc8a80b5330 2023-05-15T16:40:04.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8a6d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8a8144e90 0x7fc8a81504b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:04.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8a6d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8a8144e90 0x7fc8a81504b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:51044/0 (socket says 172.21.15.62:51044) 2023-05-15T16:40:04.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8a6d9d640 1 -- 172.21.15.62:0/3107757045 learned_addr learned my addr 172.21.15.62:0/3107757045 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:04.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.595+0000 7fc8a659c640 1 --2- 172.21.15.62:0/3107757045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8a8071a90 0x7fc8a8070400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:04.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.599+0000 7fc8a5d9b640 1 --2- 172.21.15.62:0/3107757045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8a80b5330 0x7fc8a813f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:04.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.599+0000 7fc8a6d9d640 1 -- 172.21.15.62:0/3107757045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8a80b5330 msgr2=0x7fc8a813f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:04.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.599+0000 7fc8a6d9d640 1 --2- 172.21.15.62:0/3107757045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8a80b5330 0x7fc8a813f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.599+0000 7fc8a6d9d640 1 -- 172.21.15.62:0/3107757045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8a8071a90 msgr2=0x7fc8a8070400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:04.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.599+0000 7fc8a6d9d640 1 --2- 172.21.15.62:0/3107757045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8a8071a90 0x7fc8a8070400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.599+0000 7fc8a6d9d640 1 -- 172.21.15.62:0/3107757045 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8980094d0 con 0x7fc8a8144e90 2023-05-15T16:40:04.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.599+0000 7fc8a5d9b640 1 --2- 172.21.15.62:0/3107757045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8a80b5330 0x7fc8a813f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:04.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.599+0000 7fc8a6d9d640 1 --2- 172.21.15.62:0/3107757045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8a8144e90 0x7fc8a81504b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0007e60 tx=0x7fc8a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:04.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.599+0000 7fc896ffd640 1 -- 172.21.15.62:0/3107757045 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0014420 con 0x7fc8a8144e90 2023-05-15T16:40:04.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.599+0000 7fc896ffd640 1 -- 172.21.15.62:0/3107757045 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a00145a0 con 0x7fc8a8144e90 2023-05-15T16:40:04.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.599+0000 7fc8ac9c4640 1 -- 172.21.15.62:0/3107757045 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a80b1ec0 con 0x7fc8a8144e90 2023-05-15T16:40:04.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.599+0000 7fc896ffd640 1 -- 172.21.15.62:0/3107757045 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a0014950 con 0x7fc8a8144e90 2023-05-15T16:40:04.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.599+0000 7fc8ac9c4640 1 -- 172.21.15.62:0/3107757045 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a80b1c00 con 0x7fc8a8144e90 2023-05-15T16:40:04.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.599+0000 7fc8ac9c4640 1 -- 172.21.15.62:0/3107757045 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a80b2050 con 0x7fc8a8144e90 2023-05-15T16:40:04.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.599+0000 7fc896ffd640 1 -- 172.21.15.62:0/3107757045 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fc8a0014ab0 con 0x7fc8a8144e90 2023-05-15T16:40:04.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.599+0000 7fc896ffd640 1 --2- 172.21.15.62:0/3107757045 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc888065380 0x7fc888067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:04.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.599+0000 7fc896ffd640 1 -- 172.21.15.62:0/3107757045 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc8a00831a0 con 0x7fc8a8144e90 2023-05-15T16:40:04.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.599+0000 7fc8a659c640 1 --2- 172.21.15.62:0/3107757045 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc888065380 0x7fc888067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:04.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.599+0000 7fc8a659c640 1 --2- 172.21.15.62:0/3107757045 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc888065380 0x7fc888067830 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc8980ae000 tx=0x7fc8980a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:04.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.603+0000 7fc896ffd640 1 -- 172.21.15.62:0/3107757045 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fc8a00547c0 con 0x7fc8a8144e90 2023-05-15T16:40:04.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.747+0000 7fc8ac9c4640 1 -- 172.21.15.62:0/3107757045 --> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc8a804dbe0 con 0x7fc888065380 2023-05-15T16:40:04.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.771+0000 7fc896ffd640 1 -- 172.21.15.62:0/3107757045 <== mgr.4105 v2:172.21.15.161:6832/37541 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271914 (secure 0 0 0) 0x7fc8a804dbe0 con 0x7fc888065380 2023-05-15T16:40:04.782 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:04.783 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-05-15T16:40:04.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.771+0000 7fc8ac9c4640 1 -- 172.21.15.62:0/3107757045 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc888065380 msgr2=0x7fc888067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:04.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.771+0000 7fc8ac9c4640 1 --2- 172.21.15.62:0/3107757045 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc888065380 0x7fc888067830 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fc8980ae000 tx=0x7fc8980a7000 comp rx=0 tx=0).stop 2023-05-15T16:40:04.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.771+0000 7fc8ac9c4640 1 -- 172.21.15.62:0/3107757045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8a8144e90 msgr2=0x7fc8a81504b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:04.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.771+0000 7fc8ac9c4640 1 --2- 172.21.15.62:0/3107757045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8a8144e90 0x7fc8a81504b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fc8a0007e60 tx=0x7fc8a000e4b0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.771+0000 7fc8ac9c4640 1 -- 172.21.15.62:0/3107757045 shutdown_connections 2023-05-15T16:40:04.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.771+0000 7fc8ac9c4640 1 --2- 172.21.15.62:0/3107757045 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc888065380 0x7fc888067830 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.771+0000 7fc8ac9c4640 1 --2- 172.21.15.62:0/3107757045 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc8a8144e90 0x7fc8a81504b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.771+0000 7fc8ac9c4640 1 --2- 172.21.15.62:0/3107757045 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc8a80b5330 0x7fc8a813f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.771+0000 7fc8ac9c4640 1 --2- 172.21.15.62:0/3107757045 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8a8071a90 0x7fc8a8070400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.771+0000 7fc8ac9c4640 1 -- 172.21.15.62:0/3107757045 >> 172.21.15.62:0/3107757045 conn(0x7fc8a80653f0 msgr2=0x7fc8a80697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:04.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.771+0000 7fc8ac9c4640 1 -- 172.21.15.62:0/3107757045 shutdown_connections 2023-05-15T16:40:04.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.771+0000 7fc8ac9c4640 1 -- 172.21.15.62:0/3107757045 wait complete. 2023-05-15T16:40:04.798 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-05-15T16:40:03.316577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":64680,"kb_used_data":2664,"kb_used_omap":0,"kb_used_meta":61952,"kb_avail":754910040,"statfs":{"total":773094113280,"available":773027880960,"internally_reserved":0,"allocated":2727936,"data_stored":1684960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":63438848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001126"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-05-15T16:39:56.690933+0000","last_change":"2023-05-15T16:39:50.637320+0000","last_active":"2023-05-15T16:39:56.690933+0000","last_peered":"2023-05-15T16:39:56.690933+0000","last_clean":"2023-05-15T16:39:56.690933+0000","last_became_active":"2023-05-15T16:39:50.636541+0000","last_became_peered":"2023-05-15T16:39:50.636541+0000","last_unstale":"2023-05-15T16:39:56.690933+0000","last_undegraded":"2023-05-15T16:39:56.690933+0000","last_fullsized":"2023-05-15T16:39:56.690933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:49.601783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:49.601783+0000","last_clean_scrub_stamp":"2023-05-15T16:39:49.601783+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:18:01.941203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-05-15T16:39:57.979778+0000","last_change":"2023-05-15T16:39:56.699270+0000","last_active":"2023-05-15T16:39:57.979778+0000","last_peered":"2023-05-15T16:39:57.979778+0000","last_clean":"2023-05-15T16:39:57.979778+0000","last_became_active":"2023-05-15T16:39:56.698429+0000","last_became_peered":"2023-05-15T16:39:56.698429+0000","last_unstale":"2023-05-15T16:39:57.979778+0000","last_undegraded":"2023-05-15T16:39:57.979778+0000","last_fullsized":"2023-05-15T16:39:57.979778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:31.428692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-05-15T16:39:57.980513+0000","last_change":"2023-05-15T16:39:56.700800+0000","last_active":"2023-05-15T16:39:57.980513+0000","last_peered":"2023-05-15T16:39:57.980513+0000","last_clean":"2023-05-15T16:39:57.980513+0000","last_became_active":"2023-05-15T16:39:56.700022+0000","last_became_peered":"2023-05-15T16:39:56.700022+0000","last_unstale":"2023-05-15T16:39:57.980513+0000","last_undegraded":"2023-05-15T16:39:57.980513+0000","last_fullsized":"2023-05-15T16:39:57.980513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:11:54.752932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-05-15T16:39:57.975865+0000","last_change":"2023-05-15T16:39:57.018815+0000","last_active":"2023-05-15T16:39:57.975865+0000","last_peered":"2023-05-15T16:39:57.975865+0000","last_clean":"2023-05-15T16:39:57.975865+0000","last_became_active":"2023-05-15T16:39:57.018404+0000","last_became_peered":"2023-05-15T16:39:57.018404+0000","last_unstale":"2023-05-15T16:39:57.975865+0000","last_undegraded":"2023-05-15T16:39:57.975865+0000","last_fullsized":"2023-05-15T16:39:57.975865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-05-15T16:39:57.979723+0000","last_change":"2023-05-15T16:39:56.701269+0000","last_active":"2023-05-15T16:39:57.979723+0000","last_peered":"2023-05-15T16:39:57.979723+0000","last_clean":"2023-05-15T16:39:57.979723+0000","last_became_active":"2023-05-15T16:39:56.700221+0000","last_became_peered":"2023-05-15T16:39:56.700221+0000","last_unstale":"2023-05-15T16:39:57.979723+0000","last_undegraded":"2023-05-15T16:39:57.979723+0000","last_fullsized":"2023-05-15T16:39:57.979723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-05-15T16:39:57.681000+0000","last_change":"2023-05-15T16:39:56.692931+0000","last_active":"2023-05-15T16:39:57.681000+0000","last_peered":"2023-05-15T16:39:57.681000+0000","last_clean":"2023-05-15T16:39:57.681000+0000","last_became_active":"2023-05-15T16:39:56.692557+0000","last_became_peered":"2023-05-15T16:39:56.692557+0000","last_unstale":"2023-05-15T16:39:57.681000+0000","last_undegraded":"2023-05-15T16:39:57.681000+0000","last_fullsized":"2023-05-15T16:39:57.681000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-05-15T16:39:57.980585+0000","last_change":"2023-05-15T16:39:56.698079+0000","last_active":"2023-05-15T16:39:57.980585+0000","last_peered":"2023-05-15T16:39:57.980585+0000","last_clean":"2023-05-15T16:39:57.980585+0000","last_became_active":"2023-05-15T16:39:56.697298+0000","last_became_peered":"2023-05-15T16:39:56.697298+0000","last_unstale":"2023-05-15T16:39:57.980585+0000","last_undegraded":"2023-05-15T16:39:57.980585+0000","last_fullsized":"2023-05-15T16:39:57.980585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:32:01.734351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-05-15T16:39:57.680994+0000","last_change":"2023-05-15T16:39:56.694298+0000","last_active":"2023-05-15T16:39:57.680994+0000","last_peered":"2023-05-15T16:39:57.680994+0000","last_clean":"2023-05-15T16:39:57.680994+0000","last_became_active":"2023-05-15T16:39:56.693723+0000","last_became_peered":"2023-05-15T16:39:56.693723+0000","last_unstale":"2023-05-15T16:39:57.680994+0000","last_undegraded":"2023-05-15T16:39:57.680994+0000","last_fullsized":"2023-05-15T16:39:57.680994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:31.428692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-05-15T16:39:57.979678+0000","last_change":"2023-05-15T16:39:56.697003+0000","last_active":"2023-05-15T16:39:57.979678+0000","last_peered":"2023-05-15T16:39:57.979678+0000","last_clean":"2023-05-15T16:39:57.979678+0000","last_became_active":"2023-05-15T16:39:56.696210+0000","last_became_peered":"2023-05-15T16:39:56.696210+0000","last_unstale":"2023-05-15T16:39:57.979678+0000","last_undegraded":"2023-05-15T16:39:57.979678+0000","last_fullsized":"2023-05-15T16:39:57.979678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:29:27.454964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8904,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94362936,"statfs":{"total":96636764160,"available":96627646464,"internally_reserved":0,"allocated":786432,"data_stored":653396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7812,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364028,"statfs":{"total":96636764160,"available":96628764672,"internally_reserved":0,"allocated":192512,"data_stored":63028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7812,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364028,"statfs":{"total":96636764160,"available":96628764672,"internally_reserved":0,"allocated":192512,"data_stored":63028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":7812,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364028,"statfs":{"total":96636764160,"available":96628764672,"internally_reserved":0,"allocated":192512,"data_stored":63028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7812,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364028,"statfs":{"total":96636764160,"available":96628764672,"internally_reserved":0,"allocated":192512,"data_stored":63028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4650000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7812,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364028,"statfs":{"total":96636764160,"available":96628764672,"internally_reserved":0,"allocated":192512,"data_stored":63028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7812,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364028,"statfs":{"total":96636764160,"available":96628764672,"internally_reserved":0,"allocated":192512,"data_stored":63028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8904,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94362936,"statfs":{"total":96636764160,"available":96627646464,"internally_reserved":0,"allocated":786432,"data_stored":653396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-15T16:40:04.805 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-15T16:40:04.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.959+0000 7f75c2da6640 1 Processor -- start 2023-05-15T16:40:04.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.959+0000 7f75c2da6640 1 -- start start 2023-05-15T16:40:04.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f75bc071a90 0x7f75bc0b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:04.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75bc0716b0 con 0x7f75bc0b5330 2023-05-15T16:40:04.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75bc0afa90 con 0x7f75bc144e90 2023-05-15T16:40:04.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75bc0b2280 con 0x7f75bc071a90 2023-05-15T16:40:04.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75bbfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f75bc071a90 0x7f75bc0b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:04.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c0b42640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f75bc0b5330 0x7f75bc0b16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37786/0 (socket says 172.21.15.62:37786) 2023-05-15T16:40:04.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c0b42640 1 -- 172.21.15.62:0/349671345 learned_addr learned my addr 172.21.15.62:0/349671345 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:04.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75bbfff640 1 -- 172.21.15.62:0/349671345 >> v1:172.21.15.161:6789/0 conn(0x7f75bc144e90 legacy=0x7f75bc152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:04.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75bbfff640 1 -- 172.21.15.62:0/349671345 >> v1:172.21.15.62:6789/0 conn(0x7f75bc0b5330 legacy=0x7f75bc0b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:04.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75bbfff640 1 -- 172.21.15.62:0/349671345 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc0b0f00 con 0x7f75bc071a90 2023-05-15T16:40:04.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75bb7fe640 1 -- 172.21.15.62:0/349671345 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3714236106 0 0) 0x7f75bc0716b0 con 0x7f75bc0b5330 2023-05-15T16:40:04.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75bbfff640 1 --2- 172.21.15.62:0/349671345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75bc071a90 0x7f75bc0b5700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009d90 tx=0x7f75a801f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d059fb04483723 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:04.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75bb7fe640 1 -- 172.21.15.62:0/349671345 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a80af600 con 0x7f75bc071a90 2023-05-15T16:40:04.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75bb7fe640 1 -- 172.21.15.62:0/349671345 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a80ab050 con 0x7f75bc071a90 2023-05-15T16:40:04.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75bb7fe640 1 -- 172.21.15.62:0/349671345 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a80af980 con 0x7f75bc071a90 2023-05-15T16:40:04.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 -- 172.21.15.62:0/349671345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75bc071a90 msgr2=0x7f75bc0b5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:04.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 --2- 172.21.15.62:0/349671345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75bc071a90 0x7f75bc0b5700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f75a8009d90 tx=0x7f75a801f100 comp rx=0 tx=0).stop 2023-05-15T16:40:04.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 -- 172.21.15.62:0/349671345 shutdown_connections 2023-05-15T16:40:04.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 --2- 172.21.15.62:0/349671345 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75bc071a90 0x7f75bc0b5700 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 -- 172.21.15.62:0/349671345 >> 172.21.15.62:0/349671345 conn(0x7f75bc0653f0 msgr2=0x7f75bc0697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:04.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 -- 172.21.15.62:0/349671345 shutdown_connections 2023-05-15T16:40:04.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 -- 172.21.15.62:0/349671345 wait complete. 2023-05-15T16:40:04.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 Processor -- start 2023-05-15T16:40:04.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 -- start start 2023-05-15T16:40:04.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75bc071a90 0x7f75bc141c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75bc0b5330 0x7f75bc1457b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75bc144e90 0x7f75bc13de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc1421c0 con 0x7f75bc071a90 2023-05-15T16:40:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc1e0da0 con 0x7f75bc0b5330 2023-05-15T16:40:04.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75bc147f10 con 0x7f75bc144e90 2023-05-15T16:40:04.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c0b42640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75bc071a90 0x7f75bc141c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:04.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c0b42640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75bc071a90 0x7f75bc141c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42518/0 (socket says 172.21.15.62:42518) 2023-05-15T16:40:04.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c0b42640 1 -- 172.21.15.62:0/1123282160 learned_addr learned my addr 172.21.15.62:0/1123282160 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:04.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75bbfff640 1 --2- 172.21.15.62:0/1123282160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75bc0b5330 0x7f75bc1457b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:04.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c1343640 1 --2- 172.21.15.62:0/1123282160 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75bc144e90 0x7f75bc13de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:04.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c0b42640 1 -- 172.21.15.62:0/1123282160 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75bc144e90 msgr2=0x7f75bc13de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:04.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c0b42640 1 --2- 172.21.15.62:0/1123282160 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75bc144e90 0x7f75bc13de60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c0b42640 1 -- 172.21.15.62:0/1123282160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75bc0b5330 msgr2=0x7f75bc1457b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:04.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c0b42640 1 --2- 172.21.15.62:0/1123282160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75bc0b5330 0x7f75bc1457b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:04.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c0b42640 1 -- 172.21.15.62:0/1123282160 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a8009a70 con 0x7f75bc071a90 2023-05-15T16:40:04.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75bbfff640 1 --2- 172.21.15.62:0/1123282160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75bc0b5330 0x7f75bc1457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:04.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c0b42640 1 --2- 172.21.15.62:0/1123282160 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75bc071a90 0x7f75bc141c80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00c520 tx=0x7f75ac00c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:04.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75b97fa640 1 -- 172.21.15.62:0/1123282160 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac0074e0 con 0x7f75bc071a90 2023-05-15T16:40:04.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75b97fa640 1 -- 172.21.15.62:0/1123282160 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75ac007640 con 0x7f75bc071a90 2023-05-15T16:40:04.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 -- 172.21.15.62:0/1123282160 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75bc0b11a0 con 0x7f75bc071a90 2023-05-15T16:40:04.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75b97fa640 1 -- 172.21.15.62:0/1123282160 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75ac0049f0 con 0x7f75bc071a90 2023-05-15T16:40:04.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 -- 172.21.15.62:0/1123282160 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75bc0af7b0 con 0x7f75bc071a90 2023-05-15T16:40:04.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.963+0000 7f75c2da6640 1 -- 172.21.15.62:0/1123282160 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75bc0b1ec0 con 0x7f75bc071a90 2023-05-15T16:40:04.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.967+0000 7f75b97fa640 1 -- 172.21.15.62:0/1123282160 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f75ac004b50 con 0x7f75bc071a90 2023-05-15T16:40:04.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.967+0000 7f75b97fa640 1 --2- 172.21.15.62:0/1123282160 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f75a4065380 0x7f75a4067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:04.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.967+0000 7f75b97fa640 1 -- 172.21.15.62:0/1123282160 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f75ac0819f0 con 0x7f75bc071a90 2023-05-15T16:40:04.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.967+0000 7f75bbfff640 1 --2- 172.21.15.62:0/1123282160 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f75a4065380 0x7f75a4067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:04.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.967+0000 7f75bbfff640 1 --2- 172.21.15.62:0/1123282160 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f75a4065380 0x7f75a4067830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f75a80b1000 tx=0x7f75a80aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:04.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:04.971+0000 7f75b97fa640 1 -- 172.21.15.62:0/1123282160 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f75ac04a620 con 0x7f75bc071a90 2023-05-15T16:40:05.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.119+0000 7f75c2da6640 1 -- 172.21.15.62:0/1123282160 --> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f75bc1e0550 con 0x7f75a4065380 2023-05-15T16:40:05.147 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.139+0000 7f75b97fa640 1 -- 172.21.15.62:0/1123282160 <== mgr.4105 v2:172.21.15.161:6832/37541 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271914 (secure 0 0 0) 0x7f75bc1e0550 con 0x7f75a4065380 2023-05-15T16:40:05.152 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:05.155 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-05-15T16:40:05.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.143+0000 7f75c2da6640 1 -- 172.21.15.62:0/1123282160 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f75a4065380 msgr2=0x7f75a4067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:05.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.143+0000 7f75c2da6640 1 --2- 172.21.15.62:0/1123282160 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f75a4065380 0x7f75a4067830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f75a80b1000 tx=0x7f75a80aa000 comp rx=0 tx=0).stop 2023-05-15T16:40:05.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.143+0000 7f75c2da6640 1 -- 172.21.15.62:0/1123282160 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75bc071a90 msgr2=0x7f75bc141c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:05.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.143+0000 7f75c2da6640 1 --2- 172.21.15.62:0/1123282160 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75bc071a90 0x7f75bc141c80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f75ac00c520 tx=0x7f75ac00c9e0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.143+0000 7f75c2da6640 1 -- 172.21.15.62:0/1123282160 shutdown_connections 2023-05-15T16:40:05.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.143+0000 7f75c2da6640 1 --2- 172.21.15.62:0/1123282160 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f75bc144e90 0x7f75bc13de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.143+0000 7f75c2da6640 1 --2- 172.21.15.62:0/1123282160 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f75bc0b5330 0x7f75bc1457b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.143+0000 7f75c2da6640 1 --2- 172.21.15.62:0/1123282160 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f75a4065380 0x7f75a4067830 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.143+0000 7f75c2da6640 1 --2- 172.21.15.62:0/1123282160 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f75bc071a90 0x7f75bc141c80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.143+0000 7f75c2da6640 1 -- 172.21.15.62:0/1123282160 >> 172.21.15.62:0/1123282160 conn(0x7f75bc0653f0 msgr2=0x7f75bc0bad00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:05.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.143+0000 7f75c2da6640 1 -- 172.21.15.62:0/1123282160 shutdown_connections 2023-05-15T16:40:05.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.143+0000 7f75c2da6640 1 -- 172.21.15.62:0/1123282160 wait complete. 2023-05-15T16:40:05.169 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-05-15T16:40:03.316577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":64680,"kb_used_data":2664,"kb_used_omap":0,"kb_used_meta":61952,"kb_avail":754910040,"statfs":{"total":773094113280,"available":773027880960,"internally_reserved":0,"allocated":2727936,"data_stored":1684960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":63438848},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001126"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-05-15T16:39:56.690933+0000","last_change":"2023-05-15T16:39:50.637320+0000","last_active":"2023-05-15T16:39:56.690933+0000","last_peered":"2023-05-15T16:39:56.690933+0000","last_clean":"2023-05-15T16:39:56.690933+0000","last_became_active":"2023-05-15T16:39:50.636541+0000","last_became_peered":"2023-05-15T16:39:50.636541+0000","last_unstale":"2023-05-15T16:39:56.690933+0000","last_undegraded":"2023-05-15T16:39:56.690933+0000","last_fullsized":"2023-05-15T16:39:56.690933+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:49.601783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:49.601783+0000","last_clean_scrub_stamp":"2023-05-15T16:39:49.601783+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:18:01.941203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-05-15T16:39:57.979778+0000","last_change":"2023-05-15T16:39:56.699270+0000","last_active":"2023-05-15T16:39:57.979778+0000","last_peered":"2023-05-15T16:39:57.979778+0000","last_clean":"2023-05-15T16:39:57.979778+0000","last_became_active":"2023-05-15T16:39:56.698429+0000","last_became_peered":"2023-05-15T16:39:56.698429+0000","last_unstale":"2023-05-15T16:39:57.979778+0000","last_undegraded":"2023-05-15T16:39:57.979778+0000","last_fullsized":"2023-05-15T16:39:57.979778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:31.428692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-05-15T16:39:57.980513+0000","last_change":"2023-05-15T16:39:56.700800+0000","last_active":"2023-05-15T16:39:57.980513+0000","last_peered":"2023-05-15T16:39:57.980513+0000","last_clean":"2023-05-15T16:39:57.980513+0000","last_became_active":"2023-05-15T16:39:56.700022+0000","last_became_peered":"2023-05-15T16:39:56.700022+0000","last_unstale":"2023-05-15T16:39:57.980513+0000","last_undegraded":"2023-05-15T16:39:57.980513+0000","last_fullsized":"2023-05-15T16:39:57.980513+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:11:54.752932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-05-15T16:39:57.975865+0000","last_change":"2023-05-15T16:39:57.018815+0000","last_active":"2023-05-15T16:39:57.975865+0000","last_peered":"2023-05-15T16:39:57.975865+0000","last_clean":"2023-05-15T16:39:57.975865+0000","last_became_active":"2023-05-15T16:39:57.018404+0000","last_became_peered":"2023-05-15T16:39:57.018404+0000","last_unstale":"2023-05-15T16:39:57.975865+0000","last_undegraded":"2023-05-15T16:39:57.975865+0000","last_fullsized":"2023-05-15T16:39:57.975865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-05-15T16:39:57.979723+0000","last_change":"2023-05-15T16:39:56.701269+0000","last_active":"2023-05-15T16:39:57.979723+0000","last_peered":"2023-05-15T16:39:57.979723+0000","last_clean":"2023-05-15T16:39:57.979723+0000","last_became_active":"2023-05-15T16:39:56.700221+0000","last_became_peered":"2023-05-15T16:39:56.700221+0000","last_unstale":"2023-05-15T16:39:57.979723+0000","last_undegraded":"2023-05-15T16:39:57.979723+0000","last_fullsized":"2023-05-15T16:39:57.979723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-05-15T16:39:57.681000+0000","last_change":"2023-05-15T16:39:56.692931+0000","last_active":"2023-05-15T16:39:57.681000+0000","last_peered":"2023-05-15T16:39:57.681000+0000","last_clean":"2023-05-15T16:39:57.681000+0000","last_became_active":"2023-05-15T16:39:56.692557+0000","last_became_peered":"2023-05-15T16:39:56.692557+0000","last_unstale":"2023-05-15T16:39:57.681000+0000","last_undegraded":"2023-05-15T16:39:57.681000+0000","last_fullsized":"2023-05-15T16:39:57.681000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-05-15T16:39:57.980585+0000","last_change":"2023-05-15T16:39:56.698079+0000","last_active":"2023-05-15T16:39:57.980585+0000","last_peered":"2023-05-15T16:39:57.980585+0000","last_clean":"2023-05-15T16:39:57.980585+0000","last_became_active":"2023-05-15T16:39:56.697298+0000","last_became_peered":"2023-05-15T16:39:56.697298+0000","last_unstale":"2023-05-15T16:39:57.980585+0000","last_undegraded":"2023-05-15T16:39:57.980585+0000","last_fullsized":"2023-05-15T16:39:57.980585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:32:01.734351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-05-15T16:39:57.680994+0000","last_change":"2023-05-15T16:39:56.694298+0000","last_active":"2023-05-15T16:39:57.680994+0000","last_peered":"2023-05-15T16:39:57.680994+0000","last_clean":"2023-05-15T16:39:57.680994+0000","last_became_active":"2023-05-15T16:39:56.693723+0000","last_became_peered":"2023-05-15T16:39:56.693723+0000","last_unstale":"2023-05-15T16:39:57.680994+0000","last_undegraded":"2023-05-15T16:39:57.680994+0000","last_fullsized":"2023-05-15T16:39:57.680994+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:31.428692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-05-15T16:39:57.979678+0000","last_change":"2023-05-15T16:39:56.697003+0000","last_active":"2023-05-15T16:39:57.979678+0000","last_peered":"2023-05-15T16:39:57.979678+0000","last_clean":"2023-05-15T16:39:57.979678+0000","last_became_active":"2023-05-15T16:39:56.696210+0000","last_became_peered":"2023-05-15T16:39:56.696210+0000","last_unstale":"2023-05-15T16:39:57.979678+0000","last_undegraded":"2023-05-15T16:39:57.979678+0000","last_fullsized":"2023-05-15T16:39:57.979678+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:29:27.454964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:40:00.698778+0000","last_change":"2023-05-15T16:40:00.698778+0000","last_active":"2023-05-15T16:40:00.698778+0000","last_peered":"2023-05-15T16:40:00.698778+0000","last_clean":"2023-05-15T16:40:00.698778+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:40:00.698778+0000","last_undegraded":"2023-05-15T16:40:00.698778+0000","last_fullsized":"2023-05-15T16:40:00.698778+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-05-15T16:39:59.689275+0000","last_change":"2023-05-15T16:39:59.689275+0000","last_active":"2023-05-15T16:39:59.689275+0000","last_peered":"2023-05-15T16:39:59.689275+0000","last_clean":"2023-05-15T16:39:59.689275+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-05-15T16:39:59.689275+0000","last_undegraded":"2023-05-15T16:39:59.689275+0000","last_fullsized":"2023-05-15T16:39:59.689275+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8904,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94362936,"statfs":{"total":96636764160,"available":96627646464,"internally_reserved":0,"allocated":786432,"data_stored":653396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89700000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84299999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.093}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.228}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7812,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364028,"statfs":{"total":96636764160,"available":96628764672,"internally_reserved":0,"allocated":192512,"data_stored":63028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91100000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79200000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66900000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7812,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364028,"statfs":{"total":96636764160,"available":96628764672,"internally_reserved":0,"allocated":192512,"data_stored":63028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0149999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94699999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98999999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1479999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":7812,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364028,"statfs":{"total":96636764160,"available":96628764672,"internally_reserved":0,"allocated":192512,"data_stored":63028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.329}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.585}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7812,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364028,"statfs":{"total":96636764160,"available":96628764672,"internally_reserved":0,"allocated":192512,"data_stored":63028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82999999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3149999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.286}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4650000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7812,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364028,"statfs":{"total":96636764160,"available":96628764672,"internally_reserved":0,"allocated":192512,"data_stored":63028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45300000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86399999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79600000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7812,"kb_used_data":188,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364028,"statfs":{"total":96636764160,"available":96628764672,"internally_reserved":0,"allocated":192512,"data_stored":63028,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.754}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8904,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94362936,"statfs":{"total":96636764160,"available":96627646464,"internally_reserved":0,"allocated":786432,"data_stored":653396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81699999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92300000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-15T16:40:05.177 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-15T16:40:05.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.331+0000 7fe2de5cd640 1 Processor -- start 2023-05-15T16:40:05.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.331+0000 7fe2de5cd640 1 -- start start 2023-05-15T16:40:05.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.331+0000 7fe2de5cd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe2d80b2b40 0x7fe2d8148270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:05.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.331+0000 7fe2de5cd640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d806ed00 con 0x7fe2d80b8250 2023-05-15T16:40:05.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.331+0000 7fe2de5cd640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d806f750 con 0x7fe2d8071320 2023-05-15T16:40:05.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.331+0000 7fe2de5cd640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d806ef70 con 0x7fe2d80b2b40 2023-05-15T16:40:05.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.331+0000 7fe2d7fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe2d80b2b40 0x7fe2d8148270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:05.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.331+0000 7fe2d7fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe2d80b2b40 0x7fe2d8148270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42526/0 (socket says 172.21.15.62:42526) 2023-05-15T16:40:05.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.331+0000 7fe2d77fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fe2d80b8250 0x7fe2d8070c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37796/0 (socket says 172.21.15.62:37796) 2023-05-15T16:40:05.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.331+0000 7fe2d7fff640 1 -- 172.21.15.62:0/2511429515 learned_addr learned my addr 172.21.15.62:0/2511429515 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:05.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.331+0000 7fe2d7fff640 1 -- 172.21.15.62:0/2511429515 >> v1:172.21.15.161:6789/0 conn(0x7fe2d8071320 legacy=0x7fe2d8158cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:05.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.331+0000 7fe2d7fff640 1 -- 172.21.15.62:0/2511429515 >> v1:172.21.15.62:6789/0 conn(0x7fe2d80b8250 legacy=0x7fe2d8070c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:05.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.331+0000 7fe2d7fff640 1 -- 172.21.15.62:0/2511429515 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d806f250 con 0x7fe2d80b2b40 2023-05-15T16:40:05.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.331+0000 7fe2d7fff640 1 --2- 172.21.15.62:0/2511429515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d80b2b40 0x7fe2d8148270 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009870 tx=0x7fe2cc01c390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60eaffecc4e5ab85 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:05.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2d6ffd640 1 -- 172.21.15.62:0/2511429515 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc0ab600 con 0x7fe2d80b2b40 2023-05-15T16:40:05.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2d6ffd640 1 -- 172.21.15.62:0/2511429515 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc0a7050 con 0x7fe2d80b2b40 2023-05-15T16:40:05.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2d6ffd640 1 -- 172.21.15.62:0/2511429515 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc0ab980 con 0x7fe2d80b2b40 2023-05-15T16:40:05.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2de5cd640 1 -- 172.21.15.62:0/2511429515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d80b2b40 msgr2=0x7fe2d8148270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:05.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2de5cd640 1 --2- 172.21.15.62:0/2511429515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d80b2b40 0x7fe2d8148270 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc009870 tx=0x7fe2cc01c390 comp rx=0 tx=0).stop 2023-05-15T16:40:05.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2de5cd640 1 -- 172.21.15.62:0/2511429515 shutdown_connections 2023-05-15T16:40:05.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2de5cd640 1 --2- 172.21.15.62:0/2511429515 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d80b2b40 0x7fe2d8148270 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2de5cd640 1 -- 172.21.15.62:0/2511429515 >> 172.21.15.62:0/2511429515 conn(0x7fe2d80bc350 msgr2=0x7fe2d80bc750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:05.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2de5cd640 1 -- 172.21.15.62:0/2511429515 shutdown_connections 2023-05-15T16:40:05.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2de5cd640 1 -- 172.21.15.62:0/2511429515 wait complete. 2023-05-15T16:40:05.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2de5cd640 1 Processor -- start 2023-05-15T16:40:05.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2de5cd640 1 -- start start 2023-05-15T16:40:05.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2de5cd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d8071320 0x7fe2d8143500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:05.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2de5cd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2d80b2b40 0x7fe2d81e7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:05.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2de5cd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2d80b8250 0x7fe2d81e7bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:05.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2de5cd640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d81e71f0 con 0x7fe2d8071320 2023-05-15T16:40:05.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2de5cd640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d8143a40 con 0x7fe2d80b2b40 2023-05-15T16:40:05.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2de5cd640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d8151720 con 0x7fe2d80b8250 2023-05-15T16:40:05.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2d7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d8071320 0x7fe2d8143500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:05.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2d7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d8071320 0x7fe2d8143500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42532/0 (socket says 172.21.15.62:42532) 2023-05-15T16:40:05.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2d7fff640 1 -- 172.21.15.62:0/136649300 learned_addr learned my addr 172.21.15.62:0/136649300 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:05.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2d7fff640 1 -- 172.21.15.62:0/136649300 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2d80b8250 msgr2=0x7fe2d81e7bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:05.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2d7fff640 1 --2- 172.21.15.62:0/136649300 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2d80b8250 0x7fe2d81e7bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2d7fff640 1 -- 172.21.15.62:0/136649300 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2d80b2b40 msgr2=0x7fe2d81e7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:05.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2d7fff640 1 --2- 172.21.15.62:0/136649300 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2d80b2b40 0x7fe2d81e7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2d7fff640 1 -- 172.21.15.62:0/136649300 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2cc0094d0 con 0x7fe2d8071320 2023-05-15T16:40:05.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2d7fff640 1 --2- 172.21.15.62:0/136649300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d8071320 0x7fe2d8143500 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0ae040 tx=0x7fe2cc01abd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:05.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2d4ff9640 1 -- 172.21.15.62:0/136649300 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc0aa930 con 0x7fe2d8071320 2023-05-15T16:40:05.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2d4ff9640 1 -- 172.21.15.62:0/136649300 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2cc0aaab0 con 0x7fe2d8071320 2023-05-15T16:40:05.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2de5cd640 1 -- 172.21.15.62:0/136649300 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d80b7ac0 con 0x7fe2d8071320 2023-05-15T16:40:05.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2d4ff9640 1 -- 172.21.15.62:0/136649300 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2cc0aae60 con 0x7fe2d8071320 2023-05-15T16:40:05.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.335+0000 7fe2de5cd640 1 -- 172.21.15.62:0/136649300 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d80b86e0 con 0x7fe2d8071320 2023-05-15T16:40:05.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.339+0000 7fe2de5cd640 1 -- 172.21.15.62:0/136649300 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d8067960 con 0x7fe2d8071320 2023-05-15T16:40:05.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.339+0000 7fe2d4ff9640 1 -- 172.21.15.62:0/136649300 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fe2cc0b2040 con 0x7fe2d8071320 2023-05-15T16:40:05.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.339+0000 7fe2d4ff9640 1 --2- 172.21.15.62:0/136649300 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe2c4065380 0x7fe2c4067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:05.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.339+0000 7fe2d4ff9640 1 -- 172.21.15.62:0/136649300 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe2cc11d250 con 0x7fe2d8071320 2023-05-15T16:40:05.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.339+0000 7fe2d77fe640 1 --2- 172.21.15.62:0/136649300 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe2c4065380 0x7fe2c4067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:05.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.339+0000 7fe2d77fe640 1 --2- 172.21.15.62:0/136649300 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe2c4065380 0x7fe2c4067830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8001ec0 tx=0x7fe2c8001cd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:05.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.343+0000 7fe2d4ff9640 1 -- 172.21.15.62:0/136649300 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fe2cc0eaf60 con 0x7fe2d8071320 2023-05-15T16:40:05.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.491+0000 7fe2de5cd640 1 -- 172.21.15.62:0/136649300 --> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe2d8065c60 con 0x7fe2c4065380 2023-05-15T16:40:05.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.511+0000 7fe2d4ff9640 1 -- 172.21.15.62:0/136649300 <== mgr.4105 v2:172.21.15.161:6832/37541 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286640 (secure 0 0 0) 0x7fe2d8065c60 con 0x7fe2c4065380 2023-05-15T16:40:05.519 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:05.521 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-05-15T16:40:05.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.515+0000 7fe2de5cd640 1 -- 172.21.15.62:0/136649300 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe2c4065380 msgr2=0x7fe2c4067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:05.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.515+0000 7fe2de5cd640 1 --2- 172.21.15.62:0/136649300 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe2c4065380 0x7fe2c4067830 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fe2c8001ec0 tx=0x7fe2c8001cd0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.515+0000 7fe2de5cd640 1 -- 172.21.15.62:0/136649300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d8071320 msgr2=0x7fe2d8143500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:05.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.515+0000 7fe2de5cd640 1 --2- 172.21.15.62:0/136649300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d8071320 0x7fe2d8143500 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe2cc0ae040 tx=0x7fe2cc01abd0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.515+0000 7fe2de5cd640 1 -- 172.21.15.62:0/136649300 shutdown_connections 2023-05-15T16:40:05.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.515+0000 7fe2de5cd640 1 --2- 172.21.15.62:0/136649300 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe2d80b8250 0x7fe2d81e7bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.515+0000 7fe2de5cd640 1 --2- 172.21.15.62:0/136649300 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe2d80b2b40 0x7fe2d81e7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.515+0000 7fe2de5cd640 1 --2- 172.21.15.62:0/136649300 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe2c4065380 0x7fe2c4067830 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.515+0000 7fe2de5cd640 1 --2- 172.21.15.62:0/136649300 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe2d8071320 0x7fe2d8143500 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.515+0000 7fe2de5cd640 1 -- 172.21.15.62:0/136649300 >> 172.21.15.62:0/136649300 conn(0x7fe2d80bc350 msgr2=0x7fe2d8145d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:05.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.515+0000 7fe2de5cd640 1 -- 172.21.15.62:0/136649300 shutdown_connections 2023-05-15T16:40:05.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.515+0000 7fe2de5cd640 1 -- 172.21.15.62:0/136649300 wait complete. 2023-05-15T16:40:05.539 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-05-15T16:40:05.317193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":193,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66280,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908440,"statfs":{"total":773094113280,"available":773026242560,"internally_reserved":0,"allocated":3186688,"data_stored":1902188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.614196"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278001+0000","last_change":"2023-05-15T16:40:01.108030+0000","last_active":"2023-05-15T16:40:02.278001+0000","last_peered":"2023-05-15T16:40:02.278001+0000","last_clean":"2023-05-15T16:40:02.278001+0000","last_became_active":"2023-05-15T16:40:01.107701+0000","last_became_peered":"2023-05-15T16:40:01.107701+0000","last_unstale":"2023-05-15T16:40:02.278001+0000","last_undegraded":"2023-05-15T16:40:02.278001+0000","last_fullsized":"2023-05-15T16:40:02.278001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:06.423119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282608+0000","last_change":"2023-05-15T16:40:01.162454+0000","last_active":"2023-05-15T16:40:02.282608+0000","last_peered":"2023-05-15T16:40:02.282608+0000","last_clean":"2023-05-15T16:40:02.282608+0000","last_became_active":"2023-05-15T16:40:01.161325+0000","last_became_peered":"2023-05-15T16:40:01.161325+0000","last_unstale":"2023-05-15T16:40:02.282608+0000","last_undegraded":"2023-05-15T16:40:02.282608+0000","last_fullsized":"2023-05-15T16:40:02.282608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:13:33.110131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100574+0000","last_change":"2023-05-15T16:40:01.140999+0000","last_active":"2023-05-15T16:40:02.100574+0000","last_peered":"2023-05-15T16:40:02.100574+0000","last_clean":"2023-05-15T16:40:02.100574+0000","last_became_active":"2023-05-15T16:40:01.138081+0000","last_became_peered":"2023-05-15T16:40:01.138081+0000","last_unstale":"2023-05-15T16:40:02.100574+0000","last_undegraded":"2023-05-15T16:40:02.100574+0000","last_fullsized":"2023-05-15T16:40:02.100574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:43:45.244861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280478+0000","last_change":"2023-05-15T16:40:01.125926+0000","last_active":"2023-05-15T16:40:02.280478+0000","last_peered":"2023-05-15T16:40:02.280478+0000","last_clean":"2023-05-15T16:40:02.280478+0000","last_became_active":"2023-05-15T16:40:01.121506+0000","last_became_peered":"2023-05-15T16:40:01.121506+0000","last_unstale":"2023-05-15T16:40:02.280478+0000","last_undegraded":"2023-05-15T16:40:02.280478+0000","last_fullsized":"2023-05-15T16:40:02.280478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:56:14.814256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097671+0000","last_change":"2023-05-15T16:40:01.113655+0000","last_active":"2023-05-15T16:40:02.097671+0000","last_peered":"2023-05-15T16:40:02.097671+0000","last_clean":"2023-05-15T16:40:02.097671+0000","last_became_active":"2023-05-15T16:40:01.113359+0000","last_became_peered":"2023-05-15T16:40:01.113359+0000","last_unstale":"2023-05-15T16:40:02.097671+0000","last_undegraded":"2023-05-15T16:40:02.097671+0000","last_fullsized":"2023-05-15T16:40:02.097671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099373+0000","last_change":"2023-05-15T16:40:01.138514+0000","last_active":"2023-05-15T16:40:02.099373+0000","last_peered":"2023-05-15T16:40:02.099373+0000","last_clean":"2023-05-15T16:40:02.099373+0000","last_became_active":"2023-05-15T16:40:01.137610+0000","last_became_peered":"2023-05-15T16:40:01.137610+0000","last_unstale":"2023-05-15T16:40:02.099373+0000","last_undegraded":"2023-05-15T16:40:02.099373+0000","last_fullsized":"2023-05-15T16:40:02.099373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:41:16.912612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280784+0000","last_change":"2023-05-15T16:40:01.149263+0000","last_active":"2023-05-15T16:40:02.280784+0000","last_peered":"2023-05-15T16:40:02.280784+0000","last_clean":"2023-05-15T16:40:02.280784+0000","last_became_active":"2023-05-15T16:40:01.148591+0000","last_became_peered":"2023-05-15T16:40:01.148591+0000","last_unstale":"2023-05-15T16:40:02.280784+0000","last_undegraded":"2023-05-15T16:40:02.280784+0000","last_fullsized":"2023-05-15T16:40:02.280784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:13:33.110131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282009+0000","last_change":"2023-05-15T16:40:01.160969+0000","last_active":"2023-05-15T16:40:02.282009+0000","last_peered":"2023-05-15T16:40:02.282009+0000","last_clean":"2023-05-15T16:40:02.282009+0000","last_became_active":"2023-05-15T16:40:01.160118+0000","last_became_peered":"2023-05-15T16:40:01.160118+0000","last_unstale":"2023-05-15T16:40:02.282009+0000","last_undegraded":"2023-05-15T16:40:02.282009+0000","last_fullsized":"2023-05-15T16:40:02.282009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098107+0000","last_change":"2023-05-15T16:40:01.114095+0000","last_active":"2023-05-15T16:40:02.098107+0000","last_peered":"2023-05-15T16:40:02.098107+0000","last_clean":"2023-05-15T16:40:02.098107+0000","last_became_active":"2023-05-15T16:40:01.113367+0000","last_became_peered":"2023-05-15T16:40:01.113367+0000","last_unstale":"2023-05-15T16:40:02.098107+0000","last_undegraded":"2023-05-15T16:40:02.098107+0000","last_fullsized":"2023-05-15T16:40:02.098107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:22:08.631817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282722+0000","last_change":"2023-05-15T16:40:01.161203+0000","last_active":"2023-05-15T16:40:02.282722+0000","last_peered":"2023-05-15T16:40:02.282722+0000","last_clean":"2023-05-15T16:40:02.282722+0000","last_became_active":"2023-05-15T16:40:01.160163+0000","last_became_peered":"2023-05-15T16:40:01.160163+0000","last_unstale":"2023-05-15T16:40:02.282722+0000","last_undegraded":"2023-05-15T16:40:02.282722+0000","last_fullsized":"2023-05-15T16:40:02.282722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:31:14.621756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100644+0000","last_change":"2023-05-15T16:40:01.140439+0000","last_active":"2023-05-15T16:40:02.100644+0000","last_peered":"2023-05-15T16:40:02.100644+0000","last_clean":"2023-05-15T16:40:02.100644+0000","last_became_active":"2023-05-15T16:40:01.136958+0000","last_became_peered":"2023-05-15T16:40:01.136958+0000","last_unstale":"2023-05-15T16:40:02.100644+0000","last_undegraded":"2023-05-15T16:40:02.100644+0000","last_fullsized":"2023-05-15T16:40:02.100644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:48:42.521388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278138+0000","last_change":"2023-05-15T16:40:01.140940+0000","last_active":"2023-05-15T16:40:02.278138+0000","last_peered":"2023-05-15T16:40:02.278138+0000","last_clean":"2023-05-15T16:40:02.278138+0000","last_became_active":"2023-05-15T16:40:01.140666+0000","last_became_peered":"2023-05-15T16:40:01.140666+0000","last_unstale":"2023-05-15T16:40:02.278138+0000","last_undegraded":"2023-05-15T16:40:02.278138+0000","last_fullsized":"2023-05-15T16:40:02.278138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:56:14.814256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278109+0000","last_change":"2023-05-15T16:40:01.104796+0000","last_active":"2023-05-15T16:40:02.278109+0000","last_peered":"2023-05-15T16:40:02.278109+0000","last_clean":"2023-05-15T16:40:02.278109+0000","last_became_active":"2023-05-15T16:40:01.104505+0000","last_became_peered":"2023-05-15T16:40:01.104505+0000","last_unstale":"2023-05-15T16:40:02.278109+0000","last_undegraded":"2023-05-15T16:40:02.278109+0000","last_fullsized":"2023-05-15T16:40:02.278109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:34.510844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.283018+0000","last_change":"2023-05-15T16:40:01.146028+0000","last_active":"2023-05-15T16:40:02.283018+0000","last_peered":"2023-05-15T16:40:02.283018+0000","last_clean":"2023-05-15T16:40:02.283018+0000","last_became_active":"2023-05-15T16:40:01.145321+0000","last_became_peered":"2023-05-15T16:40:01.145321+0000","last_unstale":"2023-05-15T16:40:02.283018+0000","last_undegraded":"2023-05-15T16:40:02.283018+0000","last_fullsized":"2023-05-15T16:40:02.283018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:02:23.376990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281189+0000","last_change":"2023-05-15T16:40:01.157628+0000","last_active":"2023-05-15T16:40:02.281189+0000","last_peered":"2023-05-15T16:40:02.281189+0000","last_clean":"2023-05-15T16:40:02.281189+0000","last_became_active":"2023-05-15T16:40:01.157096+0000","last_became_peered":"2023-05-15T16:40:01.157096+0000","last_unstale":"2023-05-15T16:40:02.281189+0000","last_undegraded":"2023-05-15T16:40:02.281189+0000","last_fullsized":"2023-05-15T16:40:02.281189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098971+0000","last_change":"2023-05-15T16:40:01.136171+0000","last_active":"2023-05-15T16:40:02.098971+0000","last_peered":"2023-05-15T16:40:02.098971+0000","last_clean":"2023-05-15T16:40:02.098971+0000","last_became_active":"2023-05-15T16:40:01.135400+0000","last_became_peered":"2023-05-15T16:40:01.135400+0000","last_unstale":"2023-05-15T16:40:02.098971+0000","last_undegraded":"2023-05-15T16:40:02.098971+0000","last_fullsized":"2023-05-15T16:40:02.098971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:15:00.512988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098127+0000","last_change":"2023-05-15T16:40:01.113893+0000","last_active":"2023-05-15T16:40:02.098127+0000","last_peered":"2023-05-15T16:40:02.098127+0000","last_clean":"2023-05-15T16:40:02.098127+0000","last_became_active":"2023-05-15T16:40:01.113415+0000","last_became_peered":"2023-05-15T16:40:01.113415+0000","last_unstale":"2023-05-15T16:40:02.098127+0000","last_undegraded":"2023-05-15T16:40:02.098127+0000","last_fullsized":"2023-05-15T16:40:02.098127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100417+0000","last_change":"2023-05-15T16:40:01.139891+0000","last_active":"2023-05-15T16:40:02.100417+0000","last_peered":"2023-05-15T16:40:02.100417+0000","last_clean":"2023-05-15T16:40:02.100417+0000","last_became_active":"2023-05-15T16:40:01.138421+0000","last_became_peered":"2023-05-15T16:40:01.138421+0000","last_unstale":"2023-05-15T16:40:02.100417+0000","last_undegraded":"2023-05-15T16:40:02.100417+0000","last_fullsized":"2023-05-15T16:40:02.100417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T03:57:26.700942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278992+0000","last_change":"2023-05-15T16:40:01.129321+0000","last_active":"2023-05-15T16:40:02.278992+0000","last_peered":"2023-05-15T16:40:02.278992+0000","last_clean":"2023-05-15T16:40:02.278992+0000","last_became_active":"2023-05-15T16:40:01.129026+0000","last_became_peered":"2023-05-15T16:40:01.129026+0000","last_unstale":"2023-05-15T16:40:02.278992+0000","last_undegraded":"2023-05-15T16:40:02.278992+0000","last_fullsized":"2023-05-15T16:40:02.278992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:51:42.949566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100354+0000","last_change":"2023-05-15T16:40:01.141251+0000","last_active":"2023-05-15T16:40:02.100354+0000","last_peered":"2023-05-15T16:40:02.100354+0000","last_clean":"2023-05-15T16:40:02.100354+0000","last_became_active":"2023-05-15T16:40:01.140102+0000","last_became_peered":"2023-05-15T16:40:01.140102+0000","last_unstale":"2023-05-15T16:40:02.100354+0000","last_undegraded":"2023-05-15T16:40:02.100354+0000","last_fullsized":"2023-05-15T16:40:02.100354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:14:42.054526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281668+0000","last_change":"2023-05-15T16:40:01.157690+0000","last_active":"2023-05-15T16:40:02.281668+0000","last_peered":"2023-05-15T16:40:02.281668+0000","last_clean":"2023-05-15T16:40:02.281668+0000","last_became_active":"2023-05-15T16:40:01.157028+0000","last_became_peered":"2023-05-15T16:40:01.157028+0000","last_unstale":"2023-05-15T16:40:02.281668+0000","last_undegraded":"2023-05-15T16:40:02.281668+0000","last_fullsized":"2023-05-15T16:40:02.281668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097365+0000","last_change":"2023-05-15T16:40:01.111473+0000","last_active":"2023-05-15T16:40:02.097365+0000","last_peered":"2023-05-15T16:40:02.097365+0000","last_clean":"2023-05-15T16:40:02.097365+0000","last_became_active":"2023-05-15T16:40:01.109519+0000","last_became_peered":"2023-05-15T16:40:01.109519+0000","last_unstale":"2023-05-15T16:40:02.097365+0000","last_undegraded":"2023-05-15T16:40:02.097365+0000","last_fullsized":"2023-05-15T16:40:02.097365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:39:15.813849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095154+0000","last_change":"2023-05-15T16:40:01.109311+0000","last_active":"2023-05-15T16:40:02.095154+0000","last_peered":"2023-05-15T16:40:02.095154+0000","last_clean":"2023-05-15T16:40:02.095154+0000","last_became_active":"2023-05-15T16:40:01.109001+0000","last_became_peered":"2023-05-15T16:40:01.109001+0000","last_unstale":"2023-05-15T16:40:02.095154+0000","last_undegraded":"2023-05-15T16:40:02.095154+0000","last_fullsized":"2023-05-15T16:40:02.095154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:22:08.631817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280862+0000","last_change":"2023-05-15T16:40:01.151544+0000","last_active":"2023-05-15T16:40:02.280862+0000","last_peered":"2023-05-15T16:40:02.280862+0000","last_clean":"2023-05-15T16:40:02.280862+0000","last_became_active":"2023-05-15T16:40:01.150292+0000","last_became_peered":"2023-05-15T16:40:01.150292+0000","last_unstale":"2023-05-15T16:40:02.280862+0000","last_undegraded":"2023-05-15T16:40:02.280862+0000","last_fullsized":"2023-05-15T16:40:02.280862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279251+0000","last_change":"2023-05-15T16:40:01.119067+0000","last_active":"2023-05-15T16:40:02.279251+0000","last_peered":"2023-05-15T16:40:02.279251+0000","last_clean":"2023-05-15T16:40:02.279251+0000","last_became_active":"2023-05-15T16:40:01.118808+0000","last_became_peered":"2023-05-15T16:40:01.118808+0000","last_unstale":"2023-05-15T16:40:02.279251+0000","last_undegraded":"2023-05-15T16:40:02.279251+0000","last_fullsized":"2023-05-15T16:40:02.279251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:02:23.376990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279750+0000","last_change":"2023-05-15T16:40:01.108611+0000","last_active":"2023-05-15T16:40:02.279750+0000","last_peered":"2023-05-15T16:40:02.279750+0000","last_clean":"2023-05-15T16:40:02.279750+0000","last_became_active":"2023-05-15T16:40:01.107595+0000","last_became_peered":"2023-05-15T16:40:01.107595+0000","last_unstale":"2023-05-15T16:40:02.279750+0000","last_undegraded":"2023-05-15T16:40:02.279750+0000","last_fullsized":"2023-05-15T16:40:02.279750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:45:33.580738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282768+0000","last_change":"2023-05-15T16:40:01.161786+0000","last_active":"2023-05-15T16:40:02.282768+0000","last_peered":"2023-05-15T16:40:02.282768+0000","last_clean":"2023-05-15T16:40:02.282768+0000","last_became_active":"2023-05-15T16:40:01.160406+0000","last_became_peered":"2023-05-15T16:40:01.160406+0000","last_unstale":"2023-05-15T16:40:02.282768+0000","last_undegraded":"2023-05-15T16:40:02.282768+0000","last_fullsized":"2023-05-15T16:40:02.282768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279900+0000","last_change":"2023-05-15T16:40:01.147235+0000","last_active":"2023-05-15T16:40:02.279900+0000","last_peered":"2023-05-15T16:40:02.279900+0000","last_clean":"2023-05-15T16:40:02.279900+0000","last_became_active":"2023-05-15T16:40:01.146964+0000","last_became_peered":"2023-05-15T16:40:01.146964+0000","last_unstale":"2023-05-15T16:40:02.279900+0000","last_undegraded":"2023-05-15T16:40:02.279900+0000","last_fullsized":"2023-05-15T16:40:02.279900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:07:25.649507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095330+0000","last_change":"2023-05-15T16:40:01.125493+0000","last_active":"2023-05-15T16:40:02.095330+0000","last_peered":"2023-05-15T16:40:02.095330+0000","last_clean":"2023-05-15T16:40:02.095330+0000","last_became_active":"2023-05-15T16:40:01.125172+0000","last_became_peered":"2023-05-15T16:40:01.125172+0000","last_unstale":"2023-05-15T16:40:02.095330+0000","last_undegraded":"2023-05-15T16:40:02.095330+0000","last_fullsized":"2023-05-15T16:40:02.095330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099957+0000","last_change":"2023-05-15T16:40:01.138349+0000","last_active":"2023-05-15T16:40:02.099957+0000","last_peered":"2023-05-15T16:40:02.099957+0000","last_clean":"2023-05-15T16:40:02.099957+0000","last_became_active":"2023-05-15T16:40:01.137255+0000","last_became_peered":"2023-05-15T16:40:01.137255+0000","last_unstale":"2023-05-15T16:40:02.099957+0000","last_undegraded":"2023-05-15T16:40:02.099957+0000","last_fullsized":"2023-05-15T16:40:02.099957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:22:31.889776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095427+0000","last_change":"2023-05-15T16:40:01.105121+0000","last_active":"2023-05-15T16:40:02.095427+0000","last_peered":"2023-05-15T16:40:02.095427+0000","last_clean":"2023-05-15T16:40:02.095427+0000","last_became_active":"2023-05-15T16:40:01.104061+0000","last_became_peered":"2023-05-15T16:40:01.104061+0000","last_unstale":"2023-05-15T16:40:02.095427+0000","last_undegraded":"2023-05-15T16:40:02.095427+0000","last_fullsized":"2023-05-15T16:40:02.095427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279918+0000","last_change":"2023-05-15T16:40:01.132449+0000","last_active":"2023-05-15T16:40:02.279918+0000","last_peered":"2023-05-15T16:40:02.279918+0000","last_clean":"2023-05-15T16:40:02.279918+0000","last_became_active":"2023-05-15T16:40:01.131460+0000","last_became_peered":"2023-05-15T16:40:01.131460+0000","last_unstale":"2023-05-15T16:40:02.279918+0000","last_undegraded":"2023-05-15T16:40:02.279918+0000","last_fullsized":"2023-05-15T16:40:02.279918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:19:49.435267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.096152+0000","last_change":"2023-05-15T16:40:01.109245+0000","last_active":"2023-05-15T16:40:02.096152+0000","last_peered":"2023-05-15T16:40:02.096152+0000","last_clean":"2023-05-15T16:40:02.096152+0000","last_became_active":"2023-05-15T16:40:01.108858+0000","last_became_peered":"2023-05-15T16:40:01.108858+0000","last_unstale":"2023-05-15T16:40:02.096152+0000","last_undegraded":"2023-05-15T16:40:02.096152+0000","last_fullsized":"2023-05-15T16:40:02.096152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:45:33.580738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281902+0000","last_change":"2023-05-15T16:40:00.763235+0000","last_active":"2023-05-15T16:40:02.281902+0000","last_peered":"2023-05-15T16:40:02.281902+0000","last_clean":"2023-05-15T16:40:02.281902+0000","last_became_active":"2023-05-15T16:40:00.762235+0000","last_became_peered":"2023-05-15T16:40:00.762235+0000","last_unstale":"2023-05-15T16:40:02.281902+0000","last_undegraded":"2023-05-15T16:40:02.281902+0000","last_fullsized":"2023-05-15T16:40:02.281902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:51:11.783628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282911+0000","last_change":"2023-05-15T16:40:01.160372+0000","last_active":"2023-05-15T16:40:02.282911+0000","last_peered":"2023-05-15T16:40:02.282911+0000","last_clean":"2023-05-15T16:40:02.282911+0000","last_became_active":"2023-05-15T16:40:01.159573+0000","last_became_peered":"2023-05-15T16:40:01.159573+0000","last_unstale":"2023-05-15T16:40:02.282911+0000","last_undegraded":"2023-05-15T16:40:02.282911+0000","last_fullsized":"2023-05-15T16:40:02.282911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097310+0000","last_change":"2023-05-15T16:40:00.739620+0000","last_active":"2023-05-15T16:40:02.097310+0000","last_peered":"2023-05-15T16:40:02.097310+0000","last_clean":"2023-05-15T16:40:02.097310+0000","last_became_active":"2023-05-15T16:40:00.739275+0000","last_became_peered":"2023-05-15T16:40:00.739275+0000","last_unstale":"2023-05-15T16:40:02.097310+0000","last_undegraded":"2023-05-15T16:40:02.097310+0000","last_fullsized":"2023-05-15T16:40:02.097310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:05.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098022+0000","last_change":"2023-05-15T16:40:01.113172+0000","last_active":"2023-05-15T16:40:02.098022+0000","last_peered":"2023-05-15T16:40:02.098022+0000","last_clean":"2023-05-15T16:40:02.098022+0000","last_became_active":"2023-05-15T16:40:01.112870+0000","last_became_peered":"2023-05-15T16:40:01.112870+0000","last_unstale":"2023-05-15T16:40:02.098022+0000","last_undegraded":"2023-05-15T16:40:02.098022+0000","last_fullsized":"2023-05-15T16:40:02.098022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281420+0000","last_change":"2023-05-15T16:40:00.762606+0000","last_active":"2023-05-15T16:40:02.281420+0000","last_peered":"2023-05-15T16:40:02.281420+0000","last_clean":"2023-05-15T16:40:02.281420+0000","last_became_active":"2023-05-15T16:40:00.761988+0000","last_became_peered":"2023-05-15T16:40:00.761988+0000","last_unstale":"2023-05-15T16:40:02.281420+0000","last_undegraded":"2023-05-15T16:40:02.281420+0000","last_fullsized":"2023-05-15T16:40:02.281420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:45:32.571235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095959+0000","last_change":"2023-05-15T16:40:01.147086+0000","last_active":"2023-05-15T16:40:02.095959+0000","last_peered":"2023-05-15T16:40:02.095959+0000","last_clean":"2023-05-15T16:40:02.095959+0000","last_became_active":"2023-05-15T16:40:01.146808+0000","last_became_peered":"2023-05-15T16:40:01.146808+0000","last_unstale":"2023-05-15T16:40:02.095959+0000","last_undegraded":"2023-05-15T16:40:02.095959+0000","last_fullsized":"2023-05-15T16:40:02.095959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280054+0000","last_change":"2023-05-15T16:40:00.730676+0000","last_active":"2023-05-15T16:40:02.280054+0000","last_peered":"2023-05-15T16:40:02.280054+0000","last_clean":"2023-05-15T16:40:02.280054+0000","last_became_active":"2023-05-15T16:40:00.729878+0000","last_became_peered":"2023-05-15T16:40:00.729878+0000","last_unstale":"2023-05-15T16:40:02.280054+0000","last_undegraded":"2023-05-15T16:40:02.280054+0000","last_fullsized":"2023-05-15T16:40:02.280054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:11:08.088281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282241+0000","last_change":"2023-05-15T16:40:00.758036+0000","last_active":"2023-05-15T16:40:02.282241+0000","last_peered":"2023-05-15T16:40:02.282241+0000","last_clean":"2023-05-15T16:40:02.282241+0000","last_became_active":"2023-05-15T16:40:00.757440+0000","last_became_peered":"2023-05-15T16:40:00.757440+0000","last_unstale":"2023-05-15T16:40:02.282241+0000","last_undegraded":"2023-05-15T16:40:02.282241+0000","last_fullsized":"2023-05-15T16:40:02.282241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:39:14.804346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282268+0000","last_change":"2023-05-15T16:40:01.160001+0000","last_active":"2023-05-15T16:40:02.282268+0000","last_peered":"2023-05-15T16:40:02.282268+0000","last_clean":"2023-05-15T16:40:02.282268+0000","last_became_active":"2023-05-15T16:40:01.159447+0000","last_became_peered":"2023-05-15T16:40:01.159447+0000","last_unstale":"2023-05-15T16:40:02.282268+0000","last_undegraded":"2023-05-15T16:40:02.282268+0000","last_fullsized":"2023-05-15T16:40:02.282268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:26:45.774263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282224+0000","last_change":"2023-05-15T16:40:00.762701+0000","last_active":"2023-05-15T16:40:02.282224+0000","last_peered":"2023-05-15T16:40:02.282224+0000","last_clean":"2023-05-15T16:40:02.282224+0000","last_became_active":"2023-05-15T16:40:00.762050+0000","last_became_peered":"2023-05-15T16:40:00.762050+0000","last_unstale":"2023-05-15T16:40:02.282224+0000","last_undegraded":"2023-05-15T16:40:02.282224+0000","last_fullsized":"2023-05-15T16:40:02.282224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:00:39.077549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099635+0000","last_change":"2023-05-15T16:40:01.141928+0000","last_active":"2023-05-15T16:40:02.099635+0000","last_peered":"2023-05-15T16:40:02.099635+0000","last_clean":"2023-05-15T16:40:02.099635+0000","last_became_active":"2023-05-15T16:40:01.135581+0000","last_became_peered":"2023-05-15T16:40:01.135581+0000","last_unstale":"2023-05-15T16:40:02.099635+0000","last_undegraded":"2023-05-15T16:40:02.099635+0000","last_fullsized":"2023-05-15T16:40:02.099635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:50:32.789209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281732+0000","last_change":"2023-05-15T16:40:00.760061+0000","last_active":"2023-05-15T16:40:02.281732+0000","last_peered":"2023-05-15T16:40:02.281732+0000","last_clean":"2023-05-15T16:40:02.281732+0000","last_became_active":"2023-05-15T16:40:00.759394+0000","last_became_peered":"2023-05-15T16:40:00.759394+0000","last_unstale":"2023-05-15T16:40:02.281732+0000","last_undegraded":"2023-05-15T16:40:02.281732+0000","last_fullsized":"2023-05-15T16:40:02.281732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:51:42.381804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280016+0000","last_change":"2023-05-15T16:40:01.124789+0000","last_active":"2023-05-15T16:40:02.280016+0000","last_peered":"2023-05-15T16:40:02.280016+0000","last_clean":"2023-05-15T16:40:02.280016+0000","last_became_active":"2023-05-15T16:40:01.123158+0000","last_became_peered":"2023-05-15T16:40:01.123158+0000","last_unstale":"2023-05-15T16:40:02.280016+0000","last_undegraded":"2023-05-15T16:40:02.280016+0000","last_fullsized":"2023-05-15T16:40:02.280016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:00:40.087052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282519+0000","last_change":"2023-05-15T16:40:00.754578+0000","last_active":"2023-05-15T16:40:02.282519+0000","last_peered":"2023-05-15T16:40:02.282519+0000","last_clean":"2023-05-15T16:40:02.282519+0000","last_became_active":"2023-05-15T16:40:00.753829+0000","last_became_peered":"2023-05-15T16:40:00.753829+0000","last_unstale":"2023-05-15T16:40:02.282519+0000","last_undegraded":"2023-05-15T16:40:02.282519+0000","last_fullsized":"2023-05-15T16:40:02.282519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097589+0000","last_change":"2023-05-15T16:40:01.111444+0000","last_active":"2023-05-15T16:40:02.097589+0000","last_peered":"2023-05-15T16:40:02.097589+0000","last_clean":"2023-05-15T16:40:02.097589+0000","last_became_active":"2023-05-15T16:40:01.108848+0000","last_became_peered":"2023-05-15T16:40:01.108848+0000","last_unstale":"2023-05-15T16:40:02.097589+0000","last_undegraded":"2023-05-15T16:40:02.097589+0000","last_fullsized":"2023-05-15T16:40:02.097589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:26:45.774263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095431+0000","last_change":"2023-05-15T16:40:00.740949+0000","last_active":"2023-05-15T16:40:02.095431+0000","last_peered":"2023-05-15T16:40:02.095431+0000","last_clean":"2023-05-15T16:40:02.095431+0000","last_became_active":"2023-05-15T16:40:00.739009+0000","last_became_peered":"2023-05-15T16:40:00.739009+0000","last_unstale":"2023-05-15T16:40:02.095431+0000","last_undegraded":"2023-05-15T16:40:02.095431+0000","last_fullsized":"2023-05-15T16:40:02.095431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:14:54.500421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100640+0000","last_change":"2023-05-15T16:40:01.140770+0000","last_active":"2023-05-15T16:40:02.100640+0000","last_peered":"2023-05-15T16:40:02.100640+0000","last_clean":"2023-05-15T16:40:02.100640+0000","last_became_active":"2023-05-15T16:40:01.138754+0000","last_became_peered":"2023-05-15T16:40:01.138754+0000","last_unstale":"2023-05-15T16:40:02.100640+0000","last_undegraded":"2023-05-15T16:40:02.100640+0000","last_fullsized":"2023-05-15T16:40:02.100640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:02:15.760757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280274+0000","last_change":"2023-05-15T16:40:00.749907+0000","last_active":"2023-05-15T16:40:02.280274+0000","last_peered":"2023-05-15T16:40:02.280274+0000","last_clean":"2023-05-15T16:40:02.280274+0000","last_became_active":"2023-05-15T16:40:00.749282+0000","last_became_peered":"2023-05-15T16:40:00.749282+0000","last_unstale":"2023-05-15T16:40:02.280274+0000","last_undegraded":"2023-05-15T16:40:02.280274+0000","last_fullsized":"2023-05-15T16:40:02.280274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:14:54.500421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100813+0000","last_change":"2023-05-15T16:40:01.139858+0000","last_active":"2023-05-15T16:40:02.100813+0000","last_peered":"2023-05-15T16:40:02.100813+0000","last_clean":"2023-05-15T16:40:02.100813+0000","last_became_active":"2023-05-15T16:40:01.136069+0000","last_became_peered":"2023-05-15T16:40:01.136069+0000","last_unstale":"2023-05-15T16:40:02.100813+0000","last_undegraded":"2023-05-15T16:40:02.100813+0000","last_fullsized":"2023-05-15T16:40:02.100813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:05:11.188290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099660+0000","last_change":"2023-05-15T16:40:00.749474+0000","last_active":"2023-05-15T16:40:02.099660+0000","last_peered":"2023-05-15T16:40:02.099660+0000","last_clean":"2023-05-15T16:40:02.099660+0000","last_became_active":"2023-05-15T16:40:00.748842+0000","last_became_peered":"2023-05-15T16:40:00.748842+0000","last_unstale":"2023-05-15T16:40:02.099660+0000","last_undegraded":"2023-05-15T16:40:02.099660+0000","last_fullsized":"2023-05-15T16:40:02.099660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:56:52.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100423+0000","last_change":"2023-05-15T16:40:01.138792+0000","last_active":"2023-05-15T16:40:02.100423+0000","last_peered":"2023-05-15T16:40:02.100423+0000","last_clean":"2023-05-15T16:40:02.100423+0000","last_became_active":"2023-05-15T16:40:01.137792+0000","last_became_peered":"2023-05-15T16:40:01.137792+0000","last_unstale":"2023-05-15T16:40:02.100423+0000","last_undegraded":"2023-05-15T16:40:02.100423+0000","last_fullsized":"2023-05-15T16:40:02.100423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095575+0000","last_change":"2023-05-15T16:40:00.735846+0000","last_active":"2023-05-15T16:40:02.095575+0000","last_peered":"2023-05-15T16:40:02.095575+0000","last_clean":"2023-05-15T16:40:02.095575+0000","last_became_active":"2023-05-15T16:40:00.734223+0000","last_became_peered":"2023-05-15T16:40:00.734223+0000","last_unstale":"2023-05-15T16:40:02.095575+0000","last_undegraded":"2023-05-15T16:40:02.095575+0000","last_fullsized":"2023-05-15T16:40:02.095575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:05.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279676+0000","last_change":"2023-05-15T16:40:01.106280+0000","last_active":"2023-05-15T16:40:02.279676+0000","last_peered":"2023-05-15T16:40:02.279676+0000","last_clean":"2023-05-15T16:40:02.279676+0000","last_became_active":"2023-05-15T16:40:01.105962+0000","last_became_peered":"2023-05-15T16:40:01.105962+0000","last_unstale":"2023-05-15T16:40:02.279676+0000","last_undegraded":"2023-05-15T16:40:02.279676+0000","last_fullsized":"2023-05-15T16:40:02.279676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:24:01.307491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.125777+0000","last_change":"2023-05-15T16:39:50.637320+0000","last_active":"2023-05-15T16:40:01.125777+0000","last_peered":"2023-05-15T16:40:01.125777+0000","last_clean":"2023-05-15T16:40:01.125777+0000","last_became_active":"2023-05-15T16:39:50.636541+0000","last_became_peered":"2023-05-15T16:39:50.636541+0000","last_unstale":"2023-05-15T16:40:01.125777+0000","last_undegraded":"2023-05-15T16:40:01.125777+0000","last_fullsized":"2023-05-15T16:40:01.125777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:49.601783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:49.601783+0000","last_clean_scrub_stamp":"2023-05-15T16:39:49.601783+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:18:01.941203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.156165+0000","last_change":"2023-05-15T16:39:56.699270+0000","last_active":"2023-05-15T16:40:01.156165+0000","last_peered":"2023-05-15T16:40:01.156165+0000","last_clean":"2023-05-15T16:40:01.156165+0000","last_became_active":"2023-05-15T16:39:56.698429+0000","last_became_peered":"2023-05-15T16:39:56.698429+0000","last_unstale":"2023-05-15T16:40:01.156165+0000","last_undegraded":"2023-05-15T16:40:01.156165+0000","last_fullsized":"2023-05-15T16:40:01.156165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:31.428692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095161+0000","last_change":"2023-05-15T16:40:00.753212+0000","last_active":"2023-05-15T16:40:02.095161+0000","last_peered":"2023-05-15T16:40:02.095161+0000","last_clean":"2023-05-15T16:40:02.095161+0000","last_became_active":"2023-05-15T16:40:00.752900+0000","last_became_peered":"2023-05-15T16:40:00.752900+0000","last_unstale":"2023-05-15T16:40:02.095161+0000","last_undegraded":"2023-05-15T16:40:02.095161+0000","last_fullsized":"2023-05-15T16:40:02.095161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:30:28.823039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280571+0000","last_change":"2023-05-15T16:40:01.148321+0000","last_active":"2023-05-15T16:40:02.280571+0000","last_peered":"2023-05-15T16:40:02.280571+0000","last_clean":"2023-05-15T16:40:02.280571+0000","last_became_active":"2023-05-15T16:40:01.147687+0000","last_became_peered":"2023-05-15T16:40:01.147687+0000","last_unstale":"2023-05-15T16:40:02.280571+0000","last_undegraded":"2023-05-15T16:40:02.280571+0000","last_fullsized":"2023-05-15T16:40:02.280571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:51:43.391307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.125606+0000","last_change":"2023-05-15T16:39:56.700800+0000","last_active":"2023-05-15T16:40:01.125606+0000","last_peered":"2023-05-15T16:40:01.125606+0000","last_clean":"2023-05-15T16:40:01.125606+0000","last_became_active":"2023-05-15T16:39:56.700022+0000","last_became_peered":"2023-05-15T16:39:56.700022+0000","last_unstale":"2023-05-15T16:40:01.125606+0000","last_undegraded":"2023-05-15T16:40:01.125606+0000","last_fullsized":"2023-05-15T16:40:01.125606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:11:54.752932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097131+0000","last_change":"2023-05-15T16:40:00.762802+0000","last_active":"2023-05-15T16:40:02.097131+0000","last_peered":"2023-05-15T16:40:02.097131+0000","last_clean":"2023-05-15T16:40:02.097131+0000","last_became_active":"2023-05-15T16:40:00.762564+0000","last_became_peered":"2023-05-15T16:40:00.762564+0000","last_unstale":"2023-05-15T16:40:02.097131+0000","last_undegraded":"2023-05-15T16:40:02.097131+0000","last_fullsized":"2023-05-15T16:40:02.097131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:21:29.173379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097918+0000","last_change":"2023-05-15T16:40:01.111468+0000","last_active":"2023-05-15T16:40:02.097918+0000","last_peered":"2023-05-15T16:40:02.097918+0000","last_clean":"2023-05-15T16:40:02.097918+0000","last_became_active":"2023-05-15T16:40:01.108705+0000","last_became_peered":"2023-05-15T16:40:01.108705+0000","last_unstale":"2023-05-15T16:40:02.097918+0000","last_undegraded":"2023-05-15T16:40:02.097918+0000","last_fullsized":"2023-05-15T16:40:02.097918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:24:01.307491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.091019+0000","last_change":"2023-05-15T16:39:57.018815+0000","last_active":"2023-05-15T16:40:01.091019+0000","last_peered":"2023-05-15T16:40:01.091019+0000","last_clean":"2023-05-15T16:40:01.091019+0000","last_became_active":"2023-05-15T16:39:57.018404+0000","last_became_peered":"2023-05-15T16:39:57.018404+0000","last_unstale":"2023-05-15T16:40:01.091019+0000","last_undegraded":"2023-05-15T16:40:01.091019+0000","last_fullsized":"2023-05-15T16:40:01.091019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278644+0000","last_change":"2023-05-15T16:40:00.732605+0000","last_active":"2023-05-15T16:40:02.278644+0000","last_peered":"2023-05-15T16:40:02.278644+0000","last_clean":"2023-05-15T16:40:02.278644+0000","last_became_active":"2023-05-15T16:40:00.731996+0000","last_became_peered":"2023-05-15T16:40:00.731996+0000","last_unstale":"2023-05-15T16:40:02.278644+0000","last_undegraded":"2023-05-15T16:40:02.278644+0000","last_fullsized":"2023-05-15T16:40:02.278644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:30:28.823039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280039+0000","last_change":"2023-05-15T16:40:01.158076+0000","last_active":"2023-05-15T16:40:02.280039+0000","last_peered":"2023-05-15T16:40:02.280039+0000","last_clean":"2023-05-15T16:40:02.280039+0000","last_became_active":"2023-05-15T16:40:01.157836+0000","last_became_peered":"2023-05-15T16:40:01.157836+0000","last_unstale":"2023-05-15T16:40:02.280039+0000","last_undegraded":"2023-05-15T16:40:02.280039+0000","last_fullsized":"2023-05-15T16:40:02.280039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:26:45.774263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.156363+0000","last_change":"2023-05-15T16:39:56.701269+0000","last_active":"2023-05-15T16:40:01.156363+0000","last_peered":"2023-05-15T16:40:01.156363+0000","last_clean":"2023-05-15T16:40:01.156363+0000","last_became_active":"2023-05-15T16:39:56.700221+0000","last_became_peered":"2023-05-15T16:39:56.700221+0000","last_unstale":"2023-05-15T16:40:01.156363+0000","last_undegraded":"2023-05-15T16:40:01.156363+0000","last_fullsized":"2023-05-15T16:40:01.156363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099905+0000","last_change":"2023-05-15T16:40:00.749117+0000","last_active":"2023-05-15T16:40:02.099905+0000","last_peered":"2023-05-15T16:40:02.099905+0000","last_clean":"2023-05-15T16:40:02.099905+0000","last_became_active":"2023-05-15T16:40:00.748493+0000","last_became_peered":"2023-05-15T16:40:00.748493+0000","last_unstale":"2023-05-15T16:40:02.099905+0000","last_undegraded":"2023-05-15T16:40:02.099905+0000","last_fullsized":"2023-05-15T16:40:02.099905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279394+0000","last_change":"2023-05-15T16:40:01.108032+0000","last_active":"2023-05-15T16:40:02.279394+0000","last_peered":"2023-05-15T16:40:02.279394+0000","last_clean":"2023-05-15T16:40:02.279394+0000","last_became_active":"2023-05-15T16:40:01.107664+0000","last_became_peered":"2023-05-15T16:40:01.107664+0000","last_unstale":"2023-05-15T16:40:02.279394+0000","last_undegraded":"2023-05-15T16:40:02.279394+0000","last_fullsized":"2023-05-15T16:40:02.279394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:31:14.621756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.283078+0000","last_change":"2023-05-15T16:40:00.756830+0000","last_active":"2023-05-15T16:40:02.283078+0000","last_peered":"2023-05-15T16:40:02.283078+0000","last_clean":"2023-05-15T16:40:02.283078+0000","last_became_active":"2023-05-15T16:40:00.755791+0000","last_became_peered":"2023-05-15T16:40:00.755791+0000","last_unstale":"2023-05-15T16:40:02.283078+0000","last_undegraded":"2023-05-15T16:40:02.283078+0000","last_fullsized":"2023-05-15T16:40:02.283078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:21:29.173379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.101846+0000","last_change":"2023-05-15T16:39:56.692931+0000","last_active":"2023-05-15T16:40:01.101846+0000","last_peered":"2023-05-15T16:40:01.101846+0000","last_clean":"2023-05-15T16:40:01.101846+0000","last_became_active":"2023-05-15T16:39:56.692557+0000","last_became_peered":"2023-05-15T16:39:56.692557+0000","last_unstale":"2023-05-15T16:40:01.101846+0000","last_undegraded":"2023-05-15T16:40:01.101846+0000","last_fullsized":"2023-05-15T16:40:01.101846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279898+0000","last_change":"2023-05-15T16:40:01.143115+0000","last_active":"2023-05-15T16:40:02.279898+0000","last_peered":"2023-05-15T16:40:02.279898+0000","last_clean":"2023-05-15T16:40:02.279898+0000","last_became_active":"2023-05-15T16:40:01.142777+0000","last_became_peered":"2023-05-15T16:40:01.142777+0000","last_unstale":"2023-05-15T16:40:02.279898+0000","last_undegraded":"2023-05-15T16:40:02.279898+0000","last_fullsized":"2023-05-15T16:40:02.279898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279615+0000","last_change":"2023-05-15T16:40:00.732385+0000","last_active":"2023-05-15T16:40:02.279615+0000","last_peered":"2023-05-15T16:40:02.279615+0000","last_clean":"2023-05-15T16:40:02.279615+0000","last_became_active":"2023-05-15T16:40:00.731887+0000","last_became_peered":"2023-05-15T16:40:00.731887+0000","last_unstale":"2023-05-15T16:40:02.279615+0000","last_undegraded":"2023-05-15T16:40:02.279615+0000","last_fullsized":"2023-05-15T16:40:02.279615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.129045+0000","last_change":"2023-05-15T16:39:56.698079+0000","last_active":"2023-05-15T16:40:01.129045+0000","last_peered":"2023-05-15T16:40:01.129045+0000","last_clean":"2023-05-15T16:40:01.129045+0000","last_became_active":"2023-05-15T16:39:56.697298+0000","last_became_peered":"2023-05-15T16:39:56.697298+0000","last_unstale":"2023-05-15T16:40:01.129045+0000","last_undegraded":"2023-05-15T16:40:01.129045+0000","last_fullsized":"2023-05-15T16:40:01.129045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:32:01.734351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097558+0000","last_change":"2023-05-15T16:40:01.144386+0000","last_active":"2023-05-15T16:40:02.097558+0000","last_peered":"2023-05-15T16:40:02.097558+0000","last_clean":"2023-05-15T16:40:02.097558+0000","last_became_active":"2023-05-15T16:40:01.144046+0000","last_became_peered":"2023-05-15T16:40:01.144046+0000","last_unstale":"2023-05-15T16:40:02.097558+0000","last_undegraded":"2023-05-15T16:40:02.097558+0000","last_fullsized":"2023-05-15T16:40:02.097558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:50:32.789209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.096140+0000","last_change":"2023-05-15T16:40:00.740983+0000","last_active":"2023-05-15T16:40:02.096140+0000","last_peered":"2023-05-15T16:40:02.096140+0000","last_clean":"2023-05-15T16:40:02.096140+0000","last_became_active":"2023-05-15T16:40:00.739828+0000","last_became_peered":"2023-05-15T16:40:00.739828+0000","last_unstale":"2023-05-15T16:40:02.096140+0000","last_undegraded":"2023-05-15T16:40:02.096140+0000","last_fullsized":"2023-05-15T16:40:02.096140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.101796+0000","last_change":"2023-05-15T16:39:56.694298+0000","last_active":"2023-05-15T16:40:01.101796+0000","last_peered":"2023-05-15T16:40:01.101796+0000","last_clean":"2023-05-15T16:40:01.101796+0000","last_became_active":"2023-05-15T16:39:56.693723+0000","last_became_peered":"2023-05-15T16:39:56.693723+0000","last_unstale":"2023-05-15T16:40:01.101796+0000","last_undegraded":"2023-05-15T16:40:01.101796+0000","last_fullsized":"2023-05-15T16:40:01.101796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:31.428692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095317+0000","last_change":"2023-05-15T16:40:01.125833+0000","last_active":"2023-05-15T16:40:02.095317+0000","last_peered":"2023-05-15T16:40:02.095317+0000","last_clean":"2023-05-15T16:40:02.095317+0000","last_became_active":"2023-05-15T16:40:01.125641+0000","last_became_peered":"2023-05-15T16:40:01.125641+0000","last_unstale":"2023-05-15T16:40:02.095317+0000","last_undegraded":"2023-05-15T16:40:02.095317+0000","last_fullsized":"2023-05-15T16:40:02.095317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:48:42.521388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098109+0000","last_change":"2023-05-15T16:40:00.729163+0000","last_active":"2023-05-15T16:40:02.098109+0000","last_peered":"2023-05-15T16:40:02.098109+0000","last_clean":"2023-05-15T16:40:02.098109+0000","last_became_active":"2023-05-15T16:40:00.725627+0000","last_became_peered":"2023-05-15T16:40:00.725627+0000","last_unstale":"2023-05-15T16:40:02.098109+0000","last_undegraded":"2023-05-15T16:40:02.098109+0000","last_fullsized":"2023-05-15T16:40:02.098109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.115241+0000","last_change":"2023-05-15T16:39:56.697003+0000","last_active":"2023-05-15T16:40:01.115241+0000","last_peered":"2023-05-15T16:40:01.115241+0000","last_clean":"2023-05-15T16:40:01.115241+0000","last_became_active":"2023-05-15T16:39:56.696210+0000","last_became_peered":"2023-05-15T16:39:56.696210+0000","last_unstale":"2023-05-15T16:40:01.115241+0000","last_undegraded":"2023-05-15T16:40:01.115241+0000","last_fullsized":"2023-05-15T16:40:01.115241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:29:27.454964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099418+0000","last_change":"2023-05-15T16:40:01.146590+0000","last_active":"2023-05-15T16:40:02.099418+0000","last_peered":"2023-05-15T16:40:02.099418+0000","last_clean":"2023-05-15T16:40:02.099418+0000","last_became_active":"2023-05-15T16:40:01.145902+0000","last_became_peered":"2023-05-15T16:40:01.145902+0000","last_unstale":"2023-05-15T16:40:02.099418+0000","last_undegraded":"2023-05-15T16:40:02.099418+0000","last_fullsized":"2023-05-15T16:40:02.099418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:26:42.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099663+0000","last_change":"2023-05-15T16:40:01.137328+0000","last_active":"2023-05-15T16:40:02.099663+0000","last_peered":"2023-05-15T16:40:02.099663+0000","last_clean":"2023-05-15T16:40:02.099663+0000","last_became_active":"2023-05-15T16:40:01.135859+0000","last_became_peered":"2023-05-15T16:40:01.135859+0000","last_unstale":"2023-05-15T16:40:02.099663+0000","last_undegraded":"2023-05-15T16:40:02.099663+0000","last_fullsized":"2023-05-15T16:40:02.099663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:22:08.631817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100701+0000","last_change":"2023-05-15T16:40:00.741443+0000","last_active":"2023-05-15T16:40:02.100701+0000","last_peered":"2023-05-15T16:40:02.100701+0000","last_clean":"2023-05-15T16:40:02.100701+0000","last_became_active":"2023-05-15T16:40:00.737218+0000","last_became_peered":"2023-05-15T16:40:00.737218+0000","last_unstale":"2023-05-15T16:40:02.100701+0000","last_undegraded":"2023-05-15T16:40:02.100701+0000","last_fullsized":"2023-05-15T16:40:02.100701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:05.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279727+0000","last_change":"2023-05-15T16:40:01.119384+0000","last_active":"2023-05-15T16:40:02.279727+0000","last_peered":"2023-05-15T16:40:02.279727+0000","last_clean":"2023-05-15T16:40:02.279727+0000","last_became_active":"2023-05-15T16:40:01.119075+0000","last_became_peered":"2023-05-15T16:40:01.119075+0000","last_unstale":"2023-05-15T16:40:02.279727+0000","last_undegraded":"2023-05-15T16:40:02.279727+0000","last_fullsized":"2023-05-15T16:40:02.279727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:29:25.132530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281736+0000","last_change":"2023-05-15T16:40:00.744828+0000","last_active":"2023-05-15T16:40:02.281736+0000","last_peered":"2023-05-15T16:40:02.281736+0000","last_clean":"2023-05-15T16:40:02.281736+0000","last_became_active":"2023-05-15T16:40:00.744103+0000","last_became_peered":"2023-05-15T16:40:00.744103+0000","last_unstale":"2023-05-15T16:40:02.281736+0000","last_undegraded":"2023-05-15T16:40:02.281736+0000","last_fullsized":"2023-05-15T16:40:02.281736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:19:48.425765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282856+0000","last_change":"2023-05-15T16:40:00.754697+0000","last_active":"2023-05-15T16:40:02.282856+0000","last_peered":"2023-05-15T16:40:02.282856+0000","last_clean":"2023-05-15T16:40:02.282856+0000","last_became_active":"2023-05-15T16:40:00.754117+0000","last_became_peered":"2023-05-15T16:40:00.754117+0000","last_unstale":"2023-05-15T16:40:02.282856+0000","last_undegraded":"2023-05-15T16:40:02.282856+0000","last_fullsized":"2023-05-15T16:40:02.282856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:05.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095638+0000","last_change":"2023-05-15T16:40:01.148027+0000","last_active":"2023-05-15T16:40:02.095638+0000","last_peered":"2023-05-15T16:40:02.095638+0000","last_clean":"2023-05-15T16:40:02.095638+0000","last_became_active":"2023-05-15T16:40:01.147699+0000","last_became_peered":"2023-05-15T16:40:01.147699+0000","last_unstale":"2023-05-15T16:40:02.095638+0000","last_undegraded":"2023-05-15T16:40:02.095638+0000","last_fullsized":"2023-05-15T16:40:02.095638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:50:32.789209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098446+0000","last_change":"2023-05-15T16:40:00.753008+0000","last_active":"2023-05-15T16:40:02.098446+0000","last_peered":"2023-05-15T16:40:02.098446+0000","last_clean":"2023-05-15T16:40:02.098446+0000","last_became_active":"2023-05-15T16:40:00.752696+0000","last_became_peered":"2023-05-15T16:40:00.752696+0000","last_unstale":"2023-05-15T16:40:02.098446+0000","last_undegraded":"2023-05-15T16:40:02.098446+0000","last_fullsized":"2023-05-15T16:40:02.098446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:30:28.823039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095101+0000","last_change":"2023-05-15T16:40:01.102001+0000","last_active":"2023-05-15T16:40:02.095101+0000","last_peered":"2023-05-15T16:40:02.095101+0000","last_clean":"2023-05-15T16:40:02.095101+0000","last_became_active":"2023-05-15T16:40:01.101708+0000","last_became_peered":"2023-05-15T16:40:01.101708+0000","last_unstale":"2023-05-15T16:40:02.095101+0000","last_undegraded":"2023-05-15T16:40:02.095101+0000","last_fullsized":"2023-05-15T16:40:02.095101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:13:33.110131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280831+0000","last_change":"2023-05-15T16:40:01.161461+0000","last_active":"2023-05-15T16:40:02.280831+0000","last_peered":"2023-05-15T16:40:02.280831+0000","last_clean":"2023-05-15T16:40:02.280831+0000","last_became_active":"2023-05-15T16:40:01.160945+0000","last_became_peered":"2023-05-15T16:40:01.160945+0000","last_unstale":"2023-05-15T16:40:02.280831+0000","last_undegraded":"2023-05-15T16:40:02.280831+0000","last_fullsized":"2023-05-15T16:40:02.280831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:39:15.813849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095333+0000","last_change":"2023-05-15T16:40:00.740953+0000","last_active":"2023-05-15T16:40:02.095333+0000","last_peered":"2023-05-15T16:40:02.095333+0000","last_clean":"2023-05-15T16:40:02.095333+0000","last_became_active":"2023-05-15T16:40:00.739500+0000","last_became_peered":"2023-05-15T16:40:00.739500+0000","last_unstale":"2023-05-15T16:40:02.095333+0000","last_undegraded":"2023-05-15T16:40:02.095333+0000","last_fullsized":"2023-05-15T16:40:02.095333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:56:52.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097941+0000","last_change":"2023-05-15T16:40:01.147295+0000","last_active":"2023-05-15T16:40:02.097941+0000","last_peered":"2023-05-15T16:40:02.097941+0000","last_clean":"2023-05-15T16:40:02.097941+0000","last_became_active":"2023-05-15T16:40:01.146994+0000","last_became_peered":"2023-05-15T16:40:01.146994+0000","last_unstale":"2023-05-15T16:40:02.097941+0000","last_undegraded":"2023-05-15T16:40:02.097941+0000","last_fullsized":"2023-05-15T16:40:02.097941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:13:33.110131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279178+0000","last_change":"2023-05-15T16:40:00.733783+0000","last_active":"2023-05-15T16:40:02.279178+0000","last_peered":"2023-05-15T16:40:02.279178+0000","last_clean":"2023-05-15T16:40:02.279178+0000","last_became_active":"2023-05-15T16:40:00.733442+0000","last_became_peered":"2023-05-15T16:40:00.733442+0000","last_unstale":"2023-05-15T16:40:02.279178+0000","last_undegraded":"2023-05-15T16:40:02.279178+0000","last_fullsized":"2023-05-15T16:40:02.279178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:56:52.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095487+0000","last_change":"2023-05-15T16:40:01.108561+0000","last_active":"2023-05-15T16:40:02.095487+0000","last_peered":"2023-05-15T16:40:02.095487+0000","last_clean":"2023-05-15T16:40:02.095487+0000","last_became_active":"2023-05-15T16:40:01.108286+0000","last_became_peered":"2023-05-15T16:40:01.108286+0000","last_unstale":"2023-05-15T16:40:02.095487+0000","last_undegraded":"2023-05-15T16:40:02.095487+0000","last_fullsized":"2023-05-15T16:40:02.095487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:07:25.649507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099944+0000","last_change":"2023-05-15T16:40:00.748959+0000","last_active":"2023-05-15T16:40:02.099944+0000","last_peered":"2023-05-15T16:40:02.099944+0000","last_clean":"2023-05-15T16:40:02.099944+0000","last_became_active":"2023-05-15T16:40:00.744181+0000","last_became_peered":"2023-05-15T16:40:00.744181+0000","last_unstale":"2023-05-15T16:40:02.099944+0000","last_undegraded":"2023-05-15T16:40:02.099944+0000","last_fullsized":"2023-05-15T16:40:02.099944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:30:28.823039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278386+0000","last_change":"2023-05-15T16:40:01.111006+0000","last_active":"2023-05-15T16:40:02.278386+0000","last_peered":"2023-05-15T16:40:02.278386+0000","last_clean":"2023-05-15T16:40:02.278386+0000","last_became_active":"2023-05-15T16:40:01.110731+0000","last_became_peered":"2023-05-15T16:40:01.110731+0000","last_unstale":"2023-05-15T16:40:02.278386+0000","last_undegraded":"2023-05-15T16:40:02.278386+0000","last_fullsized":"2023-05-15T16:40:02.278386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:21:30.182882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097788+0000","last_change":"2023-05-15T16:40:00.760933+0000","last_active":"2023-05-15T16:40:02.097788+0000","last_peered":"2023-05-15T16:40:02.097788+0000","last_clean":"2023-05-15T16:40:02.097788+0000","last_became_active":"2023-05-15T16:40:00.760570+0000","last_became_peered":"2023-05-15T16:40:00.760570+0000","last_unstale":"2023-05-15T16:40:02.097788+0000","last_undegraded":"2023-05-15T16:40:02.097788+0000","last_fullsized":"2023-05-15T16:40:02.097788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:51:41.940063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099449+0000","last_change":"2023-05-15T16:40:01.137937+0000","last_active":"2023-05-15T16:40:02.099449+0000","last_peered":"2023-05-15T16:40:02.099449+0000","last_clean":"2023-05-15T16:40:02.099449+0000","last_became_active":"2023-05-15T16:40:01.136661+0000","last_became_peered":"2023-05-15T16:40:01.136661+0000","last_unstale":"2023-05-15T16:40:02.099449+0000","last_undegraded":"2023-05-15T16:40:02.099449+0000","last_fullsized":"2023-05-15T16:40:02.099449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:45:23.112789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282296+0000","last_change":"2023-05-15T16:40:00.765428+0000","last_active":"2023-05-15T16:40:02.282296+0000","last_peered":"2023-05-15T16:40:02.282296+0000","last_clean":"2023-05-15T16:40:02.282296+0000","last_became_active":"2023-05-15T16:40:00.764846+0000","last_became_peered":"2023-05-15T16:40:00.764846+0000","last_unstale":"2023-05-15T16:40:02.282296+0000","last_undegraded":"2023-05-15T16:40:02.282296+0000","last_fullsized":"2023-05-15T16:40:02.282296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:56:13.804754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099659+0000","last_change":"2023-05-15T16:40:01.138011+0000","last_active":"2023-05-15T16:40:02.099659+0000","last_peered":"2023-05-15T16:40:02.099659+0000","last_clean":"2023-05-15T16:40:02.099659+0000","last_became_active":"2023-05-15T16:40:01.136847+0000","last_became_peered":"2023-05-15T16:40:01.136847+0000","last_unstale":"2023-05-15T16:40:02.099659+0000","last_undegraded":"2023-05-15T16:40:02.099659+0000","last_fullsized":"2023-05-15T16:40:02.099659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:14:14.713803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282986+0000","last_change":"2023-05-15T16:40:00.765361+0000","last_active":"2023-05-15T16:40:02.282986+0000","last_peered":"2023-05-15T16:40:02.282986+0000","last_clean":"2023-05-15T16:40:02.282986+0000","last_became_active":"2023-05-15T16:40:00.764881+0000","last_became_peered":"2023-05-15T16:40:00.764881+0000","last_unstale":"2023-05-15T16:40:02.282986+0000","last_undegraded":"2023-05-15T16:40:02.282986+0000","last_fullsized":"2023-05-15T16:40:02.282986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:51:41.940063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095732+0000","last_change":"2023-05-15T16:40:01.102202+0000","last_active":"2023-05-15T16:40:02.095732+0000","last_peered":"2023-05-15T16:40:02.095732+0000","last_clean":"2023-05-15T16:40:02.095732+0000","last_became_active":"2023-05-15T16:40:01.101916+0000","last_became_peered":"2023-05-15T16:40:01.101916+0000","last_unstale":"2023-05-15T16:40:02.095732+0000","last_undegraded":"2023-05-15T16:40:02.095732+0000","last_fullsized":"2023-05-15T16:40:02.095732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:26:45.774263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095575+0000","last_change":"2023-05-15T16:40:00.736792+0000","last_active":"2023-05-15T16:40:02.095575+0000","last_peered":"2023-05-15T16:40:02.095575+0000","last_clean":"2023-05-15T16:40:02.095575+0000","last_became_active":"2023-05-15T16:40:00.736507+0000","last_became_peered":"2023-05-15T16:40:00.736507+0000","last_unstale":"2023-05-15T16:40:02.095575+0000","last_undegraded":"2023-05-15T16:40:02.095575+0000","last_fullsized":"2023-05-15T16:40:02.095575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:21:29.173379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099100+0000","last_change":"2023-05-15T16:40:01.134199+0000","last_active":"2023-05-15T16:40:02.099100+0000","last_peered":"2023-05-15T16:40:02.099100+0000","last_clean":"2023-05-15T16:40:02.099100+0000","last_became_active":"2023-05-15T16:40:01.133481+0000","last_became_peered":"2023-05-15T16:40:01.133481+0000","last_unstale":"2023-05-15T16:40:02.099100+0000","last_undegraded":"2023-05-15T16:40:02.099100+0000","last_fullsized":"2023-05-15T16:40:02.099100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098440+0000","last_change":"2023-05-15T16:40:00.753734+0000","last_active":"2023-05-15T16:40:02.098440+0000","last_peered":"2023-05-15T16:40:02.098440+0000","last_clean":"2023-05-15T16:40:02.098440+0000","last_became_active":"2023-05-15T16:40:00.753401+0000","last_became_peered":"2023-05-15T16:40:00.753401+0000","last_unstale":"2023-05-15T16:40:02.098440+0000","last_undegraded":"2023-05-15T16:40:02.098440+0000","last_fullsized":"2023-05-15T16:40:02.098440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:56:52.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9108,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362732,"statfs":{"total":96636764160,"available":96627437568,"internally_reserved":0,"allocated":864256,"data_stored":681731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":90235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":91203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8056,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363784,"statfs":{"total":96636764160,"available":96628514816,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4870000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7924,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363916,"statfs":{"total":96636764160,"available":96628649984,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8052,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363788,"statfs":{"total":96636764160,"available":96628518912,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.1560000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.3659999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.645}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9084,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362756,"statfs":{"total":96636764160,"available":96627462144,"internally_reserved":0,"allocated":839680,"data_stored":680533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6140000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-15T16:40:05.550 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-05-15T16:40:05.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.699+0000 7f6aa3079640 1 Processor -- start 2023-05-15T16:40:05.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.699+0000 7f6aa3079640 1 -- start start 2023-05-15T16:40:05.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.699+0000 7f6aa3079640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6a9c0b5330 0x7f6a9c0b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:05.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.699+0000 7f6aa3079640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a9c071a90 0x7f6a9c0b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:05.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.699+0000 7f6aa3079640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6a9c144e90 0x7f6a9c145310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:05.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.699+0000 7f6aa3079640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9c0b2280 con 0x7f6a9c144e90 2023-05-15T16:40:05.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.699+0000 7f6aa3079640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a9c0716b0 con 0x7f6a9c0b5330 2023-05-15T16:40:05.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.699+0000 7f6aa3079640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c0afa90 con 0x7f6a9c071a90 2023-05-15T16:40:05.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.699+0000 7f6aa1616640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6a9c144e90 0x7f6a9c145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:05.708 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.699+0000 7f6aa1616640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6a9c144e90 0x7f6a9c145310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42544/0 (socket says 172.21.15.62:42544) 2023-05-15T16:40:05.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.699+0000 7f6aa1616640 1 -- 172.21.15.62:0/3061222451 learned_addr learned my addr 172.21.15.62:0/3061222451 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:05.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.703+0000 7f6aa0e15640 1 --2- 172.21.15.62:0/3061222451 >> v2:172.21.15.161:3300/0 conn(0x7f6a9c0b5330 0x7f6a9c0b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:05.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.703+0000 7f6a93fff640 1 --2- 172.21.15.62:0/3061222451 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a9c071a90 0x7f6a9c0b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:05.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.703+0000 7f6aa1616640 1 -- 172.21.15.62:0/3061222451 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a9c071a90 msgr2=0x7f6a9c0b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:05.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.703+0000 7f6aa1616640 1 --2- 172.21.15.62:0/3061222451 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a9c071a90 0x7f6a9c0b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.703+0000 7f6aa1616640 1 -- 172.21.15.62:0/3061222451 >> v2:172.21.15.161:3300/0 conn(0x7f6a9c0b5330 msgr2=0x7f6a9c0b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:05.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.703+0000 7f6aa1616640 1 --2- 172.21.15.62:0/3061222451 >> v2:172.21.15.161:3300/0 conn(0x7f6a9c0b5330 0x7f6a9c0b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.709 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.703+0000 7f6aa1616640 1 -- 172.21.15.62:0/3061222451 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a9c0b0f00 con 0x7f6a9c144e90 2023-05-15T16:40:05.710 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.703+0000 7f6aa0e15640 1 --2- 172.21.15.62:0/3061222451 >> v2:172.21.15.161:3300/0 conn(0x7f6a9c0b5330 0x7f6a9c0b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:05.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.703+0000 7f6aa1616640 1 --2- 172.21.15.62:0/3061222451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a9c144e90 0x7f6a9c145310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0b95d0 tx=0x7f6a9401c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3742b51d1bf6ed5d server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:05.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.703+0000 7f6a937fe640 1 -- 172.21.15.62:0/3061222451 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a940a5820 con 0x7f6a9c144e90 2023-05-15T16:40:05.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.703+0000 7f6a937fe640 1 -- 172.21.15.62:0/3061222451 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a940a5980 con 0x7f6a9c144e90 2023-05-15T16:40:05.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.703+0000 7f6a937fe640 1 -- 172.21.15.62:0/3061222451 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a940a5d10 con 0x7f6a9c144e90 2023-05-15T16:40:05.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.703+0000 7f6aa3079640 1 -- 172.21.15.62:0/3061222451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a9c144e90 msgr2=0x7f6a9c145310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:05.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.703+0000 7f6aa3079640 1 --2- 172.21.15.62:0/3061222451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a9c144e90 0x7f6a9c145310 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6a9c0b95d0 tx=0x7f6a9401c9a0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.703+0000 7f6aa3079640 1 -- 172.21.15.62:0/3061222451 shutdown_connections 2023-05-15T16:40:05.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.703+0000 7f6aa3079640 1 --2- 172.21.15.62:0/3061222451 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a9c144e90 0x7f6a9c145310 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.703+0000 7f6aa3079640 1 --2- 172.21.15.62:0/3061222451 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a9c071a90 0x7f6a9c0b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.703+0000 7f6aa3079640 1 --2- 172.21.15.62:0/3061222451 >> v2:172.21.15.161:3300/0 conn(0x7f6a9c0b5330 0x7f6a9c0b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.703+0000 7f6aa3079640 1 -- 172.21.15.62:0/3061222451 >> 172.21.15.62:0/3061222451 conn(0x7f6a9c0653f0 msgr2=0x7f6a9c0697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:05.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.703+0000 7f6aa3079640 1 -- 172.21.15.62:0/3061222451 shutdown_connections 2023-05-15T16:40:05.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.703+0000 7f6aa3079640 1 -- 172.21.15.62:0/3061222451 wait complete. 2023-05-15T16:40:05.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6aa3079640 1 Processor -- start 2023-05-15T16:40:05.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6aa3079640 1 -- start start 2023-05-15T16:40:05.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6aa3079640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a9c071a90 0x7f6a9c1431f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:05.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6aa3079640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a9c0b5330 0x7f6a9c1506f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:05.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6aa3079640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a9c144e90 0x7f6a9c150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:05.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6aa3079640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c143730 con 0x7f6a9c0b5330 2023-05-15T16:40:05.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6aa3079640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c1e2c30 con 0x7f6a9c071a90 2023-05-15T16:40:05.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6aa3079640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a9c1e2300 con 0x7f6a9c144e90 2023-05-15T16:40:05.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6a93fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a9c0b5330 0x7f6a9c1506f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:05.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6a93fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a9c0b5330 0x7f6a9c1506f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42560/0 (socket says 172.21.15.62:42560) 2023-05-15T16:40:05.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6a93fff640 1 -- 172.21.15.62:0/1275624395 learned_addr learned my addr 172.21.15.62:0/1275624395 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:05.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6aa0e15640 1 --2- 172.21.15.62:0/1275624395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a9c071a90 0x7f6a9c1431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:05.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6aa1616640 1 --2- 172.21.15.62:0/1275624395 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a9c144e90 0x7f6a9c150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:05.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6a93fff640 1 -- 172.21.15.62:0/1275624395 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a9c144e90 msgr2=0x7f6a9c150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:05.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6a93fff640 1 --2- 172.21.15.62:0/1275624395 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a9c144e90 0x7f6a9c150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6a93fff640 1 -- 172.21.15.62:0/1275624395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a9c071a90 msgr2=0x7f6a9c1431f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:05.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6a93fff640 1 --2- 172.21.15.62:0/1275624395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a9c071a90 0x7f6a9c1431f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6a93fff640 1 -- 172.21.15.62:0/1275624395 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a94009b30 con 0x7f6a9c0b5330 2023-05-15T16:40:05.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6a93fff640 1 --2- 172.21.15.62:0/1275624395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a9c0b5330 0x7f6a9c1506f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00d7d0 tx=0x7f6a8c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:05.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6a917fa640 1 -- 172.21.15.62:0/1275624395 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c00b6c0 con 0x7f6a9c0b5330 2023-05-15T16:40:05.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6a917fa640 1 -- 172.21.15.62:0/1275624395 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a8c00b820 con 0x7f6a9c0b5330 2023-05-15T16:40:05.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6a917fa640 1 -- 172.21.15.62:0/1275624395 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c00bbd0 con 0x7f6a9c0b5330 2023-05-15T16:40:05.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6aa3079640 1 -- 172.21.15.62:0/1275624395 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a9c0b1ec0 con 0x7f6a9c0b5330 2023-05-15T16:40:05.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6aa3079640 1 -- 172.21.15.62:0/1275624395 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a9c0b1c00 con 0x7f6a9c0b5330 2023-05-15T16:40:05.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.707+0000 7f6aa3079640 1 -- 172.21.15.62:0/1275624395 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a9c0b2050 con 0x7f6a9c0b5330 2023-05-15T16:40:05.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.711+0000 7f6a917fa640 1 -- 172.21.15.62:0/1275624395 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f6a8c00bd30 con 0x7f6a9c0b5330 2023-05-15T16:40:05.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.711+0000 7f6a917fa640 1 --2- 172.21.15.62:0/1275624395 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6a88065380 0x7f6a88067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:05.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.711+0000 7f6a917fa640 1 -- 172.21.15.62:0/1275624395 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6a8c082dd0 con 0x7f6a9c0b5330 2023-05-15T16:40:05.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.711+0000 7f6aa0e15640 1 --2- 172.21.15.62:0/1275624395 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6a88065380 0x7f6a88067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:05.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.711+0000 7f6aa0e15640 1 --2- 172.21.15.62:0/1275624395 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6a88065380 0x7f6a88067830 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6a98006fd0 tx=0x7f6a98008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:05.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.715+0000 7f6a917fa640 1 -- 172.21.15.62:0/1275624395 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f6a8c050a50 con 0x7f6a9c0b5330 2023-05-15T16:40:05.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.919+0000 7f6aa3079640 1 -- 172.21.15.62:0/1275624395 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f6a9c067960 con 0x7f6a9c0b5330 2023-05-15T16:40:05.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.919+0000 7f6a917fa640 1 -- 172.21.15.62:0/1275624395 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1011 (secure 0 0 0) 0x7f6a8c084410 con 0x7f6a9c0b5330 2023-05-15T16:40:05.926 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:05.926 INFO:teuthology.orchestra.run.smithi062.stdout:{"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":23,"num_osds":8,"num_up_osds":8,"osd_up_since":1684168788,"num_in_osds":8,"osd_in_since":1684168779,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":105}],"num_pgs":105,"num_pools":4,"num_objects":24,"data_bytes":592698,"bytes_used":67870720,"bytes_avail":773026242560,"bytes_total":773094113280,"write_bytes_sec":2553,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":7,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4263}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-05-15T16:39:36.758637+0000","services":{}},"progress_events":{}} 2023-05-15T16:40:05.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.923+0000 7f6aa3079640 1 -- 172.21.15.62:0/1275624395 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6a88065380 msgr2=0x7f6a88067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:05.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.923+0000 7f6aa3079640 1 --2- 172.21.15.62:0/1275624395 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6a88065380 0x7f6a88067830 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f6a98006fd0 tx=0x7f6a98008040 comp rx=0 tx=0).stop 2023-05-15T16:40:05.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.923+0000 7f6aa3079640 1 -- 172.21.15.62:0/1275624395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a9c0b5330 msgr2=0x7f6a9c1506f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:05.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.923+0000 7f6aa3079640 1 --2- 172.21.15.62:0/1275624395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a9c0b5330 0x7f6a9c1506f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c00d7d0 tx=0x7f6a8c00dc90 comp rx=0 tx=0).stop 2023-05-15T16:40:05.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.923+0000 7f6aa3079640 1 -- 172.21.15.62:0/1275624395 shutdown_connections 2023-05-15T16:40:05.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.923+0000 7f6aa3079640 1 --2- 172.21.15.62:0/1275624395 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a9c144e90 0x7f6a9c150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.923+0000 7f6aa3079640 1 --2- 172.21.15.62:0/1275624395 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6a88065380 0x7f6a88067830 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.923+0000 7f6aa3079640 1 --2- 172.21.15.62:0/1275624395 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a9c0b5330 0x7f6a9c1506f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.923+0000 7f6aa3079640 1 --2- 172.21.15.62:0/1275624395 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a9c071a90 0x7f6a9c1431f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:05.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.923+0000 7f6aa3079640 1 -- 172.21.15.62:0/1275624395 >> 172.21.15.62:0/1275624395 conn(0x7f6a9c0653f0 msgr2=0x7f6a9c141490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:05.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.923+0000 7f6aa3079640 1 -- 172.21.15.62:0/1275624395 shutdown_connections 2023-05-15T16:40:05.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:05.923+0000 7f6aa3079640 1 -- 172.21.15.62:0/1275624395 wait complete. 2023-05-15T16:40:05.942 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-05-15T16:40:05.943 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-15T16:40:06.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.051+0000 7f89020ce640 1 Processor -- start 2023-05-15T16:40:06.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.051+0000 7f89020ce640 1 -- start start 2023-05-15T16:40:06.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.051+0000 7f89020ce640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f88fc0b8780 0x7f88fc0b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:06.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.051+0000 7f89020ce640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f88fc147570 0x7f88fc0b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:06.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.051+0000 7f89020ce640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88fc0b3400 con 0x7f88fc0b3a10 2023-05-15T16:40:06.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.051+0000 7f89020ce640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88fc0b5450 con 0x7f88fc147570 2023-05-15T16:40:06.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.051+0000 7f89020ce640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88fc0b5ae0 con 0x7f88fc0b8780 2023-05-15T16:40:06.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.051+0000 7f88fbfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f88fc147570 0x7f88fc0b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:06.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.051+0000 7f88fbfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f88fc147570 0x7f88fc0b3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42568/0 (socket says 172.21.15.62:42568) 2023-05-15T16:40:06.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.051+0000 7f88fbfff640 1 -- 172.21.15.62:0/4243735120 learned_addr learned my addr 172.21.15.62:0/4243735120 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:06.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.051+0000 7f88fbfff640 1 -- 172.21.15.62:0/4243735120 >> v2:172.21.15.161:3300/0 conn(0x7f88fc0b8780 msgr2=0x7f88fc0b2ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:06.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.051+0000 7f88fbfff640 1 --2- 172.21.15.62:0/4243735120 >> v2:172.21.15.161:3300/0 conn(0x7f88fc0b8780 0x7f88fc0b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:06.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.051+0000 7f88fbfff640 1 -- 172.21.15.62:0/4243735120 >> v1:172.21.15.161:6789/0 conn(0x7f88fc0b3a10 legacy=0x7f88fc146e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:06.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.051+0000 7f88fbfff640 1 -- 172.21.15.62:0/4243735120 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88fc0b5dc0 con 0x7f88fc147570 2023-05-15T16:40:06.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f88fbfff640 1 --2- 172.21.15.62:0/4243735120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc147570 0x7f88fc0b3e70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f88fc0b94d0 tx=0x7f88f401ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814c1bcf5240193 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:06.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f88fa7fc640 1 -- 172.21.15.62:0/4243735120 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f40a89b0 con 0x7f88fc147570 2023-05-15T16:40:06.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f88fa7fc640 1 -- 172.21.15.62:0/4243735120 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f40a8b10 con 0x7f88fc147570 2023-05-15T16:40:06.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f88fa7fc640 1 -- 172.21.15.62:0/4243735120 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f40a8ea0 con 0x7f88fc147570 2023-05-15T16:40:06.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f89020ce640 1 -- 172.21.15.62:0/4243735120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc147570 msgr2=0x7f88fc0b3e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:06.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f89020ce640 1 --2- 172.21.15.62:0/4243735120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc147570 0x7f88fc0b3e70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f88fc0b94d0 tx=0x7f88f401ecb0 comp rx=0 tx=0).stop 2023-05-15T16:40:06.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f89020ce640 1 -- 172.21.15.62:0/4243735120 shutdown_connections 2023-05-15T16:40:06.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f89020ce640 1 --2- 172.21.15.62:0/4243735120 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc147570 0x7f88fc0b3e70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:06.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f89020ce640 1 --2- 172.21.15.62:0/4243735120 >> v2:172.21.15.161:3300/0 conn(0x7f88fc0b8780 0x7f88fc0b2ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:06.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f89020ce640 1 -- 172.21.15.62:0/4243735120 >> 172.21.15.62:0/4243735120 conn(0x7f88fc0653f0 msgr2=0x7f88fc0697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:06.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f89020ce640 1 -- 172.21.15.62:0/4243735120 shutdown_connections 2023-05-15T16:40:06.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f89020ce640 1 -- 172.21.15.62:0/4243735120 wait complete. 2023-05-15T16:40:06.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f89020ce640 1 Processor -- start 2023-05-15T16:40:06.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f89020ce640 1 -- start start 2023-05-15T16:40:06.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f89020ce640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88fc0b3a10 0x7f88fc0b1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:06.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f89020ce640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88fc0b8780 0x7f88fc0aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:06.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f89020ce640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc147570 0x7f88fc0bb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:06.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f89020ce640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc0b0e00 con 0x7f88fc147570 2023-05-15T16:40:06.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f89020ce640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc1df6d0 con 0x7f88fc0b3a10 2023-05-15T16:40:06.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f89020ce640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88fc0ba390 con 0x7f88fc0b8780 2023-05-15T16:40:06.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f88fbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc147570 0x7f88fc0bb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:06.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f88fbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc147570 0x7f88fc0bb8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42570/0 (socket says 172.21.15.62:42570) 2023-05-15T16:40:06.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.055+0000 7f88fbfff640 1 -- 172.21.15.62:0/840014071 learned_addr learned my addr 172.21.15.62:0/840014071 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:06.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.059+0000 7f88fb7fe640 1 --2- 172.21.15.62:0/840014071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88fc0b3a10 0x7f88fc0b1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:06.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.059+0000 7f88faffd640 1 --2- 172.21.15.62:0/840014071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88fc0b8780 0x7f88fc0aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:06.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.059+0000 7f88fbfff640 1 -- 172.21.15.62:0/840014071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88fc0b8780 msgr2=0x7f88fc0aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:06.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.059+0000 7f88fbfff640 1 --2- 172.21.15.62:0/840014071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88fc0b8780 0x7f88fc0aff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:06.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.059+0000 7f88fbfff640 1 -- 172.21.15.62:0/840014071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88fc0b3a10 msgr2=0x7f88fc0b1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:06.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.059+0000 7f88fbfff640 1 --2- 172.21.15.62:0/840014071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88fc0b3a10 0x7f88fc0b1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:06.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.059+0000 7f88fbfff640 1 -- 172.21.15.62:0/840014071 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88f40094d0 con 0x7f88fc147570 2023-05-15T16:40:06.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.059+0000 7f88fb7fe640 1 --2- 172.21.15.62:0/840014071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88fc0b3a10 0x7f88fc0b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:06.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.059+0000 7f88fbfff640 1 --2- 172.21.15.62:0/840014071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc147570 0x7f88fc0bb8a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f88f40b3040 tx=0x7f88f401ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:06.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.059+0000 7f88f3fff640 1 -- 172.21.15.62:0/840014071 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f40b0da0 con 0x7f88fc147570 2023-05-15T16:40:06.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.059+0000 7f88f3fff640 1 -- 172.21.15.62:0/840014071 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88f40bb470 con 0x7f88fc147570 2023-05-15T16:40:06.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.059+0000 7f89020ce640 1 -- 172.21.15.62:0/840014071 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88fc071ab0 con 0x7f88fc147570 2023-05-15T16:40:06.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.059+0000 7f88f3fff640 1 -- 172.21.15.62:0/840014071 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88f40bb7e0 con 0x7f88fc147570 2023-05-15T16:40:06.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.059+0000 7f89020ce640 1 -- 172.21.15.62:0/840014071 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88fc0717d0 con 0x7f88fc147570 2023-05-15T16:40:06.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.059+0000 7f89020ce640 1 -- 172.21.15.62:0/840014071 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88fc1deee0 con 0x7f88fc147570 2023-05-15T16:40:06.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.059+0000 7f88f3fff640 1 -- 172.21.15.62:0/840014071 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f88f40b7070 con 0x7f88fc147570 2023-05-15T16:40:06.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.059+0000 7f88f3fff640 1 --2- 172.21.15.62:0/840014071 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f88dc065380 0x7f88dc067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:06.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.059+0000 7f88f3fff640 1 -- 172.21.15.62:0/840014071 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f88f4120d10 con 0x7f88fc147570 2023-05-15T16:40:06.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.059+0000 7f88fb7fe640 1 --2- 172.21.15.62:0/840014071 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f88dc065380 0x7f88dc067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:06.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.059+0000 7f88fb7fe640 1 --2- 172.21.15.62:0/840014071 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f88dc065380 0x7f88dc067830 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00a8b0 tx=0x7f88ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:06.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.063+0000 7f88f3fff640 1 -- 172.21.15.62:0/840014071 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f88fc1deee0 con 0x7f88fc147570 2023-05-15T16:40:06.213 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.207+0000 7f89020ce640 1 -- 172.21.15.62:0/840014071 --> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f88fc1deee0 con 0x7f88dc065380 2023-05-15T16:40:06.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.231+0000 7f88f3fff640 1 -- 172.21.15.62:0/840014071 <== mgr.4105 v2:172.21.15.161:6832/37541 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286640 (secure 0 0 0) 0x7f88fc1deee0 con 0x7f88dc065380 2023-05-15T16:40:06.237 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:06.238 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-05-15T16:40:06.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.235+0000 7f89020ce640 1 -- 172.21.15.62:0/840014071 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f88dc065380 msgr2=0x7f88dc067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:06.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.235+0000 7f89020ce640 1 --2- 172.21.15.62:0/840014071 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f88dc065380 0x7f88dc067830 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f88ec00a8b0 tx=0x7f88ec008040 comp rx=0 tx=0).stop 2023-05-15T16:40:06.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.235+0000 7f89020ce640 1 -- 172.21.15.62:0/840014071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc147570 msgr2=0x7f88fc0bb8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:06.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.235+0000 7f89020ce640 1 --2- 172.21.15.62:0/840014071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc147570 0x7f88fc0bb8a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f88f40b3040 tx=0x7f88f401ba50 comp rx=0 tx=0).stop 2023-05-15T16:40:06.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.235+0000 7f89020ce640 1 -- 172.21.15.62:0/840014071 shutdown_connections 2023-05-15T16:40:06.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.235+0000 7f89020ce640 1 --2- 172.21.15.62:0/840014071 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f88dc065380 0x7f88dc067830 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:06.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.235+0000 7f89020ce640 1 --2- 172.21.15.62:0/840014071 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f88fc147570 0x7f88fc0bb8a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:06.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.235+0000 7f89020ce640 1 --2- 172.21.15.62:0/840014071 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f88fc0b8780 0x7f88fc0aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:06.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.235+0000 7f89020ce640 1 --2- 172.21.15.62:0/840014071 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f88fc0b3a10 0x7f88fc0b1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:06.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.235+0000 7f89020ce640 1 -- 172.21.15.62:0/840014071 >> 172.21.15.62:0/840014071 conn(0x7f88fc0653f0 msgr2=0x7f88fc06fe80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:06.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.235+0000 7f89020ce640 1 -- 172.21.15.62:0/840014071 shutdown_connections 2023-05-15T16:40:06.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:06.235+0000 7f89020ce640 1 -- 172.21.15.62:0/840014071 wait complete. 2023-05-15T16:40:06.253 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2023-05-15T16:40:05.317193+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":193,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66280,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908440,"statfs":{"total":773094113280,"available":773026242560,"internally_reserved":0,"allocated":3186688,"data_stored":1902188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.614196"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278001+0000","last_change":"2023-05-15T16:40:01.108030+0000","last_active":"2023-05-15T16:40:02.278001+0000","last_peered":"2023-05-15T16:40:02.278001+0000","last_clean":"2023-05-15T16:40:02.278001+0000","last_became_active":"2023-05-15T16:40:01.107701+0000","last_became_peered":"2023-05-15T16:40:01.107701+0000","last_unstale":"2023-05-15T16:40:02.278001+0000","last_undegraded":"2023-05-15T16:40:02.278001+0000","last_fullsized":"2023-05-15T16:40:02.278001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:06.423119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282608+0000","last_change":"2023-05-15T16:40:01.162454+0000","last_active":"2023-05-15T16:40:02.282608+0000","last_peered":"2023-05-15T16:40:02.282608+0000","last_clean":"2023-05-15T16:40:02.282608+0000","last_became_active":"2023-05-15T16:40:01.161325+0000","last_became_peered":"2023-05-15T16:40:01.161325+0000","last_unstale":"2023-05-15T16:40:02.282608+0000","last_undegraded":"2023-05-15T16:40:02.282608+0000","last_fullsized":"2023-05-15T16:40:02.282608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:13:33.110131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100574+0000","last_change":"2023-05-15T16:40:01.140999+0000","last_active":"2023-05-15T16:40:02.100574+0000","last_peered":"2023-05-15T16:40:02.100574+0000","last_clean":"2023-05-15T16:40:02.100574+0000","last_became_active":"2023-05-15T16:40:01.138081+0000","last_became_peered":"2023-05-15T16:40:01.138081+0000","last_unstale":"2023-05-15T16:40:02.100574+0000","last_undegraded":"2023-05-15T16:40:02.100574+0000","last_fullsized":"2023-05-15T16:40:02.100574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:43:45.244861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280478+0000","last_change":"2023-05-15T16:40:01.125926+0000","last_active":"2023-05-15T16:40:02.280478+0000","last_peered":"2023-05-15T16:40:02.280478+0000","last_clean":"2023-05-15T16:40:02.280478+0000","last_became_active":"2023-05-15T16:40:01.121506+0000","last_became_peered":"2023-05-15T16:40:01.121506+0000","last_unstale":"2023-05-15T16:40:02.280478+0000","last_undegraded":"2023-05-15T16:40:02.280478+0000","last_fullsized":"2023-05-15T16:40:02.280478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:56:14.814256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097671+0000","last_change":"2023-05-15T16:40:01.113655+0000","last_active":"2023-05-15T16:40:02.097671+0000","last_peered":"2023-05-15T16:40:02.097671+0000","last_clean":"2023-05-15T16:40:02.097671+0000","last_became_active":"2023-05-15T16:40:01.113359+0000","last_became_peered":"2023-05-15T16:40:01.113359+0000","last_unstale":"2023-05-15T16:40:02.097671+0000","last_undegraded":"2023-05-15T16:40:02.097671+0000","last_fullsized":"2023-05-15T16:40:02.097671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099373+0000","last_change":"2023-05-15T16:40:01.138514+0000","last_active":"2023-05-15T16:40:02.099373+0000","last_peered":"2023-05-15T16:40:02.099373+0000","last_clean":"2023-05-15T16:40:02.099373+0000","last_became_active":"2023-05-15T16:40:01.137610+0000","last_became_peered":"2023-05-15T16:40:01.137610+0000","last_unstale":"2023-05-15T16:40:02.099373+0000","last_undegraded":"2023-05-15T16:40:02.099373+0000","last_fullsized":"2023-05-15T16:40:02.099373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:41:16.912612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280784+0000","last_change":"2023-05-15T16:40:01.149263+0000","last_active":"2023-05-15T16:40:02.280784+0000","last_peered":"2023-05-15T16:40:02.280784+0000","last_clean":"2023-05-15T16:40:02.280784+0000","last_became_active":"2023-05-15T16:40:01.148591+0000","last_became_peered":"2023-05-15T16:40:01.148591+0000","last_unstale":"2023-05-15T16:40:02.280784+0000","last_undegraded":"2023-05-15T16:40:02.280784+0000","last_fullsized":"2023-05-15T16:40:02.280784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:13:33.110131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282009+0000","last_change":"2023-05-15T16:40:01.160969+0000","last_active":"2023-05-15T16:40:02.282009+0000","last_peered":"2023-05-15T16:40:02.282009+0000","last_clean":"2023-05-15T16:40:02.282009+0000","last_became_active":"2023-05-15T16:40:01.160118+0000","last_became_peered":"2023-05-15T16:40:01.160118+0000","last_unstale":"2023-05-15T16:40:02.282009+0000","last_undegraded":"2023-05-15T16:40:02.282009+0000","last_fullsized":"2023-05-15T16:40:02.282009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098107+0000","last_change":"2023-05-15T16:40:01.114095+0000","last_active":"2023-05-15T16:40:02.098107+0000","last_peered":"2023-05-15T16:40:02.098107+0000","last_clean":"2023-05-15T16:40:02.098107+0000","last_became_active":"2023-05-15T16:40:01.113367+0000","last_became_peered":"2023-05-15T16:40:01.113367+0000","last_unstale":"2023-05-15T16:40:02.098107+0000","last_undegraded":"2023-05-15T16:40:02.098107+0000","last_fullsized":"2023-05-15T16:40:02.098107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:22:08.631817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282722+0000","last_change":"2023-05-15T16:40:01.161203+0000","last_active":"2023-05-15T16:40:02.282722+0000","last_peered":"2023-05-15T16:40:02.282722+0000","last_clean":"2023-05-15T16:40:02.282722+0000","last_became_active":"2023-05-15T16:40:01.160163+0000","last_became_peered":"2023-05-15T16:40:01.160163+0000","last_unstale":"2023-05-15T16:40:02.282722+0000","last_undegraded":"2023-05-15T16:40:02.282722+0000","last_fullsized":"2023-05-15T16:40:02.282722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:31:14.621756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100644+0000","last_change":"2023-05-15T16:40:01.140439+0000","last_active":"2023-05-15T16:40:02.100644+0000","last_peered":"2023-05-15T16:40:02.100644+0000","last_clean":"2023-05-15T16:40:02.100644+0000","last_became_active":"2023-05-15T16:40:01.136958+0000","last_became_peered":"2023-05-15T16:40:01.136958+0000","last_unstale":"2023-05-15T16:40:02.100644+0000","last_undegraded":"2023-05-15T16:40:02.100644+0000","last_fullsized":"2023-05-15T16:40:02.100644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:48:42.521388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278138+0000","last_change":"2023-05-15T16:40:01.140940+0000","last_active":"2023-05-15T16:40:02.278138+0000","last_peered":"2023-05-15T16:40:02.278138+0000","last_clean":"2023-05-15T16:40:02.278138+0000","last_became_active":"2023-05-15T16:40:01.140666+0000","last_became_peered":"2023-05-15T16:40:01.140666+0000","last_unstale":"2023-05-15T16:40:02.278138+0000","last_undegraded":"2023-05-15T16:40:02.278138+0000","last_fullsized":"2023-05-15T16:40:02.278138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:56:14.814256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278109+0000","last_change":"2023-05-15T16:40:01.104796+0000","last_active":"2023-05-15T16:40:02.278109+0000","last_peered":"2023-05-15T16:40:02.278109+0000","last_clean":"2023-05-15T16:40:02.278109+0000","last_became_active":"2023-05-15T16:40:01.104505+0000","last_became_peered":"2023-05-15T16:40:01.104505+0000","last_unstale":"2023-05-15T16:40:02.278109+0000","last_undegraded":"2023-05-15T16:40:02.278109+0000","last_fullsized":"2023-05-15T16:40:02.278109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:34.510844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.283018+0000","last_change":"2023-05-15T16:40:01.146028+0000","last_active":"2023-05-15T16:40:02.283018+0000","last_peered":"2023-05-15T16:40:02.283018+0000","last_clean":"2023-05-15T16:40:02.283018+0000","last_became_active":"2023-05-15T16:40:01.145321+0000","last_became_peered":"2023-05-15T16:40:01.145321+0000","last_unstale":"2023-05-15T16:40:02.283018+0000","last_undegraded":"2023-05-15T16:40:02.283018+0000","last_fullsized":"2023-05-15T16:40:02.283018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:02:23.376990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281189+0000","last_change":"2023-05-15T16:40:01.157628+0000","last_active":"2023-05-15T16:40:02.281189+0000","last_peered":"2023-05-15T16:40:02.281189+0000","last_clean":"2023-05-15T16:40:02.281189+0000","last_became_active":"2023-05-15T16:40:01.157096+0000","last_became_peered":"2023-05-15T16:40:01.157096+0000","last_unstale":"2023-05-15T16:40:02.281189+0000","last_undegraded":"2023-05-15T16:40:02.281189+0000","last_fullsized":"2023-05-15T16:40:02.281189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098971+0000","last_change":"2023-05-15T16:40:01.136171+0000","last_active":"2023-05-15T16:40:02.098971+0000","last_peered":"2023-05-15T16:40:02.098971+0000","last_clean":"2023-05-15T16:40:02.098971+0000","last_became_active":"2023-05-15T16:40:01.135400+0000","last_became_peered":"2023-05-15T16:40:01.135400+0000","last_unstale":"2023-05-15T16:40:02.098971+0000","last_undegraded":"2023-05-15T16:40:02.098971+0000","last_fullsized":"2023-05-15T16:40:02.098971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:15:00.512988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098127+0000","last_change":"2023-05-15T16:40:01.113893+0000","last_active":"2023-05-15T16:40:02.098127+0000","last_peered":"2023-05-15T16:40:02.098127+0000","last_clean":"2023-05-15T16:40:02.098127+0000","last_became_active":"2023-05-15T16:40:01.113415+0000","last_became_peered":"2023-05-15T16:40:01.113415+0000","last_unstale":"2023-05-15T16:40:02.098127+0000","last_undegraded":"2023-05-15T16:40:02.098127+0000","last_fullsized":"2023-05-15T16:40:02.098127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100417+0000","last_change":"2023-05-15T16:40:01.139891+0000","last_active":"2023-05-15T16:40:02.100417+0000","last_peered":"2023-05-15T16:40:02.100417+0000","last_clean":"2023-05-15T16:40:02.100417+0000","last_became_active":"2023-05-15T16:40:01.138421+0000","last_became_peered":"2023-05-15T16:40:01.138421+0000","last_unstale":"2023-05-15T16:40:02.100417+0000","last_undegraded":"2023-05-15T16:40:02.100417+0000","last_fullsized":"2023-05-15T16:40:02.100417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T03:57:26.700942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278992+0000","last_change":"2023-05-15T16:40:01.129321+0000","last_active":"2023-05-15T16:40:02.278992+0000","last_peered":"2023-05-15T16:40:02.278992+0000","last_clean":"2023-05-15T16:40:02.278992+0000","last_became_active":"2023-05-15T16:40:01.129026+0000","last_became_peered":"2023-05-15T16:40:01.129026+0000","last_unstale":"2023-05-15T16:40:02.278992+0000","last_undegraded":"2023-05-15T16:40:02.278992+0000","last_fullsized":"2023-05-15T16:40:02.278992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:51:42.949566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100354+0000","last_change":"2023-05-15T16:40:01.141251+0000","last_active":"2023-05-15T16:40:02.100354+0000","last_peered":"2023-05-15T16:40:02.100354+0000","last_clean":"2023-05-15T16:40:02.100354+0000","last_became_active":"2023-05-15T16:40:01.140102+0000","last_became_peered":"2023-05-15T16:40:01.140102+0000","last_unstale":"2023-05-15T16:40:02.100354+0000","last_undegraded":"2023-05-15T16:40:02.100354+0000","last_fullsized":"2023-05-15T16:40:02.100354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:14:42.054526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281668+0000","last_change":"2023-05-15T16:40:01.157690+0000","last_active":"2023-05-15T16:40:02.281668+0000","last_peered":"2023-05-15T16:40:02.281668+0000","last_clean":"2023-05-15T16:40:02.281668+0000","last_became_active":"2023-05-15T16:40:01.157028+0000","last_became_peered":"2023-05-15T16:40:01.157028+0000","last_unstale":"2023-05-15T16:40:02.281668+0000","last_undegraded":"2023-05-15T16:40:02.281668+0000","last_fullsized":"2023-05-15T16:40:02.281668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097365+0000","last_change":"2023-05-15T16:40:01.111473+0000","last_active":"2023-05-15T16:40:02.097365+0000","last_peered":"2023-05-15T16:40:02.097365+0000","last_clean":"2023-05-15T16:40:02.097365+0000","last_became_active":"2023-05-15T16:40:01.109519+0000","last_became_peered":"2023-05-15T16:40:01.109519+0000","last_unstale":"2023-05-15T16:40:02.097365+0000","last_undegraded":"2023-05-15T16:40:02.097365+0000","last_fullsized":"2023-05-15T16:40:02.097365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:39:15.813849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095154+0000","last_change":"2023-05-15T16:40:01.109311+0000","last_active":"2023-05-15T16:40:02.095154+0000","last_peered":"2023-05-15T16:40:02.095154+0000","last_clean":"2023-05-15T16:40:02.095154+0000","last_became_active":"2023-05-15T16:40:01.109001+0000","last_became_peered":"2023-05-15T16:40:01.109001+0000","last_unstale":"2023-05-15T16:40:02.095154+0000","last_undegraded":"2023-05-15T16:40:02.095154+0000","last_fullsized":"2023-05-15T16:40:02.095154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:22:08.631817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280862+0000","last_change":"2023-05-15T16:40:01.151544+0000","last_active":"2023-05-15T16:40:02.280862+0000","last_peered":"2023-05-15T16:40:02.280862+0000","last_clean":"2023-05-15T16:40:02.280862+0000","last_became_active":"2023-05-15T16:40:01.150292+0000","last_became_peered":"2023-05-15T16:40:01.150292+0000","last_unstale":"2023-05-15T16:40:02.280862+0000","last_undegraded":"2023-05-15T16:40:02.280862+0000","last_fullsized":"2023-05-15T16:40:02.280862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279251+0000","last_change":"2023-05-15T16:40:01.119067+0000","last_active":"2023-05-15T16:40:02.279251+0000","last_peered":"2023-05-15T16:40:02.279251+0000","last_clean":"2023-05-15T16:40:02.279251+0000","last_became_active":"2023-05-15T16:40:01.118808+0000","last_became_peered":"2023-05-15T16:40:01.118808+0000","last_unstale":"2023-05-15T16:40:02.279251+0000","last_undegraded":"2023-05-15T16:40:02.279251+0000","last_fullsized":"2023-05-15T16:40:02.279251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:02:23.376990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279750+0000","last_change":"2023-05-15T16:40:01.108611+0000","last_active":"2023-05-15T16:40:02.279750+0000","last_peered":"2023-05-15T16:40:02.279750+0000","last_clean":"2023-05-15T16:40:02.279750+0000","last_became_active":"2023-05-15T16:40:01.107595+0000","last_became_peered":"2023-05-15T16:40:01.107595+0000","last_unstale":"2023-05-15T16:40:02.279750+0000","last_undegraded":"2023-05-15T16:40:02.279750+0000","last_fullsized":"2023-05-15T16:40:02.279750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:45:33.580738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282768+0000","last_change":"2023-05-15T16:40:01.161786+0000","last_active":"2023-05-15T16:40:02.282768+0000","last_peered":"2023-05-15T16:40:02.282768+0000","last_clean":"2023-05-15T16:40:02.282768+0000","last_became_active":"2023-05-15T16:40:01.160406+0000","last_became_peered":"2023-05-15T16:40:01.160406+0000","last_unstale":"2023-05-15T16:40:02.282768+0000","last_undegraded":"2023-05-15T16:40:02.282768+0000","last_fullsized":"2023-05-15T16:40:02.282768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279900+0000","last_change":"2023-05-15T16:40:01.147235+0000","last_active":"2023-05-15T16:40:02.279900+0000","last_peered":"2023-05-15T16:40:02.279900+0000","last_clean":"2023-05-15T16:40:02.279900+0000","last_became_active":"2023-05-15T16:40:01.146964+0000","last_became_peered":"2023-05-15T16:40:01.146964+0000","last_unstale":"2023-05-15T16:40:02.279900+0000","last_undegraded":"2023-05-15T16:40:02.279900+0000","last_fullsized":"2023-05-15T16:40:02.279900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:07:25.649507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095330+0000","last_change":"2023-05-15T16:40:01.125493+0000","last_active":"2023-05-15T16:40:02.095330+0000","last_peered":"2023-05-15T16:40:02.095330+0000","last_clean":"2023-05-15T16:40:02.095330+0000","last_became_active":"2023-05-15T16:40:01.125172+0000","last_became_peered":"2023-05-15T16:40:01.125172+0000","last_unstale":"2023-05-15T16:40:02.095330+0000","last_undegraded":"2023-05-15T16:40:02.095330+0000","last_fullsized":"2023-05-15T16:40:02.095330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099957+0000","last_change":"2023-05-15T16:40:01.138349+0000","last_active":"2023-05-15T16:40:02.099957+0000","last_peered":"2023-05-15T16:40:02.099957+0000","last_clean":"2023-05-15T16:40:02.099957+0000","last_became_active":"2023-05-15T16:40:01.137255+0000","last_became_peered":"2023-05-15T16:40:01.137255+0000","last_unstale":"2023-05-15T16:40:02.099957+0000","last_undegraded":"2023-05-15T16:40:02.099957+0000","last_fullsized":"2023-05-15T16:40:02.099957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:22:31.889776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095427+0000","last_change":"2023-05-15T16:40:01.105121+0000","last_active":"2023-05-15T16:40:02.095427+0000","last_peered":"2023-05-15T16:40:02.095427+0000","last_clean":"2023-05-15T16:40:02.095427+0000","last_became_active":"2023-05-15T16:40:01.104061+0000","last_became_peered":"2023-05-15T16:40:01.104061+0000","last_unstale":"2023-05-15T16:40:02.095427+0000","last_undegraded":"2023-05-15T16:40:02.095427+0000","last_fullsized":"2023-05-15T16:40:02.095427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279918+0000","last_change":"2023-05-15T16:40:01.132449+0000","last_active":"2023-05-15T16:40:02.279918+0000","last_peered":"2023-05-15T16:40:02.279918+0000","last_clean":"2023-05-15T16:40:02.279918+0000","last_became_active":"2023-05-15T16:40:01.131460+0000","last_became_peered":"2023-05-15T16:40:01.131460+0000","last_unstale":"2023-05-15T16:40:02.279918+0000","last_undegraded":"2023-05-15T16:40:02.279918+0000","last_fullsized":"2023-05-15T16:40:02.279918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:19:49.435267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.096152+0000","last_change":"2023-05-15T16:40:01.109245+0000","last_active":"2023-05-15T16:40:02.096152+0000","last_peered":"2023-05-15T16:40:02.096152+0000","last_clean":"2023-05-15T16:40:02.096152+0000","last_became_active":"2023-05-15T16:40:01.108858+0000","last_became_peered":"2023-05-15T16:40:01.108858+0000","last_unstale":"2023-05-15T16:40:02.096152+0000","last_undegraded":"2023-05-15T16:40:02.096152+0000","last_fullsized":"2023-05-15T16:40:02.096152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:45:33.580738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281902+0000","last_change":"2023-05-15T16:40:00.763235+0000","last_active":"2023-05-15T16:40:02.281902+0000","last_peered":"2023-05-15T16:40:02.281902+0000","last_clean":"2023-05-15T16:40:02.281902+0000","last_became_active":"2023-05-15T16:40:00.762235+0000","last_became_peered":"2023-05-15T16:40:00.762235+0000","last_unstale":"2023-05-15T16:40:02.281902+0000","last_undegraded":"2023-05-15T16:40:02.281902+0000","last_fullsized":"2023-05-15T16:40:02.281902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:51:11.783628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282911+0000","last_change":"2023-05-15T16:40:01.160372+0000","last_active":"2023-05-15T16:40:02.282911+0000","last_peered":"2023-05-15T16:40:02.282911+0000","last_clean":"2023-05-15T16:40:02.282911+0000","last_became_active":"2023-05-15T16:40:01.159573+0000","last_became_peered":"2023-05-15T16:40:01.159573+0000","last_unstale":"2023-05-15T16:40:02.282911+0000","last_undegraded":"2023-05-15T16:40:02.282911+0000","last_fullsized":"2023-05-15T16:40:02.282911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097310+0000","last_change":"2023-05-15T16:40:00.739620+0000","last_active":"2023-05-15T16:40:02.097310+0000","last_peered":"2023-05-15T16:40:02.097310+0000","last_clean":"2023-05-15T16:40:02.097310+0000","last_became_active":"2023-05-15T16:40:00.739275+0000","last_became_peered":"2023-05-15T16:40:00.739275+0000","last_unstale":"2023-05-15T16:40:02.097310+0000","last_undegraded":"2023-05-15T16:40:02.097310+0000","last_fullsized":"2023-05-15T16:40:02.097310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:05.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098022+0000","last_change":"2023-05-15T16:40:01.113172+0000","last_active":"2023-05-15T16:40:02.098022+0000","last_peered":"2023-05-15T16:40:02.098022+0000","last_clean":"2023-05-15T16:40:02.098022+0000","last_became_active":"2023-05-15T16:40:01.112870+0000","last_became_peered":"2023-05-15T16:40:01.112870+0000","last_unstale":"2023-05-15T16:40:02.098022+0000","last_undegraded":"2023-05-15T16:40:02.098022+0000","last_fullsized":"2023-05-15T16:40:02.098022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281420+0000","last_change":"2023-05-15T16:40:00.762606+0000","last_active":"2023-05-15T16:40:02.281420+0000","last_peered":"2023-05-15T16:40:02.281420+0000","last_clean":"2023-05-15T16:40:02.281420+0000","last_became_active":"2023-05-15T16:40:00.761988+0000","last_became_peered":"2023-05-15T16:40:00.761988+0000","last_unstale":"2023-05-15T16:40:02.281420+0000","last_undegraded":"2023-05-15T16:40:02.281420+0000","last_fullsized":"2023-05-15T16:40:02.281420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:45:32.571235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095959+0000","last_change":"2023-05-15T16:40:01.147086+0000","last_active":"2023-05-15T16:40:02.095959+0000","last_peered":"2023-05-15T16:40:02.095959+0000","last_clean":"2023-05-15T16:40:02.095959+0000","last_became_active":"2023-05-15T16:40:01.146808+0000","last_became_peered":"2023-05-15T16:40:01.146808+0000","last_unstale":"2023-05-15T16:40:02.095959+0000","last_undegraded":"2023-05-15T16:40:02.095959+0000","last_fullsized":"2023-05-15T16:40:02.095959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280054+0000","last_change":"2023-05-15T16:40:00.730676+0000","last_active":"2023-05-15T16:40:02.280054+0000","last_peered":"2023-05-15T16:40:02.280054+0000","last_clean":"2023-05-15T16:40:02.280054+0000","last_became_active":"2023-05-15T16:40:00.729878+0000","last_became_peered":"2023-05-15T16:40:00.729878+0000","last_unstale":"2023-05-15T16:40:02.280054+0000","last_undegraded":"2023-05-15T16:40:02.280054+0000","last_fullsized":"2023-05-15T16:40:02.280054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:11:08.088281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282241+0000","last_change":"2023-05-15T16:40:00.758036+0000","last_active":"2023-05-15T16:40:02.282241+0000","last_peered":"2023-05-15T16:40:02.282241+0000","last_clean":"2023-05-15T16:40:02.282241+0000","last_became_active":"2023-05-15T16:40:00.757440+0000","last_became_peered":"2023-05-15T16:40:00.757440+0000","last_unstale":"2023-05-15T16:40:02.282241+0000","last_undegraded":"2023-05-15T16:40:02.282241+0000","last_fullsized":"2023-05-15T16:40:02.282241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:39:14.804346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282268+0000","last_change":"2023-05-15T16:40:01.160001+0000","last_active":"2023-05-15T16:40:02.282268+0000","last_peered":"2023-05-15T16:40:02.282268+0000","last_clean":"2023-05-15T16:40:02.282268+0000","last_became_active":"2023-05-15T16:40:01.159447+0000","last_became_peered":"2023-05-15T16:40:01.159447+0000","last_unstale":"2023-05-15T16:40:02.282268+0000","last_undegraded":"2023-05-15T16:40:02.282268+0000","last_fullsized":"2023-05-15T16:40:02.282268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:26:45.774263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282224+0000","last_change":"2023-05-15T16:40:00.762701+0000","last_active":"2023-05-15T16:40:02.282224+0000","last_peered":"2023-05-15T16:40:02.282224+0000","last_clean":"2023-05-15T16:40:02.282224+0000","last_became_active":"2023-05-15T16:40:00.762050+0000","last_became_peered":"2023-05-15T16:40:00.762050+0000","last_unstale":"2023-05-15T16:40:02.282224+0000","last_undegraded":"2023-05-15T16:40:02.282224+0000","last_fullsized":"2023-05-15T16:40:02.282224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:00:39.077549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099635+0000","last_change":"2023-05-15T16:40:01.141928+0000","last_active":"2023-05-15T16:40:02.099635+0000","last_peered":"2023-05-15T16:40:02.099635+0000","last_clean":"2023-05-15T16:40:02.099635+0000","last_became_active":"2023-05-15T16:40:01.135581+0000","last_became_peered":"2023-05-15T16:40:01.135581+0000","last_unstale":"2023-05-15T16:40:02.099635+0000","last_undegraded":"2023-05-15T16:40:02.099635+0000","last_fullsized":"2023-05-15T16:40:02.099635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:50:32.789209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281732+0000","last_change":"2023-05-15T16:40:00.760061+0000","last_active":"2023-05-15T16:40:02.281732+0000","last_peered":"2023-05-15T16:40:02.281732+0000","last_clean":"2023-05-15T16:40:02.281732+0000","last_became_active":"2023-05-15T16:40:00.759394+0000","last_became_peered":"2023-05-15T16:40:00.759394+0000","last_unstale":"2023-05-15T16:40:02.281732+0000","last_undegraded":"2023-05-15T16:40:02.281732+0000","last_fullsized":"2023-05-15T16:40:02.281732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:51:42.381804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280016+0000","last_change":"2023-05-15T16:40:01.124789+0000","last_active":"2023-05-15T16:40:02.280016+0000","last_peered":"2023-05-15T16:40:02.280016+0000","last_clean":"2023-05-15T16:40:02.280016+0000","last_became_active":"2023-05-15T16:40:01.123158+0000","last_became_peered":"2023-05-15T16:40:01.123158+0000","last_unstale":"2023-05-15T16:40:02.280016+0000","last_undegraded":"2023-05-15T16:40:02.280016+0000","last_fullsized":"2023-05-15T16:40:02.280016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:00:40.087052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282519+0000","last_change":"2023-05-15T16:40:00.754578+0000","last_active":"2023-05-15T16:40:02.282519+0000","last_peered":"2023-05-15T16:40:02.282519+0000","last_clean":"2023-05-15T16:40:02.282519+0000","last_became_active":"2023-05-15T16:40:00.753829+0000","last_became_peered":"2023-05-15T16:40:00.753829+0000","last_unstale":"2023-05-15T16:40:02.282519+0000","last_undegraded":"2023-05-15T16:40:02.282519+0000","last_fullsized":"2023-05-15T16:40:02.282519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097589+0000","last_change":"2023-05-15T16:40:01.111444+0000","last_active":"2023-05-15T16:40:02.097589+0000","last_peered":"2023-05-15T16:40:02.097589+0000","last_clean":"2023-05-15T16:40:02.097589+0000","last_became_active":"2023-05-15T16:40:01.108848+0000","last_became_peered":"2023-05-15T16:40:01.108848+0000","last_unstale":"2023-05-15T16:40:02.097589+0000","last_undegraded":"2023-05-15T16:40:02.097589+0000","last_fullsized":"2023-05-15T16:40:02.097589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:26:45.774263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095431+0000","last_change":"2023-05-15T16:40:00.740949+0000","last_active":"2023-05-15T16:40:02.095431+0000","last_peered":"2023-05-15T16:40:02.095431+0000","last_clean":"2023-05-15T16:40:02.095431+0000","last_became_active":"2023-05-15T16:40:00.739009+0000","last_became_peered":"2023-05-15T16:40:00.739009+0000","last_unstale":"2023-05-15T16:40:02.095431+0000","last_undegraded":"2023-05-15T16:40:02.095431+0000","last_fullsized":"2023-05-15T16:40:02.095431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:14:54.500421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100640+0000","last_change":"2023-05-15T16:40:01.140770+0000","last_active":"2023-05-15T16:40:02.100640+0000","last_peered":"2023-05-15T16:40:02.100640+0000","last_clean":"2023-05-15T16:40:02.100640+0000","last_became_active":"2023-05-15T16:40:01.138754+0000","last_became_peered":"2023-05-15T16:40:01.138754+0000","last_unstale":"2023-05-15T16:40:02.100640+0000","last_undegraded":"2023-05-15T16:40:02.100640+0000","last_fullsized":"2023-05-15T16:40:02.100640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:02:15.760757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280274+0000","last_change":"2023-05-15T16:40:00.749907+0000","last_active":"2023-05-15T16:40:02.280274+0000","last_peered":"2023-05-15T16:40:02.280274+0000","last_clean":"2023-05-15T16:40:02.280274+0000","last_became_active":"2023-05-15T16:40:00.749282+0000","last_became_peered":"2023-05-15T16:40:00.749282+0000","last_unstale":"2023-05-15T16:40:02.280274+0000","last_undegraded":"2023-05-15T16:40:02.280274+0000","last_fullsized":"2023-05-15T16:40:02.280274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:14:54.500421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100813+0000","last_change":"2023-05-15T16:40:01.139858+0000","last_active":"2023-05-15T16:40:02.100813+0000","last_peered":"2023-05-15T16:40:02.100813+0000","last_clean":"2023-05-15T16:40:02.100813+0000","last_became_active":"2023-05-15T16:40:01.136069+0000","last_became_peered":"2023-05-15T16:40:01.136069+0000","last_unstale":"2023-05-15T16:40:02.100813+0000","last_undegraded":"2023-05-15T16:40:02.100813+0000","last_fullsized":"2023-05-15T16:40:02.100813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:05:11.188290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099660+0000","last_change":"2023-05-15T16:40:00.749474+0000","last_active":"2023-05-15T16:40:02.099660+0000","last_peered":"2023-05-15T16:40:02.099660+0000","last_clean":"2023-05-15T16:40:02.099660+0000","last_became_active":"2023-05-15T16:40:00.748842+0000","last_became_peered":"2023-05-15T16:40:00.748842+0000","last_unstale":"2023-05-15T16:40:02.099660+0000","last_undegraded":"2023-05-15T16:40:02.099660+0000","last_fullsized":"2023-05-15T16:40:02.099660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:56:52.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100423+0000","last_change":"2023-05-15T16:40:01.138792+0000","last_active":"2023-05-15T16:40:02.100423+0000","last_peered":"2023-05-15T16:40:02.100423+0000","last_clean":"2023-05-15T16:40:02.100423+0000","last_became_active":"2023-05-15T16:40:01.137792+0000","last_became_peered":"2023-05-15T16:40:01.137792+0000","last_unstale":"2023-05-15T16:40:02.100423+0000","last_undegraded":"2023-05-15T16:40:02.100423+0000","last_fullsized":"2023-05-15T16:40:02.100423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095575+0000","last_change":"2023-05-15T16:40:00.735846+0000","last_active":"2023-05-15T16:40:02.095575+0000","last_peered":"2023-05-15T16:40:02.095575+0000","last_clean":"2023-05-15T16:40:02.095575+0000","last_became_active":"2023-05-15T16:40:00.734223+0000","last_became_peered":"2023-05-15T16:40:00.734223+0000","last_unstale":"2023-05-15T16:40:02.095575+0000","last_undegraded":"2023-05-15T16:40:02.095575+0000","last_fullsized":"2023-05-15T16:40:02.095575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:05.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279676+0000","last_change":"2023-05-15T16:40:01.106280+0000","last_active":"2023-05-15T16:40:02.279676+0000","last_peered":"2023-05-15T16:40:02.279676+0000","last_clean":"2023-05-15T16:40:02.279676+0000","last_became_active":"2023-05-15T16:40:01.105962+0000","last_became_peered":"2023-05-15T16:40:01.105962+0000","last_unstale":"2023-05-15T16:40:02.279676+0000","last_undegraded":"2023-05-15T16:40:02.279676+0000","last_fullsized":"2023-05-15T16:40:02.279676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:24:01.307491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.125777+0000","last_change":"2023-05-15T16:39:50.637320+0000","last_active":"2023-05-15T16:40:01.125777+0000","last_peered":"2023-05-15T16:40:01.125777+0000","last_clean":"2023-05-15T16:40:01.125777+0000","last_became_active":"2023-05-15T16:39:50.636541+0000","last_became_peered":"2023-05-15T16:39:50.636541+0000","last_unstale":"2023-05-15T16:40:01.125777+0000","last_undegraded":"2023-05-15T16:40:01.125777+0000","last_fullsized":"2023-05-15T16:40:01.125777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:49.601783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:49.601783+0000","last_clean_scrub_stamp":"2023-05-15T16:39:49.601783+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:18:01.941203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.156165+0000","last_change":"2023-05-15T16:39:56.699270+0000","last_active":"2023-05-15T16:40:01.156165+0000","last_peered":"2023-05-15T16:40:01.156165+0000","last_clean":"2023-05-15T16:40:01.156165+0000","last_became_active":"2023-05-15T16:39:56.698429+0000","last_became_peered":"2023-05-15T16:39:56.698429+0000","last_unstale":"2023-05-15T16:40:01.156165+0000","last_undegraded":"2023-05-15T16:40:01.156165+0000","last_fullsized":"2023-05-15T16:40:01.156165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:31.428692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095161+0000","last_change":"2023-05-15T16:40:00.753212+0000","last_active":"2023-05-15T16:40:02.095161+0000","last_peered":"2023-05-15T16:40:02.095161+0000","last_clean":"2023-05-15T16:40:02.095161+0000","last_became_active":"2023-05-15T16:40:00.752900+0000","last_became_peered":"2023-05-15T16:40:00.752900+0000","last_unstale":"2023-05-15T16:40:02.095161+0000","last_undegraded":"2023-05-15T16:40:02.095161+0000","last_fullsized":"2023-05-15T16:40:02.095161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:30:28.823039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280571+0000","last_change":"2023-05-15T16:40:01.148321+0000","last_active":"2023-05-15T16:40:02.280571+0000","last_peered":"2023-05-15T16:40:02.280571+0000","last_clean":"2023-05-15T16:40:02.280571+0000","last_became_active":"2023-05-15T16:40:01.147687+0000","last_became_peered":"2023-05-15T16:40:01.147687+0000","last_unstale":"2023-05-15T16:40:02.280571+0000","last_undegraded":"2023-05-15T16:40:02.280571+0000","last_fullsized":"2023-05-15T16:40:02.280571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:51:43.391307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.125606+0000","last_change":"2023-05-15T16:39:56.700800+0000","last_active":"2023-05-15T16:40:01.125606+0000","last_peered":"2023-05-15T16:40:01.125606+0000","last_clean":"2023-05-15T16:40:01.125606+0000","last_became_active":"2023-05-15T16:39:56.700022+0000","last_became_peered":"2023-05-15T16:39:56.700022+0000","last_unstale":"2023-05-15T16:40:01.125606+0000","last_undegraded":"2023-05-15T16:40:01.125606+0000","last_fullsized":"2023-05-15T16:40:01.125606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:11:54.752932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097131+0000","last_change":"2023-05-15T16:40:00.762802+0000","last_active":"2023-05-15T16:40:02.097131+0000","last_peered":"2023-05-15T16:40:02.097131+0000","last_clean":"2023-05-15T16:40:02.097131+0000","last_became_active":"2023-05-15T16:40:00.762564+0000","last_became_peered":"2023-05-15T16:40:00.762564+0000","last_unstale":"2023-05-15T16:40:02.097131+0000","last_undegraded":"2023-05-15T16:40:02.097131+0000","last_fullsized":"2023-05-15T16:40:02.097131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:21:29.173379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097918+0000","last_change":"2023-05-15T16:40:01.111468+0000","last_active":"2023-05-15T16:40:02.097918+0000","last_peered":"2023-05-15T16:40:02.097918+0000","last_clean":"2023-05-15T16:40:02.097918+0000","last_became_active":"2023-05-15T16:40:01.108705+0000","last_became_peered":"2023-05-15T16:40:01.108705+0000","last_unstale":"2023-05-15T16:40:02.097918+0000","last_undegraded":"2023-05-15T16:40:02.097918+0000","last_fullsized":"2023-05-15T16:40:02.097918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:24:01.307491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.091019+0000","last_change":"2023-05-15T16:39:57.018815+0000","last_active":"2023-05-15T16:40:01.091019+0000","last_peered":"2023-05-15T16:40:01.091019+0000","last_clean":"2023-05-15T16:40:01.091019+0000","last_became_active":"2023-05-15T16:39:57.018404+0000","last_became_peered":"2023-05-15T16:39:57.018404+0000","last_unstale":"2023-05-15T16:40:01.091019+0000","last_undegraded":"2023-05-15T16:40:01.091019+0000","last_fullsized":"2023-05-15T16:40:01.091019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278644+0000","last_change":"2023-05-15T16:40:00.732605+0000","last_active":"2023-05-15T16:40:02.278644+0000","last_peered":"2023-05-15T16:40:02.278644+0000","last_clean":"2023-05-15T16:40:02.278644+0000","last_became_active":"2023-05-15T16:40:00.731996+0000","last_became_peered":"2023-05-15T16:40:00.731996+0000","last_unstale":"2023-05-15T16:40:02.278644+0000","last_undegraded":"2023-05-15T16:40:02.278644+0000","last_fullsized":"2023-05-15T16:40:02.278644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:30:28.823039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280039+0000","last_change":"2023-05-15T16:40:01.158076+0000","last_active":"2023-05-15T16:40:02.280039+0000","last_peered":"2023-05-15T16:40:02.280039+0000","last_clean":"2023-05-15T16:40:02.280039+0000","last_became_active":"2023-05-15T16:40:01.157836+0000","last_became_peered":"2023-05-15T16:40:01.157836+0000","last_unstale":"2023-05-15T16:40:02.280039+0000","last_undegraded":"2023-05-15T16:40:02.280039+0000","last_fullsized":"2023-05-15T16:40:02.280039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:26:45.774263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.156363+0000","last_change":"2023-05-15T16:39:56.701269+0000","last_active":"2023-05-15T16:40:01.156363+0000","last_peered":"2023-05-15T16:40:01.156363+0000","last_clean":"2023-05-15T16:40:01.156363+0000","last_became_active":"2023-05-15T16:39:56.700221+0000","last_became_peered":"2023-05-15T16:39:56.700221+0000","last_unstale":"2023-05-15T16:40:01.156363+0000","last_undegraded":"2023-05-15T16:40:01.156363+0000","last_fullsized":"2023-05-15T16:40:01.156363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099905+0000","last_change":"2023-05-15T16:40:00.749117+0000","last_active":"2023-05-15T16:40:02.099905+0000","last_peered":"2023-05-15T16:40:02.099905+0000","last_clean":"2023-05-15T16:40:02.099905+0000","last_became_active":"2023-05-15T16:40:00.748493+0000","last_became_peered":"2023-05-15T16:40:00.748493+0000","last_unstale":"2023-05-15T16:40:02.099905+0000","last_undegraded":"2023-05-15T16:40:02.099905+0000","last_fullsized":"2023-05-15T16:40:02.099905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279394+0000","last_change":"2023-05-15T16:40:01.108032+0000","last_active":"2023-05-15T16:40:02.279394+0000","last_peered":"2023-05-15T16:40:02.279394+0000","last_clean":"2023-05-15T16:40:02.279394+0000","last_became_active":"2023-05-15T16:40:01.107664+0000","last_became_peered":"2023-05-15T16:40:01.107664+0000","last_unstale":"2023-05-15T16:40:02.279394+0000","last_undegraded":"2023-05-15T16:40:02.279394+0000","last_fullsized":"2023-05-15T16:40:02.279394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:31:14.621756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.283078+0000","last_change":"2023-05-15T16:40:00.756830+0000","last_active":"2023-05-15T16:40:02.283078+0000","last_peered":"2023-05-15T16:40:02.283078+0000","last_clean":"2023-05-15T16:40:02.283078+0000","last_became_active":"2023-05-15T16:40:00.755791+0000","last_became_peered":"2023-05-15T16:40:00.755791+0000","last_unstale":"2023-05-15T16:40:02.283078+0000","last_undegraded":"2023-05-15T16:40:02.283078+0000","last_fullsized":"2023-05-15T16:40:02.283078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:21:29.173379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.101846+0000","last_change":"2023-05-15T16:39:56.692931+0000","last_active":"2023-05-15T16:40:01.101846+0000","last_peered":"2023-05-15T16:40:01.101846+0000","last_clean":"2023-05-15T16:40:01.101846+0000","last_became_active":"2023-05-15T16:39:56.692557+0000","last_became_peered":"2023-05-15T16:39:56.692557+0000","last_unstale":"2023-05-15T16:40:01.101846+0000","last_undegraded":"2023-05-15T16:40:01.101846+0000","last_fullsized":"2023-05-15T16:40:01.101846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279898+0000","last_change":"2023-05-15T16:40:01.143115+0000","last_active":"2023-05-15T16:40:02.279898+0000","last_peered":"2023-05-15T16:40:02.279898+0000","last_clean":"2023-05-15T16:40:02.279898+0000","last_became_active":"2023-05-15T16:40:01.142777+0000","last_became_peered":"2023-05-15T16:40:01.142777+0000","last_unstale":"2023-05-15T16:40:02.279898+0000","last_undegraded":"2023-05-15T16:40:02.279898+0000","last_fullsized":"2023-05-15T16:40:02.279898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279615+0000","last_change":"2023-05-15T16:40:00.732385+0000","last_active":"2023-05-15T16:40:02.279615+0000","last_peered":"2023-05-15T16:40:02.279615+0000","last_clean":"2023-05-15T16:40:02.279615+0000","last_became_active":"2023-05-15T16:40:00.731887+0000","last_became_peered":"2023-05-15T16:40:00.731887+0000","last_unstale":"2023-05-15T16:40:02.279615+0000","last_undegraded":"2023-05-15T16:40:02.279615+0000","last_fullsized":"2023-05-15T16:40:02.279615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.129045+0000","last_change":"2023-05-15T16:39:56.698079+0000","last_active":"2023-05-15T16:40:01.129045+0000","last_peered":"2023-05-15T16:40:01.129045+0000","last_clean":"2023-05-15T16:40:01.129045+0000","last_became_active":"2023-05-15T16:39:56.697298+0000","last_became_peered":"2023-05-15T16:39:56.697298+0000","last_unstale":"2023-05-15T16:40:01.129045+0000","last_undegraded":"2023-05-15T16:40:01.129045+0000","last_fullsized":"2023-05-15T16:40:01.129045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:32:01.734351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097558+0000","last_change":"2023-05-15T16:40:01.144386+0000","last_active":"2023-05-15T16:40:02.097558+0000","last_peered":"2023-05-15T16:40:02.097558+0000","last_clean":"2023-05-15T16:40:02.097558+0000","last_became_active":"2023-05-15T16:40:01.144046+0000","last_became_peered":"2023-05-15T16:40:01.144046+0000","last_unstale":"2023-05-15T16:40:02.097558+0000","last_undegraded":"2023-05-15T16:40:02.097558+0000","last_fullsized":"2023-05-15T16:40:02.097558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:50:32.789209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.096140+0000","last_change":"2023-05-15T16:40:00.740983+0000","last_active":"2023-05-15T16:40:02.096140+0000","last_peered":"2023-05-15T16:40:02.096140+0000","last_clean":"2023-05-15T16:40:02.096140+0000","last_became_active":"2023-05-15T16:40:00.739828+0000","last_became_peered":"2023-05-15T16:40:00.739828+0000","last_unstale":"2023-05-15T16:40:02.096140+0000","last_undegraded":"2023-05-15T16:40:02.096140+0000","last_fullsized":"2023-05-15T16:40:02.096140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.101796+0000","last_change":"2023-05-15T16:39:56.694298+0000","last_active":"2023-05-15T16:40:01.101796+0000","last_peered":"2023-05-15T16:40:01.101796+0000","last_clean":"2023-05-15T16:40:01.101796+0000","last_became_active":"2023-05-15T16:39:56.693723+0000","last_became_peered":"2023-05-15T16:39:56.693723+0000","last_unstale":"2023-05-15T16:40:01.101796+0000","last_undegraded":"2023-05-15T16:40:01.101796+0000","last_fullsized":"2023-05-15T16:40:01.101796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:31.428692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095317+0000","last_change":"2023-05-15T16:40:01.125833+0000","last_active":"2023-05-15T16:40:02.095317+0000","last_peered":"2023-05-15T16:40:02.095317+0000","last_clean":"2023-05-15T16:40:02.095317+0000","last_became_active":"2023-05-15T16:40:01.125641+0000","last_became_peered":"2023-05-15T16:40:01.125641+0000","last_unstale":"2023-05-15T16:40:02.095317+0000","last_undegraded":"2023-05-15T16:40:02.095317+0000","last_fullsized":"2023-05-15T16:40:02.095317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:48:42.521388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098109+0000","last_change":"2023-05-15T16:40:00.729163+0000","last_active":"2023-05-15T16:40:02.098109+0000","last_peered":"2023-05-15T16:40:02.098109+0000","last_clean":"2023-05-15T16:40:02.098109+0000","last_became_active":"2023-05-15T16:40:00.725627+0000","last_became_peered":"2023-05-15T16:40:00.725627+0000","last_unstale":"2023-05-15T16:40:02.098109+0000","last_undegraded":"2023-05-15T16:40:02.098109+0000","last_fullsized":"2023-05-15T16:40:02.098109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.115241+0000","last_change":"2023-05-15T16:39:56.697003+0000","last_active":"2023-05-15T16:40:01.115241+0000","last_peered":"2023-05-15T16:40:01.115241+0000","last_clean":"2023-05-15T16:40:01.115241+0000","last_became_active":"2023-05-15T16:39:56.696210+0000","last_became_peered":"2023-05-15T16:39:56.696210+0000","last_unstale":"2023-05-15T16:40:01.115241+0000","last_undegraded":"2023-05-15T16:40:01.115241+0000","last_fullsized":"2023-05-15T16:40:01.115241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:29:27.454964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099418+0000","last_change":"2023-05-15T16:40:01.146590+0000","last_active":"2023-05-15T16:40:02.099418+0000","last_peered":"2023-05-15T16:40:02.099418+0000","last_clean":"2023-05-15T16:40:02.099418+0000","last_became_active":"2023-05-15T16:40:01.145902+0000","last_became_peered":"2023-05-15T16:40:01.145902+0000","last_unstale":"2023-05-15T16:40:02.099418+0000","last_undegraded":"2023-05-15T16:40:02.099418+0000","last_fullsized":"2023-05-15T16:40:02.099418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:26:42.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099663+0000","last_change":"2023-05-15T16:40:01.137328+0000","last_active":"2023-05-15T16:40:02.099663+0000","last_peered":"2023-05-15T16:40:02.099663+0000","last_clean":"2023-05-15T16:40:02.099663+0000","last_became_active":"2023-05-15T16:40:01.135859+0000","last_became_peered":"2023-05-15T16:40:01.135859+0000","last_unstale":"2023-05-15T16:40:02.099663+0000","last_undegraded":"2023-05-15T16:40:02.099663+0000","last_fullsized":"2023-05-15T16:40:02.099663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:22:08.631817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100701+0000","last_change":"2023-05-15T16:40:00.741443+0000","last_active":"2023-05-15T16:40:02.100701+0000","last_peered":"2023-05-15T16:40:02.100701+0000","last_clean":"2023-05-15T16:40:02.100701+0000","last_became_active":"2023-05-15T16:40:00.737218+0000","last_became_peered":"2023-05-15T16:40:00.737218+0000","last_unstale":"2023-05-15T16:40:02.100701+0000","last_undegraded":"2023-05-15T16:40:02.100701+0000","last_fullsized":"2023-05-15T16:40:02.100701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:05.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279727+0000","last_change":"2023-05-15T16:40:01.119384+0000","last_active":"2023-05-15T16:40:02.279727+0000","last_peered":"2023-05-15T16:40:02.279727+0000","last_clean":"2023-05-15T16:40:02.279727+0000","last_became_active":"2023-05-15T16:40:01.119075+0000","last_became_peered":"2023-05-15T16:40:01.119075+0000","last_unstale":"2023-05-15T16:40:02.279727+0000","last_undegraded":"2023-05-15T16:40:02.279727+0000","last_fullsized":"2023-05-15T16:40:02.279727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:29:25.132530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281736+0000","last_change":"2023-05-15T16:40:00.744828+0000","last_active":"2023-05-15T16:40:02.281736+0000","last_peered":"2023-05-15T16:40:02.281736+0000","last_clean":"2023-05-15T16:40:02.281736+0000","last_became_active":"2023-05-15T16:40:00.744103+0000","last_became_peered":"2023-05-15T16:40:00.744103+0000","last_unstale":"2023-05-15T16:40:02.281736+0000","last_undegraded":"2023-05-15T16:40:02.281736+0000","last_fullsized":"2023-05-15T16:40:02.281736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:19:48.425765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282856+0000","last_change":"2023-05-15T16:40:00.754697+0000","last_active":"2023-05-15T16:40:02.282856+0000","last_peered":"2023-05-15T16:40:02.282856+0000","last_clean":"2023-05-15T16:40:02.282856+0000","last_became_active":"2023-05-15T16:40:00.754117+0000","last_became_peered":"2023-05-15T16:40:00.754117+0000","last_unstale":"2023-05-15T16:40:02.282856+0000","last_undegraded":"2023-05-15T16:40:02.282856+0000","last_fullsized":"2023-05-15T16:40:02.282856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:05.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095638+0000","last_change":"2023-05-15T16:40:01.148027+0000","last_active":"2023-05-15T16:40:02.095638+0000","last_peered":"2023-05-15T16:40:02.095638+0000","last_clean":"2023-05-15T16:40:02.095638+0000","last_became_active":"2023-05-15T16:40:01.147699+0000","last_became_peered":"2023-05-15T16:40:01.147699+0000","last_unstale":"2023-05-15T16:40:02.095638+0000","last_undegraded":"2023-05-15T16:40:02.095638+0000","last_fullsized":"2023-05-15T16:40:02.095638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:50:32.789209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098446+0000","last_change":"2023-05-15T16:40:00.753008+0000","last_active":"2023-05-15T16:40:02.098446+0000","last_peered":"2023-05-15T16:40:02.098446+0000","last_clean":"2023-05-15T16:40:02.098446+0000","last_became_active":"2023-05-15T16:40:00.752696+0000","last_became_peered":"2023-05-15T16:40:00.752696+0000","last_unstale":"2023-05-15T16:40:02.098446+0000","last_undegraded":"2023-05-15T16:40:02.098446+0000","last_fullsized":"2023-05-15T16:40:02.098446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:30:28.823039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095101+0000","last_change":"2023-05-15T16:40:01.102001+0000","last_active":"2023-05-15T16:40:02.095101+0000","last_peered":"2023-05-15T16:40:02.095101+0000","last_clean":"2023-05-15T16:40:02.095101+0000","last_became_active":"2023-05-15T16:40:01.101708+0000","last_became_peered":"2023-05-15T16:40:01.101708+0000","last_unstale":"2023-05-15T16:40:02.095101+0000","last_undegraded":"2023-05-15T16:40:02.095101+0000","last_fullsized":"2023-05-15T16:40:02.095101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:13:33.110131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280831+0000","last_change":"2023-05-15T16:40:01.161461+0000","last_active":"2023-05-15T16:40:02.280831+0000","last_peered":"2023-05-15T16:40:02.280831+0000","last_clean":"2023-05-15T16:40:02.280831+0000","last_became_active":"2023-05-15T16:40:01.160945+0000","last_became_peered":"2023-05-15T16:40:01.160945+0000","last_unstale":"2023-05-15T16:40:02.280831+0000","last_undegraded":"2023-05-15T16:40:02.280831+0000","last_fullsized":"2023-05-15T16:40:02.280831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:39:15.813849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095333+0000","last_change":"2023-05-15T16:40:00.740953+0000","last_active":"2023-05-15T16:40:02.095333+0000","last_peered":"2023-05-15T16:40:02.095333+0000","last_clean":"2023-05-15T16:40:02.095333+0000","last_became_active":"2023-05-15T16:40:00.739500+0000","last_became_peered":"2023-05-15T16:40:00.739500+0000","last_unstale":"2023-05-15T16:40:02.095333+0000","last_undegraded":"2023-05-15T16:40:02.095333+0000","last_fullsized":"2023-05-15T16:40:02.095333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:56:52.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097941+0000","last_change":"2023-05-15T16:40:01.147295+0000","last_active":"2023-05-15T16:40:02.097941+0000","last_peered":"2023-05-15T16:40:02.097941+0000","last_clean":"2023-05-15T16:40:02.097941+0000","last_became_active":"2023-05-15T16:40:01.146994+0000","last_became_peered":"2023-05-15T16:40:01.146994+0000","last_unstale":"2023-05-15T16:40:02.097941+0000","last_undegraded":"2023-05-15T16:40:02.097941+0000","last_fullsized":"2023-05-15T16:40:02.097941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:13:33.110131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279178+0000","last_change":"2023-05-15T16:40:00.733783+0000","last_active":"2023-05-15T16:40:02.279178+0000","last_peered":"2023-05-15T16:40:02.279178+0000","last_clean":"2023-05-15T16:40:02.279178+0000","last_became_active":"2023-05-15T16:40:00.733442+0000","last_became_peered":"2023-05-15T16:40:00.733442+0000","last_unstale":"2023-05-15T16:40:02.279178+0000","last_undegraded":"2023-05-15T16:40:02.279178+0000","last_fullsized":"2023-05-15T16:40:02.279178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:56:52.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095487+0000","last_change":"2023-05-15T16:40:01.108561+0000","last_active":"2023-05-15T16:40:02.095487+0000","last_peered":"2023-05-15T16:40:02.095487+0000","last_clean":"2023-05-15T16:40:02.095487+0000","last_became_active":"2023-05-15T16:40:01.108286+0000","last_became_peered":"2023-05-15T16:40:01.108286+0000","last_unstale":"2023-05-15T16:40:02.095487+0000","last_undegraded":"2023-05-15T16:40:02.095487+0000","last_fullsized":"2023-05-15T16:40:02.095487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:07:25.649507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099944+0000","last_change":"2023-05-15T16:40:00.748959+0000","last_active":"2023-05-15T16:40:02.099944+0000","last_peered":"2023-05-15T16:40:02.099944+0000","last_clean":"2023-05-15T16:40:02.099944+0000","last_became_active":"2023-05-15T16:40:00.744181+0000","last_became_peered":"2023-05-15T16:40:00.744181+0000","last_unstale":"2023-05-15T16:40:02.099944+0000","last_undegraded":"2023-05-15T16:40:02.099944+0000","last_fullsized":"2023-05-15T16:40:02.099944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:30:28.823039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278386+0000","last_change":"2023-05-15T16:40:01.111006+0000","last_active":"2023-05-15T16:40:02.278386+0000","last_peered":"2023-05-15T16:40:02.278386+0000","last_clean":"2023-05-15T16:40:02.278386+0000","last_became_active":"2023-05-15T16:40:01.110731+0000","last_became_peered":"2023-05-15T16:40:01.110731+0000","last_unstale":"2023-05-15T16:40:02.278386+0000","last_undegraded":"2023-05-15T16:40:02.278386+0000","last_fullsized":"2023-05-15T16:40:02.278386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:21:30.182882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097788+0000","last_change":"2023-05-15T16:40:00.760933+0000","last_active":"2023-05-15T16:40:02.097788+0000","last_peered":"2023-05-15T16:40:02.097788+0000","last_clean":"2023-05-15T16:40:02.097788+0000","last_became_active":"2023-05-15T16:40:00.760570+0000","last_became_peered":"2023-05-15T16:40:00.760570+0000","last_unstale":"2023-05-15T16:40:02.097788+0000","last_undegraded":"2023-05-15T16:40:02.097788+0000","last_fullsized":"2023-05-15T16:40:02.097788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:51:41.940063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099449+0000","last_change":"2023-05-15T16:40:01.137937+0000","last_active":"2023-05-15T16:40:02.099449+0000","last_peered":"2023-05-15T16:40:02.099449+0000","last_clean":"2023-05-15T16:40:02.099449+0000","last_became_active":"2023-05-15T16:40:01.136661+0000","last_became_peered":"2023-05-15T16:40:01.136661+0000","last_unstale":"2023-05-15T16:40:02.099449+0000","last_undegraded":"2023-05-15T16:40:02.099449+0000","last_fullsized":"2023-05-15T16:40:02.099449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:45:23.112789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282296+0000","last_change":"2023-05-15T16:40:00.765428+0000","last_active":"2023-05-15T16:40:02.282296+0000","last_peered":"2023-05-15T16:40:02.282296+0000","last_clean":"2023-05-15T16:40:02.282296+0000","last_became_active":"2023-05-15T16:40:00.764846+0000","last_became_peered":"2023-05-15T16:40:00.764846+0000","last_unstale":"2023-05-15T16:40:02.282296+0000","last_undegraded":"2023-05-15T16:40:02.282296+0000","last_fullsized":"2023-05-15T16:40:02.282296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:56:13.804754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099659+0000","last_change":"2023-05-15T16:40:01.138011+0000","last_active":"2023-05-15T16:40:02.099659+0000","last_peered":"2023-05-15T16:40:02.099659+0000","last_clean":"2023-05-15T16:40:02.099659+0000","last_became_active":"2023-05-15T16:40:01.136847+0000","last_became_peered":"2023-05-15T16:40:01.136847+0000","last_unstale":"2023-05-15T16:40:02.099659+0000","last_undegraded":"2023-05-15T16:40:02.099659+0000","last_fullsized":"2023-05-15T16:40:02.099659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:14:14.713803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282986+0000","last_change":"2023-05-15T16:40:00.765361+0000","last_active":"2023-05-15T16:40:02.282986+0000","last_peered":"2023-05-15T16:40:02.282986+0000","last_clean":"2023-05-15T16:40:02.282986+0000","last_became_active":"2023-05-15T16:40:00.764881+0000","last_became_peered":"2023-05-15T16:40:00.764881+0000","last_unstale":"2023-05-15T16:40:02.282986+0000","last_undegraded":"2023-05-15T16:40:02.282986+0000","last_fullsized":"2023-05-15T16:40:02.282986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:51:41.940063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095732+0000","last_change":"2023-05-15T16:40:01.102202+0000","last_active":"2023-05-15T16:40:02.095732+0000","last_peered":"2023-05-15T16:40:02.095732+0000","last_clean":"2023-05-15T16:40:02.095732+0000","last_became_active":"2023-05-15T16:40:01.101916+0000","last_became_peered":"2023-05-15T16:40:01.101916+0000","last_unstale":"2023-05-15T16:40:02.095732+0000","last_undegraded":"2023-05-15T16:40:02.095732+0000","last_fullsized":"2023-05-15T16:40:02.095732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:26:45.774263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095575+0000","last_change":"2023-05-15T16:40:00.736792+0000","last_active":"2023-05-15T16:40:02.095575+0000","last_peered":"2023-05-15T16:40:02.095575+0000","last_clean":"2023-05-15T16:40:02.095575+0000","last_became_active":"2023-05-15T16:40:00.736507+0000","last_became_peered":"2023-05-15T16:40:00.736507+0000","last_unstale":"2023-05-15T16:40:02.095575+0000","last_undegraded":"2023-05-15T16:40:02.095575+0000","last_fullsized":"2023-05-15T16:40:02.095575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:21:29.173379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099100+0000","last_change":"2023-05-15T16:40:01.134199+0000","last_active":"2023-05-15T16:40:02.099100+0000","last_peered":"2023-05-15T16:40:02.099100+0000","last_clean":"2023-05-15T16:40:02.099100+0000","last_became_active":"2023-05-15T16:40:01.133481+0000","last_became_peered":"2023-05-15T16:40:01.133481+0000","last_unstale":"2023-05-15T16:40:02.099100+0000","last_undegraded":"2023-05-15T16:40:02.099100+0000","last_fullsized":"2023-05-15T16:40:02.099100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098440+0000","last_change":"2023-05-15T16:40:00.753734+0000","last_active":"2023-05-15T16:40:02.098440+0000","last_peered":"2023-05-15T16:40:02.098440+0000","last_clean":"2023-05-15T16:40:02.098440+0000","last_became_active":"2023-05-15T16:40:00.753401+0000","last_became_peered":"2023-05-15T16:40:00.753401+0000","last_unstale":"2023-05-15T16:40:02.098440+0000","last_undegraded":"2023-05-15T16:40:02.098440+0000","last_fullsized":"2023-05-15T16:40:02.098440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:56:52.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9108,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362732,"statfs":{"total":96636764160,"available":96627437568,"internally_reserved":0,"allocated":864256,"data_stored":681731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":90235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":91203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8056,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363784,"statfs":{"total":96636764160,"available":96628514816,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4870000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7924,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363916,"statfs":{"total":96636764160,"available":96628649984,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8052,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363788,"statfs":{"total":96636764160,"available":96628518912,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.1560000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.3659999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.645}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9084,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362756,"statfs":{"total":96636764160,"available":96627462144,"internally_reserved":0,"allocated":839680,"data_stored":680533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6140000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-15T16:40:09.261 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-15T16:40:09.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.391+0000 7f58ad98d640 1 Processor -- start 2023-05-15T16:40:09.397 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.391+0000 7f58ad98d640 1 -- start start 2023-05-15T16:40:09.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58ad98d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a8149df0 0x7f58a80b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:09.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58ad98d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a80b3660 con 0x7f58a8140b30 2023-05-15T16:40:09.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58ad98d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a80b7c60 con 0x7f58a8071a00 2023-05-15T16:40:09.399 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58ad98d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a80afd30 con 0x7f58a8149df0 2023-05-15T16:40:09.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a6ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f58a8140b30 0x7f58a80b3af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37802/0 (socket says 172.21.15.62:37802) 2023-05-15T16:40:09.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a6ffd640 1 -- 172.21.15.62:0/3877602609 learned_addr learned my addr 172.21.15.62:0/3877602609 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:09.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a5ffb640 1 -- 172.21.15.62:0/3877602609 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 342836000 0 0) 0x7f58a80b3660 con 0x7f58a8140b30 2023-05-15T16:40:09.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a5ffb640 1 -- 172.21.15.62:0/3877602609 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5894003530 con 0x7f58a8140b30 2023-05-15T16:40:09.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a67fc640 1 --2- 172.21.15.62:0/3877602609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a8149df0 0x7f58a80b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:09.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a5ffb640 1 -- 172.21.15.62:0/3877602609 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3232170493 0 0) 0x7f5894003530 con 0x7f58a8140b30 2023-05-15T16:40:09.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a5ffb640 1 -- 172.21.15.62:0/3877602609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a8149df0 msgr2=0x7f58a80b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:09.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a5ffb640 1 --2- 172.21.15.62:0/3877602609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a8149df0 0x7f58a80b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:09.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a5ffb640 1 -- 172.21.15.62:0/3877602609 >> v1:172.21.15.161:6789/0 conn(0x7f58a8071a00 legacy=0x7f58a80b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:09.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a5ffb640 1 -- 172.21.15.62:0/3877602609 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a80b3330 con 0x7f58a8140b30 2023-05-15T16:40:09.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a5ffb640 1 -- 172.21.15.62:0/3877602609 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7f5898001680 con 0x7f58a8140b30 2023-05-15T16:40:09.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a67fc640 1 --2- 172.21.15.62:0/3877602609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a8149df0 0x7f58a80b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-15T16:40:09.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a5ffb640 1 -- 172.21.15.62:0/3877602609 >> v1:172.21.15.62:6789/0 conn(0x7f58a8140b30 legacy=0x7f58a80b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:09.401 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a5ffb640 1 --2- 172.21.15.62:0/3877602609 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58940039b0 0x7f5894003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:09.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a5ffb640 1 --2- 172.21.15.62:0/3877602609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a8149df0 0x7f58940047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:09.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a5ffb640 1 --2- 172.21.15.62:0/3877602609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5894004d10 0x7f5894005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:09.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a5ffb640 1 -- 172.21.15.62:0/3877602609 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a80afd30 con 0x7f58940039b0 2023-05-15T16:40:09.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a5ffb640 1 -- 172.21.15.62:0/3877602609 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f589400bb00 con 0x7f5894004d10 2023-05-15T16:40:09.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a5ffb640 1 -- 172.21.15.62:0/3877602609 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f589400bcc0 con 0x7f58a8149df0 2023-05-15T16:40:09.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a6ffd640 1 --2- 172.21.15.62:0/3877602609 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58940039b0 0x7f5894003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:09.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a77fe640 1 --2- 172.21.15.62:0/3877602609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5894004d10 0x7f5894005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:09.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a67fc640 1 --2- 172.21.15.62:0/3877602609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a8149df0 0x7f58940047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:09.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a6ffd640 1 -- 172.21.15.62:0/3877602609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a8149df0 msgr2=0x7f58940047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:09.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a6ffd640 1 --2- 172.21.15.62:0/3877602609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a8149df0 0x7f58940047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:09.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a6ffd640 1 -- 172.21.15.62:0/3877602609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5894004d10 msgr2=0x7f5894005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:09.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a6ffd640 1 --2- 172.21.15.62:0/3877602609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5894004d10 0x7f5894005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:09.404 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.395+0000 7f58a6ffd640 1 -- 172.21.15.62:0/3877602609 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5894003530 con 0x7f58940039b0 2023-05-15T16:40:09.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58a6ffd640 1 --2- 172.21.15.62:0/3877602609 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58940039b0 0x7f5894003dc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f589800c1c0 tx=0x7f589801f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3429e3b903a43748 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:09.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58a5ffb640 1 -- 172.21.15.62:0/3877602609 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898005ae0 con 0x7f58940039b0 2023-05-15T16:40:09.407 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58a5ffb640 1 -- 172.21.15.62:0/3877602609 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58980ab070 con 0x7f58940039b0 2023-05-15T16:40:09.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58a5ffb640 1 -- 172.21.15.62:0/3877602609 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898007070 con 0x7f58940039b0 2023-05-15T16:40:09.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58ad98d640 1 -- 172.21.15.62:0/3877602609 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58940039b0 msgr2=0x7f5894003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:09.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58ad98d640 1 --2- 172.21.15.62:0/3877602609 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58940039b0 0x7f5894003dc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f589800c1c0 tx=0x7f589801f390 comp rx=0 tx=0).stop 2023-05-15T16:40:09.408 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58a77fe640 1 -- 172.21.15.62:0/3877602609 reap_dead start 2023-05-15T16:40:09.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58ad98d640 1 -- 172.21.15.62:0/3877602609 shutdown_connections 2023-05-15T16:40:09.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58ad98d640 1 -- 172.21.15.62:0/3877602609 >> 172.21.15.62:0/3877602609 conn(0x7f58a80653f0 msgr2=0x7f58a80697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:09.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58ad98d640 1 -- 172.21.15.62:0/3877602609 shutdown_connections 2023-05-15T16:40:09.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58ad98d640 1 -- 172.21.15.62:0/3877602609 wait complete. 2023-05-15T16:40:09.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58ad98d640 1 Processor -- start 2023-05-15T16:40:09.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58ad98d640 1 -- start start 2023-05-15T16:40:09.409 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58ad98d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58940039b0 0x7f58a80b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:09.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58ad98d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a8141c20 0x7f58a8143880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:09.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58ad98d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58a8142780 0x7f58a81e25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:09.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58ad98d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a8141800 con 0x7f58940039b0 2023-05-15T16:40:09.410 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58ad98d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a8143dc0 con 0x7f58a8142780 2023-05-15T16:40:09.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58ad98d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a8142070 con 0x7f58a8141c20 2023-05-15T16:40:09.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58a6ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58940039b0 0x7f58a80b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:09.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58a6ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58940039b0 0x7f58a80b0070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42590/0 (socket says 172.21.15.62:42590) 2023-05-15T16:40:09.411 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58a6ffd640 1 -- 172.21.15.62:0/118550400 learned_addr learned my addr 172.21.15.62:0/118550400 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:09.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58a67fc640 1 --2- 172.21.15.62:0/118550400 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a8141c20 0x7f58a8143880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:09.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58a77fe640 1 --2- 172.21.15.62:0/118550400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58a8142780 0x7f58a81e25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:09.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58a6ffd640 1 -- 172.21.15.62:0/118550400 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a8141c20 msgr2=0x7f58a8143880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:09.412 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58a6ffd640 1 --2- 172.21.15.62:0/118550400 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a8141c20 0x7f58a8143880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:09.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58a6ffd640 1 -- 172.21.15.62:0/118550400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58a8142780 msgr2=0x7f58a81e25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:09.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58a6ffd640 1 --2- 172.21.15.62:0/118550400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58a8142780 0x7f58a81e25a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:09.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58a6ffd640 1 -- 172.21.15.62:0/118550400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a80b5dd0 con 0x7f58940039b0 2023-05-15T16:40:09.413 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58a6ffd640 1 --2- 172.21.15.62:0/118550400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58940039b0 0x7f58a80b0070 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f589801f1c0 tx=0x7f5894005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:09.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f589ffff640 1 -- 172.21.15.62:0/118550400 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898001640 con 0x7f58940039b0 2023-05-15T16:40:09.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f589ffff640 1 -- 172.21.15.62:0/118550400 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5898005e60 con 0x7f58940039b0 2023-05-15T16:40:09.414 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58ad98d640 1 -- 172.21.15.62:0/118550400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a8140f00 con 0x7f58940039b0 2023-05-15T16:40:09.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f589ffff640 1 -- 172.21.15.62:0/118550400 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5898007290 con 0x7f58940039b0 2023-05-15T16:40:09.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.399+0000 7f58ad98d640 1 -- 172.21.15.62:0/118550400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a80b5f60 con 0x7f58940039b0 2023-05-15T16:40:09.415 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.403+0000 7f58ad98d640 1 -- 172.21.15.62:0/118550400 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a8067960 con 0x7f58940039b0 2023-05-15T16:40:09.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.403+0000 7f589ffff640 1 -- 172.21.15.62:0/118550400 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f58980073f0 con 0x7f58940039b0 2023-05-15T16:40:09.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.403+0000 7f589ffff640 1 --2- 172.21.15.62:0/118550400 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5888065380 0x7f5888067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:09.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.403+0000 7f589ffff640 1 -- 172.21.15.62:0/118550400 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f58980b7040 con 0x7f58940039b0 2023-05-15T16:40:09.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.403+0000 7f58a67fc640 1 --2- 172.21.15.62:0/118550400 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5888065380 0x7f5888067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:09.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.403+0000 7f58a67fc640 1 --2- 172.21.15.62:0/118550400 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5888065380 0x7f5888067830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f58a80b1c10 tx=0x7f589000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:09.418 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.407+0000 7f589ffff640 1 -- 172.21.15.62:0/118550400 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f58980ed9e0 con 0x7f58940039b0 2023-05-15T16:40:09.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.555+0000 7f58ad98d640 1 -- 172.21.15.62:0/118550400 --> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f58a804dbe0 con 0x7f5888065380 2023-05-15T16:40:09.581 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.575+0000 7f589ffff640 1 -- 172.21.15.62:0/118550400 <== mgr.4105 v2:172.21.15.161:6832/37541 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286640 (secure 0 0 0) 0x7f58a804dbe0 con 0x7f5888065380 2023-05-15T16:40:09.585 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:09.588 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-05-15T16:40:09.589 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.583+0000 7f58ad98d640 1 -- 172.21.15.62:0/118550400 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5888065380 msgr2=0x7f5888067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:09.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.583+0000 7f58ad98d640 1 --2- 172.21.15.62:0/118550400 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5888065380 0x7f5888067830 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f58a80b1c10 tx=0x7f589000b040 comp rx=0 tx=0).stop 2023-05-15T16:40:09.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.583+0000 7f58ad98d640 1 -- 172.21.15.62:0/118550400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58940039b0 msgr2=0x7f58a80b0070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:09.590 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.583+0000 7f58ad98d640 1 --2- 172.21.15.62:0/118550400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58940039b0 0x7f58a80b0070 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f589801f1c0 tx=0x7f5894005800 comp rx=0 tx=0).stop 2023-05-15T16:40:09.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.583+0000 7f58ad98d640 1 -- 172.21.15.62:0/118550400 shutdown_connections 2023-05-15T16:40:09.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.583+0000 7f58ad98d640 1 --2- 172.21.15.62:0/118550400 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f58a8142780 0x7f58a81e25a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:09.591 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.583+0000 7f58ad98d640 1 --2- 172.21.15.62:0/118550400 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f58a8141c20 0x7f58a8143880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:09.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.583+0000 7f58ad98d640 1 --2- 172.21.15.62:0/118550400 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5888065380 0x7f5888067830 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:09.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.583+0000 7f58ad98d640 1 --2- 172.21.15.62:0/118550400 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f58940039b0 0x7f58a80b0070 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:09.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.583+0000 7f58ad98d640 1 -- 172.21.15.62:0/118550400 >> 172.21.15.62:0/118550400 conn(0x7f58a80653f0 msgr2=0x7f58a80b9910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:09.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.583+0000 7f58ad98d640 1 -- 172.21.15.62:0/118550400 shutdown_connections 2023-05-15T16:40:09.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.583+0000 7f58ad98d640 1 -- 172.21.15.62:0/118550400 wait complete. 2023-05-15T16:40:09.604 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2023-05-15T16:40:09.318680+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":193,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66280,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908440,"statfs":{"total":773094113280,"available":773026242560,"internally_reserved":0,"allocated":3186688,"data_stored":1902188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":56,"apply_latency_ms":56,"commit_latency_ns":56000000,"apply_latency_ns":56000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.224736"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278001+0000","last_change":"2023-05-15T16:40:01.108030+0000","last_active":"2023-05-15T16:40:02.278001+0000","last_peered":"2023-05-15T16:40:02.278001+0000","last_clean":"2023-05-15T16:40:02.278001+0000","last_became_active":"2023-05-15T16:40:01.107701+0000","last_became_peered":"2023-05-15T16:40:01.107701+0000","last_unstale":"2023-05-15T16:40:02.278001+0000","last_undegraded":"2023-05-15T16:40:02.278001+0000","last_fullsized":"2023-05-15T16:40:02.278001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:06.423119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282608+0000","last_change":"2023-05-15T16:40:01.162454+0000","last_active":"2023-05-15T16:40:02.282608+0000","last_peered":"2023-05-15T16:40:02.282608+0000","last_clean":"2023-05-15T16:40:02.282608+0000","last_became_active":"2023-05-15T16:40:01.161325+0000","last_became_peered":"2023-05-15T16:40:01.161325+0000","last_unstale":"2023-05-15T16:40:02.282608+0000","last_undegraded":"2023-05-15T16:40:02.282608+0000","last_fullsized":"2023-05-15T16:40:02.282608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:13:33.110131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100574+0000","last_change":"2023-05-15T16:40:01.140999+0000","last_active":"2023-05-15T16:40:02.100574+0000","last_peered":"2023-05-15T16:40:02.100574+0000","last_clean":"2023-05-15T16:40:02.100574+0000","last_became_active":"2023-05-15T16:40:01.138081+0000","last_became_peered":"2023-05-15T16:40:01.138081+0000","last_unstale":"2023-05-15T16:40:02.100574+0000","last_undegraded":"2023-05-15T16:40:02.100574+0000","last_fullsized":"2023-05-15T16:40:02.100574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:43:45.244861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280478+0000","last_change":"2023-05-15T16:40:01.125926+0000","last_active":"2023-05-15T16:40:02.280478+0000","last_peered":"2023-05-15T16:40:02.280478+0000","last_clean":"2023-05-15T16:40:02.280478+0000","last_became_active":"2023-05-15T16:40:01.121506+0000","last_became_peered":"2023-05-15T16:40:01.121506+0000","last_unstale":"2023-05-15T16:40:02.280478+0000","last_undegraded":"2023-05-15T16:40:02.280478+0000","last_fullsized":"2023-05-15T16:40:02.280478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:56:14.814256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097671+0000","last_change":"2023-05-15T16:40:01.113655+0000","last_active":"2023-05-15T16:40:02.097671+0000","last_peered":"2023-05-15T16:40:02.097671+0000","last_clean":"2023-05-15T16:40:02.097671+0000","last_became_active":"2023-05-15T16:40:01.113359+0000","last_became_peered":"2023-05-15T16:40:01.113359+0000","last_unstale":"2023-05-15T16:40:02.097671+0000","last_undegraded":"2023-05-15T16:40:02.097671+0000","last_fullsized":"2023-05-15T16:40:02.097671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099373+0000","last_change":"2023-05-15T16:40:01.138514+0000","last_active":"2023-05-15T16:40:02.099373+0000","last_peered":"2023-05-15T16:40:02.099373+0000","last_clean":"2023-05-15T16:40:02.099373+0000","last_became_active":"2023-05-15T16:40:01.137610+0000","last_became_peered":"2023-05-15T16:40:01.137610+0000","last_unstale":"2023-05-15T16:40:02.099373+0000","last_undegraded":"2023-05-15T16:40:02.099373+0000","last_fullsized":"2023-05-15T16:40:02.099373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:41:16.912612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280784+0000","last_change":"2023-05-15T16:40:01.149263+0000","last_active":"2023-05-15T16:40:02.280784+0000","last_peered":"2023-05-15T16:40:02.280784+0000","last_clean":"2023-05-15T16:40:02.280784+0000","last_became_active":"2023-05-15T16:40:01.148591+0000","last_became_peered":"2023-05-15T16:40:01.148591+0000","last_unstale":"2023-05-15T16:40:02.280784+0000","last_undegraded":"2023-05-15T16:40:02.280784+0000","last_fullsized":"2023-05-15T16:40:02.280784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:13:33.110131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282009+0000","last_change":"2023-05-15T16:40:01.160969+0000","last_active":"2023-05-15T16:40:02.282009+0000","last_peered":"2023-05-15T16:40:02.282009+0000","last_clean":"2023-05-15T16:40:02.282009+0000","last_became_active":"2023-05-15T16:40:01.160118+0000","last_became_peered":"2023-05-15T16:40:01.160118+0000","last_unstale":"2023-05-15T16:40:02.282009+0000","last_undegraded":"2023-05-15T16:40:02.282009+0000","last_fullsized":"2023-05-15T16:40:02.282009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098107+0000","last_change":"2023-05-15T16:40:01.114095+0000","last_active":"2023-05-15T16:40:02.098107+0000","last_peered":"2023-05-15T16:40:02.098107+0000","last_clean":"2023-05-15T16:40:02.098107+0000","last_became_active":"2023-05-15T16:40:01.113367+0000","last_became_peered":"2023-05-15T16:40:01.113367+0000","last_unstale":"2023-05-15T16:40:02.098107+0000","last_undegraded":"2023-05-15T16:40:02.098107+0000","last_fullsized":"2023-05-15T16:40:02.098107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:22:08.631817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282722+0000","last_change":"2023-05-15T16:40:01.161203+0000","last_active":"2023-05-15T16:40:02.282722+0000","last_peered":"2023-05-15T16:40:02.282722+0000","last_clean":"2023-05-15T16:40:02.282722+0000","last_became_active":"2023-05-15T16:40:01.160163+0000","last_became_peered":"2023-05-15T16:40:01.160163+0000","last_unstale":"2023-05-15T16:40:02.282722+0000","last_undegraded":"2023-05-15T16:40:02.282722+0000","last_fullsized":"2023-05-15T16:40:02.282722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:31:14.621756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100644+0000","last_change":"2023-05-15T16:40:01.140439+0000","last_active":"2023-05-15T16:40:02.100644+0000","last_peered":"2023-05-15T16:40:02.100644+0000","last_clean":"2023-05-15T16:40:02.100644+0000","last_became_active":"2023-05-15T16:40:01.136958+0000","last_became_peered":"2023-05-15T16:40:01.136958+0000","last_unstale":"2023-05-15T16:40:02.100644+0000","last_undegraded":"2023-05-15T16:40:02.100644+0000","last_fullsized":"2023-05-15T16:40:02.100644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:48:42.521388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278138+0000","last_change":"2023-05-15T16:40:01.140940+0000","last_active":"2023-05-15T16:40:02.278138+0000","last_peered":"2023-05-15T16:40:02.278138+0000","last_clean":"2023-05-15T16:40:02.278138+0000","last_became_active":"2023-05-15T16:40:01.140666+0000","last_became_peered":"2023-05-15T16:40:01.140666+0000","last_unstale":"2023-05-15T16:40:02.278138+0000","last_undegraded":"2023-05-15T16:40:02.278138+0000","last_fullsized":"2023-05-15T16:40:02.278138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:56:14.814256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278109+0000","last_change":"2023-05-15T16:40:01.104796+0000","last_active":"2023-05-15T16:40:02.278109+0000","last_peered":"2023-05-15T16:40:02.278109+0000","last_clean":"2023-05-15T16:40:02.278109+0000","last_became_active":"2023-05-15T16:40:01.104505+0000","last_became_peered":"2023-05-15T16:40:01.104505+0000","last_unstale":"2023-05-15T16:40:02.278109+0000","last_undegraded":"2023-05-15T16:40:02.278109+0000","last_fullsized":"2023-05-15T16:40:02.278109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:34.510844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.283018+0000","last_change":"2023-05-15T16:40:01.146028+0000","last_active":"2023-05-15T16:40:02.283018+0000","last_peered":"2023-05-15T16:40:02.283018+0000","last_clean":"2023-05-15T16:40:02.283018+0000","last_became_active":"2023-05-15T16:40:01.145321+0000","last_became_peered":"2023-05-15T16:40:01.145321+0000","last_unstale":"2023-05-15T16:40:02.283018+0000","last_undegraded":"2023-05-15T16:40:02.283018+0000","last_fullsized":"2023-05-15T16:40:02.283018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:02:23.376990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281189+0000","last_change":"2023-05-15T16:40:01.157628+0000","last_active":"2023-05-15T16:40:02.281189+0000","last_peered":"2023-05-15T16:40:02.281189+0000","last_clean":"2023-05-15T16:40:02.281189+0000","last_became_active":"2023-05-15T16:40:01.157096+0000","last_became_peered":"2023-05-15T16:40:01.157096+0000","last_unstale":"2023-05-15T16:40:02.281189+0000","last_undegraded":"2023-05-15T16:40:02.281189+0000","last_fullsized":"2023-05-15T16:40:02.281189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098971+0000","last_change":"2023-05-15T16:40:01.136171+0000","last_active":"2023-05-15T16:40:02.098971+0000","last_peered":"2023-05-15T16:40:02.098971+0000","last_clean":"2023-05-15T16:40:02.098971+0000","last_became_active":"2023-05-15T16:40:01.135400+0000","last_became_peered":"2023-05-15T16:40:01.135400+0000","last_unstale":"2023-05-15T16:40:02.098971+0000","last_undegraded":"2023-05-15T16:40:02.098971+0000","last_fullsized":"2023-05-15T16:40:02.098971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:15:00.512988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098127+0000","last_change":"2023-05-15T16:40:01.113893+0000","last_active":"2023-05-15T16:40:02.098127+0000","last_peered":"2023-05-15T16:40:02.098127+0000","last_clean":"2023-05-15T16:40:02.098127+0000","last_became_active":"2023-05-15T16:40:01.113415+0000","last_became_peered":"2023-05-15T16:40:01.113415+0000","last_unstale":"2023-05-15T16:40:02.098127+0000","last_undegraded":"2023-05-15T16:40:02.098127+0000","last_fullsized":"2023-05-15T16:40:02.098127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100417+0000","last_change":"2023-05-15T16:40:01.139891+0000","last_active":"2023-05-15T16:40:02.100417+0000","last_peered":"2023-05-15T16:40:02.100417+0000","last_clean":"2023-05-15T16:40:02.100417+0000","last_became_active":"2023-05-15T16:40:01.138421+0000","last_became_peered":"2023-05-15T16:40:01.138421+0000","last_unstale":"2023-05-15T16:40:02.100417+0000","last_undegraded":"2023-05-15T16:40:02.100417+0000","last_fullsized":"2023-05-15T16:40:02.100417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T03:57:26.700942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278992+0000","last_change":"2023-05-15T16:40:01.129321+0000","last_active":"2023-05-15T16:40:02.278992+0000","last_peered":"2023-05-15T16:40:02.278992+0000","last_clean":"2023-05-15T16:40:02.278992+0000","last_became_active":"2023-05-15T16:40:01.129026+0000","last_became_peered":"2023-05-15T16:40:01.129026+0000","last_unstale":"2023-05-15T16:40:02.278992+0000","last_undegraded":"2023-05-15T16:40:02.278992+0000","last_fullsized":"2023-05-15T16:40:02.278992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:51:42.949566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100354+0000","last_change":"2023-05-15T16:40:01.141251+0000","last_active":"2023-05-15T16:40:02.100354+0000","last_peered":"2023-05-15T16:40:02.100354+0000","last_clean":"2023-05-15T16:40:02.100354+0000","last_became_active":"2023-05-15T16:40:01.140102+0000","last_became_peered":"2023-05-15T16:40:01.140102+0000","last_unstale":"2023-05-15T16:40:02.100354+0000","last_undegraded":"2023-05-15T16:40:02.100354+0000","last_fullsized":"2023-05-15T16:40:02.100354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:14:42.054526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281668+0000","last_change":"2023-05-15T16:40:01.157690+0000","last_active":"2023-05-15T16:40:02.281668+0000","last_peered":"2023-05-15T16:40:02.281668+0000","last_clean":"2023-05-15T16:40:02.281668+0000","last_became_active":"2023-05-15T16:40:01.157028+0000","last_became_peered":"2023-05-15T16:40:01.157028+0000","last_unstale":"2023-05-15T16:40:02.281668+0000","last_undegraded":"2023-05-15T16:40:02.281668+0000","last_fullsized":"2023-05-15T16:40:02.281668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097365+0000","last_change":"2023-05-15T16:40:01.111473+0000","last_active":"2023-05-15T16:40:02.097365+0000","last_peered":"2023-05-15T16:40:02.097365+0000","last_clean":"2023-05-15T16:40:02.097365+0000","last_became_active":"2023-05-15T16:40:01.109519+0000","last_became_peered":"2023-05-15T16:40:01.109519+0000","last_unstale":"2023-05-15T16:40:02.097365+0000","last_undegraded":"2023-05-15T16:40:02.097365+0000","last_fullsized":"2023-05-15T16:40:02.097365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:39:15.813849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095154+0000","last_change":"2023-05-15T16:40:01.109311+0000","last_active":"2023-05-15T16:40:02.095154+0000","last_peered":"2023-05-15T16:40:02.095154+0000","last_clean":"2023-05-15T16:40:02.095154+0000","last_became_active":"2023-05-15T16:40:01.109001+0000","last_became_peered":"2023-05-15T16:40:01.109001+0000","last_unstale":"2023-05-15T16:40:02.095154+0000","last_undegraded":"2023-05-15T16:40:02.095154+0000","last_fullsized":"2023-05-15T16:40:02.095154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:22:08.631817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280862+0000","last_change":"2023-05-15T16:40:01.151544+0000","last_active":"2023-05-15T16:40:02.280862+0000","last_peered":"2023-05-15T16:40:02.280862+0000","last_clean":"2023-05-15T16:40:02.280862+0000","last_became_active":"2023-05-15T16:40:01.150292+0000","last_became_peered":"2023-05-15T16:40:01.150292+0000","last_unstale":"2023-05-15T16:40:02.280862+0000","last_undegraded":"2023-05-15T16:40:02.280862+0000","last_fullsized":"2023-05-15T16:40:02.280862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279251+0000","last_change":"2023-05-15T16:40:01.119067+0000","last_active":"2023-05-15T16:40:02.279251+0000","last_peered":"2023-05-15T16:40:02.279251+0000","last_clean":"2023-05-15T16:40:02.279251+0000","last_became_active":"2023-05-15T16:40:01.118808+0000","last_became_peered":"2023-05-15T16:40:01.118808+0000","last_unstale":"2023-05-15T16:40:02.279251+0000","last_undegraded":"2023-05-15T16:40:02.279251+0000","last_fullsized":"2023-05-15T16:40:02.279251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:02:23.376990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279750+0000","last_change":"2023-05-15T16:40:01.108611+0000","last_active":"2023-05-15T16:40:02.279750+0000","last_peered":"2023-05-15T16:40:02.279750+0000","last_clean":"2023-05-15T16:40:02.279750+0000","last_became_active":"2023-05-15T16:40:01.107595+0000","last_became_peered":"2023-05-15T16:40:01.107595+0000","last_unstale":"2023-05-15T16:40:02.279750+0000","last_undegraded":"2023-05-15T16:40:02.279750+0000","last_fullsized":"2023-05-15T16:40:02.279750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:45:33.580738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282768+0000","last_change":"2023-05-15T16:40:01.161786+0000","last_active":"2023-05-15T16:40:02.282768+0000","last_peered":"2023-05-15T16:40:02.282768+0000","last_clean":"2023-05-15T16:40:02.282768+0000","last_became_active":"2023-05-15T16:40:01.160406+0000","last_became_peered":"2023-05-15T16:40:01.160406+0000","last_unstale":"2023-05-15T16:40:02.282768+0000","last_undegraded":"2023-05-15T16:40:02.282768+0000","last_fullsized":"2023-05-15T16:40:02.282768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279900+0000","last_change":"2023-05-15T16:40:01.147235+0000","last_active":"2023-05-15T16:40:02.279900+0000","last_peered":"2023-05-15T16:40:02.279900+0000","last_clean":"2023-05-15T16:40:02.279900+0000","last_became_active":"2023-05-15T16:40:01.146964+0000","last_became_peered":"2023-05-15T16:40:01.146964+0000","last_unstale":"2023-05-15T16:40:02.279900+0000","last_undegraded":"2023-05-15T16:40:02.279900+0000","last_fullsized":"2023-05-15T16:40:02.279900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:07:25.649507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095330+0000","last_change":"2023-05-15T16:40:01.125493+0000","last_active":"2023-05-15T16:40:02.095330+0000","last_peered":"2023-05-15T16:40:02.095330+0000","last_clean":"2023-05-15T16:40:02.095330+0000","last_became_active":"2023-05-15T16:40:01.125172+0000","last_became_peered":"2023-05-15T16:40:01.125172+0000","last_unstale":"2023-05-15T16:40:02.095330+0000","last_undegraded":"2023-05-15T16:40:02.095330+0000","last_fullsized":"2023-05-15T16:40:02.095330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099957+0000","last_change":"2023-05-15T16:40:01.138349+0000","last_active":"2023-05-15T16:40:02.099957+0000","last_peered":"2023-05-15T16:40:02.099957+0000","last_clean":"2023-05-15T16:40:02.099957+0000","last_became_active":"2023-05-15T16:40:01.137255+0000","last_became_peered":"2023-05-15T16:40:01.137255+0000","last_unstale":"2023-05-15T16:40:02.099957+0000","last_undegraded":"2023-05-15T16:40:02.099957+0000","last_fullsized":"2023-05-15T16:40:02.099957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:22:31.889776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095427+0000","last_change":"2023-05-15T16:40:01.105121+0000","last_active":"2023-05-15T16:40:02.095427+0000","last_peered":"2023-05-15T16:40:02.095427+0000","last_clean":"2023-05-15T16:40:02.095427+0000","last_became_active":"2023-05-15T16:40:01.104061+0000","last_became_peered":"2023-05-15T16:40:01.104061+0000","last_unstale":"2023-05-15T16:40:02.095427+0000","last_undegraded":"2023-05-15T16:40:02.095427+0000","last_fullsized":"2023-05-15T16:40:02.095427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279918+0000","last_change":"2023-05-15T16:40:01.132449+0000","last_active":"2023-05-15T16:40:02.279918+0000","last_peered":"2023-05-15T16:40:02.279918+0000","last_clean":"2023-05-15T16:40:02.279918+0000","last_became_active":"2023-05-15T16:40:01.131460+0000","last_became_peered":"2023-05-15T16:40:01.131460+0000","last_unstale":"2023-05-15T16:40:02.279918+0000","last_undegraded":"2023-05-15T16:40:02.279918+0000","last_fullsized":"2023-05-15T16:40:02.279918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:19:49.435267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.096152+0000","last_change":"2023-05-15T16:40:01.109245+0000","last_active":"2023-05-15T16:40:02.096152+0000","last_peered":"2023-05-15T16:40:02.096152+0000","last_clean":"2023-05-15T16:40:02.096152+0000","last_became_active":"2023-05-15T16:40:01.108858+0000","last_became_peered":"2023-05-15T16:40:01.108858+0000","last_unstale":"2023-05-15T16:40:02.096152+0000","last_undegraded":"2023-05-15T16:40:02.096152+0000","last_fullsized":"2023-05-15T16:40:02.096152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:45:33.580738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281902+0000","last_change":"2023-05-15T16:40:00.763235+0000","last_active":"2023-05-15T16:40:02.281902+0000","last_peered":"2023-05-15T16:40:02.281902+0000","last_clean":"2023-05-15T16:40:02.281902+0000","last_became_active":"2023-05-15T16:40:00.762235+0000","last_became_peered":"2023-05-15T16:40:00.762235+0000","last_unstale":"2023-05-15T16:40:02.281902+0000","last_undegraded":"2023-05-15T16:40:02.281902+0000","last_fullsized":"2023-05-15T16:40:02.281902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:51:11.783628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282911+0000","last_change":"2023-05-15T16:40:01.160372+0000","last_active":"2023-05-15T16:40:02.282911+0000","last_peered":"2023-05-15T16:40:02.282911+0000","last_clean":"2023-05-15T16:40:02.282911+0000","last_became_active":"2023-05-15T16:40:01.159573+0000","last_became_peered":"2023-05-15T16:40:01.159573+0000","last_unstale":"2023-05-15T16:40:02.282911+0000","last_undegraded":"2023-05-15T16:40:02.282911+0000","last_fullsized":"2023-05-15T16:40:02.282911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097310+0000","last_change":"2023-05-15T16:40:00.739620+0000","last_active":"2023-05-15T16:40:02.097310+0000","last_peered":"2023-05-15T16:40:02.097310+0000","last_clean":"2023-05-15T16:40:02.097310+0000","last_became_active":"2023-05-15T16:40:00.739275+0000","last_became_peered":"2023-05-15T16:40:00.739275+0000","last_unstale":"2023-05-15T16:40:02.097310+0000","last_undegraded":"2023-05-15T16:40:02.097310+0000","last_fullsized":"2023-05-15T16:40:02.097310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:05.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098022+0000","last_change":"2023-05-15T16:40:01.113172+0000","last_active":"2023-05-15T16:40:02.098022+0000","last_peered":"2023-05-15T16:40:02.098022+0000","last_clean":"2023-05-15T16:40:02.098022+0000","last_became_active":"2023-05-15T16:40:01.112870+0000","last_became_peered":"2023-05-15T16:40:01.112870+0000","last_unstale":"2023-05-15T16:40:02.098022+0000","last_undegraded":"2023-05-15T16:40:02.098022+0000","last_fullsized":"2023-05-15T16:40:02.098022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281420+0000","last_change":"2023-05-15T16:40:00.762606+0000","last_active":"2023-05-15T16:40:02.281420+0000","last_peered":"2023-05-15T16:40:02.281420+0000","last_clean":"2023-05-15T16:40:02.281420+0000","last_became_active":"2023-05-15T16:40:00.761988+0000","last_became_peered":"2023-05-15T16:40:00.761988+0000","last_unstale":"2023-05-15T16:40:02.281420+0000","last_undegraded":"2023-05-15T16:40:02.281420+0000","last_fullsized":"2023-05-15T16:40:02.281420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:45:32.571235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095959+0000","last_change":"2023-05-15T16:40:01.147086+0000","last_active":"2023-05-15T16:40:02.095959+0000","last_peered":"2023-05-15T16:40:02.095959+0000","last_clean":"2023-05-15T16:40:02.095959+0000","last_became_active":"2023-05-15T16:40:01.146808+0000","last_became_peered":"2023-05-15T16:40:01.146808+0000","last_unstale":"2023-05-15T16:40:02.095959+0000","last_undegraded":"2023-05-15T16:40:02.095959+0000","last_fullsized":"2023-05-15T16:40:02.095959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280054+0000","last_change":"2023-05-15T16:40:00.730676+0000","last_active":"2023-05-15T16:40:02.280054+0000","last_peered":"2023-05-15T16:40:02.280054+0000","last_clean":"2023-05-15T16:40:02.280054+0000","last_became_active":"2023-05-15T16:40:00.729878+0000","last_became_peered":"2023-05-15T16:40:00.729878+0000","last_unstale":"2023-05-15T16:40:02.280054+0000","last_undegraded":"2023-05-15T16:40:02.280054+0000","last_fullsized":"2023-05-15T16:40:02.280054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:11:08.088281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282241+0000","last_change":"2023-05-15T16:40:00.758036+0000","last_active":"2023-05-15T16:40:02.282241+0000","last_peered":"2023-05-15T16:40:02.282241+0000","last_clean":"2023-05-15T16:40:02.282241+0000","last_became_active":"2023-05-15T16:40:00.757440+0000","last_became_peered":"2023-05-15T16:40:00.757440+0000","last_unstale":"2023-05-15T16:40:02.282241+0000","last_undegraded":"2023-05-15T16:40:02.282241+0000","last_fullsized":"2023-05-15T16:40:02.282241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:39:14.804346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282268+0000","last_change":"2023-05-15T16:40:01.160001+0000","last_active":"2023-05-15T16:40:02.282268+0000","last_peered":"2023-05-15T16:40:02.282268+0000","last_clean":"2023-05-15T16:40:02.282268+0000","last_became_active":"2023-05-15T16:40:01.159447+0000","last_became_peered":"2023-05-15T16:40:01.159447+0000","last_unstale":"2023-05-15T16:40:02.282268+0000","last_undegraded":"2023-05-15T16:40:02.282268+0000","last_fullsized":"2023-05-15T16:40:02.282268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:26:45.774263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282224+0000","last_change":"2023-05-15T16:40:00.762701+0000","last_active":"2023-05-15T16:40:02.282224+0000","last_peered":"2023-05-15T16:40:02.282224+0000","last_clean":"2023-05-15T16:40:02.282224+0000","last_became_active":"2023-05-15T16:40:00.762050+0000","last_became_peered":"2023-05-15T16:40:00.762050+0000","last_unstale":"2023-05-15T16:40:02.282224+0000","last_undegraded":"2023-05-15T16:40:02.282224+0000","last_fullsized":"2023-05-15T16:40:02.282224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:00:39.077549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099635+0000","last_change":"2023-05-15T16:40:01.141928+0000","last_active":"2023-05-15T16:40:02.099635+0000","last_peered":"2023-05-15T16:40:02.099635+0000","last_clean":"2023-05-15T16:40:02.099635+0000","last_became_active":"2023-05-15T16:40:01.135581+0000","last_became_peered":"2023-05-15T16:40:01.135581+0000","last_unstale":"2023-05-15T16:40:02.099635+0000","last_undegraded":"2023-05-15T16:40:02.099635+0000","last_fullsized":"2023-05-15T16:40:02.099635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:50:32.789209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281732+0000","last_change":"2023-05-15T16:40:00.760061+0000","last_active":"2023-05-15T16:40:02.281732+0000","last_peered":"2023-05-15T16:40:02.281732+0000","last_clean":"2023-05-15T16:40:02.281732+0000","last_became_active":"2023-05-15T16:40:00.759394+0000","last_became_peered":"2023-05-15T16:40:00.759394+0000","last_unstale":"2023-05-15T16:40:02.281732+0000","last_undegraded":"2023-05-15T16:40:02.281732+0000","last_fullsized":"2023-05-15T16:40:02.281732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:51:42.381804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280016+0000","last_change":"2023-05-15T16:40:01.124789+0000","last_active":"2023-05-15T16:40:02.280016+0000","last_peered":"2023-05-15T16:40:02.280016+0000","last_clean":"2023-05-15T16:40:02.280016+0000","last_became_active":"2023-05-15T16:40:01.123158+0000","last_became_peered":"2023-05-15T16:40:01.123158+0000","last_unstale":"2023-05-15T16:40:02.280016+0000","last_undegraded":"2023-05-15T16:40:02.280016+0000","last_fullsized":"2023-05-15T16:40:02.280016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:00:40.087052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282519+0000","last_change":"2023-05-15T16:40:00.754578+0000","last_active":"2023-05-15T16:40:02.282519+0000","last_peered":"2023-05-15T16:40:02.282519+0000","last_clean":"2023-05-15T16:40:02.282519+0000","last_became_active":"2023-05-15T16:40:00.753829+0000","last_became_peered":"2023-05-15T16:40:00.753829+0000","last_unstale":"2023-05-15T16:40:02.282519+0000","last_undegraded":"2023-05-15T16:40:02.282519+0000","last_fullsized":"2023-05-15T16:40:02.282519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097589+0000","last_change":"2023-05-15T16:40:01.111444+0000","last_active":"2023-05-15T16:40:02.097589+0000","last_peered":"2023-05-15T16:40:02.097589+0000","last_clean":"2023-05-15T16:40:02.097589+0000","last_became_active":"2023-05-15T16:40:01.108848+0000","last_became_peered":"2023-05-15T16:40:01.108848+0000","last_unstale":"2023-05-15T16:40:02.097589+0000","last_undegraded":"2023-05-15T16:40:02.097589+0000","last_fullsized":"2023-05-15T16:40:02.097589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:26:45.774263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095431+0000","last_change":"2023-05-15T16:40:00.740949+0000","last_active":"2023-05-15T16:40:02.095431+0000","last_peered":"2023-05-15T16:40:02.095431+0000","last_clean":"2023-05-15T16:40:02.095431+0000","last_became_active":"2023-05-15T16:40:00.739009+0000","last_became_peered":"2023-05-15T16:40:00.739009+0000","last_unstale":"2023-05-15T16:40:02.095431+0000","last_undegraded":"2023-05-15T16:40:02.095431+0000","last_fullsized":"2023-05-15T16:40:02.095431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:14:54.500421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100640+0000","last_change":"2023-05-15T16:40:01.140770+0000","last_active":"2023-05-15T16:40:02.100640+0000","last_peered":"2023-05-15T16:40:02.100640+0000","last_clean":"2023-05-15T16:40:02.100640+0000","last_became_active":"2023-05-15T16:40:01.138754+0000","last_became_peered":"2023-05-15T16:40:01.138754+0000","last_unstale":"2023-05-15T16:40:02.100640+0000","last_undegraded":"2023-05-15T16:40:02.100640+0000","last_fullsized":"2023-05-15T16:40:02.100640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:02:15.760757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280274+0000","last_change":"2023-05-15T16:40:00.749907+0000","last_active":"2023-05-15T16:40:02.280274+0000","last_peered":"2023-05-15T16:40:02.280274+0000","last_clean":"2023-05-15T16:40:02.280274+0000","last_became_active":"2023-05-15T16:40:00.749282+0000","last_became_peered":"2023-05-15T16:40:00.749282+0000","last_unstale":"2023-05-15T16:40:02.280274+0000","last_undegraded":"2023-05-15T16:40:02.280274+0000","last_fullsized":"2023-05-15T16:40:02.280274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:14:54.500421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100813+0000","last_change":"2023-05-15T16:40:01.139858+0000","last_active":"2023-05-15T16:40:02.100813+0000","last_peered":"2023-05-15T16:40:02.100813+0000","last_clean":"2023-05-15T16:40:02.100813+0000","last_became_active":"2023-05-15T16:40:01.136069+0000","last_became_peered":"2023-05-15T16:40:01.136069+0000","last_unstale":"2023-05-15T16:40:02.100813+0000","last_undegraded":"2023-05-15T16:40:02.100813+0000","last_fullsized":"2023-05-15T16:40:02.100813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:05:11.188290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099660+0000","last_change":"2023-05-15T16:40:00.749474+0000","last_active":"2023-05-15T16:40:02.099660+0000","last_peered":"2023-05-15T16:40:02.099660+0000","last_clean":"2023-05-15T16:40:02.099660+0000","last_became_active":"2023-05-15T16:40:00.748842+0000","last_became_peered":"2023-05-15T16:40:00.748842+0000","last_unstale":"2023-05-15T16:40:02.099660+0000","last_undegraded":"2023-05-15T16:40:02.099660+0000","last_fullsized":"2023-05-15T16:40:02.099660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:56:52.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100423+0000","last_change":"2023-05-15T16:40:01.138792+0000","last_active":"2023-05-15T16:40:02.100423+0000","last_peered":"2023-05-15T16:40:02.100423+0000","last_clean":"2023-05-15T16:40:02.100423+0000","last_became_active":"2023-05-15T16:40:01.137792+0000","last_became_peered":"2023-05-15T16:40:01.137792+0000","last_unstale":"2023-05-15T16:40:02.100423+0000","last_undegraded":"2023-05-15T16:40:02.100423+0000","last_fullsized":"2023-05-15T16:40:02.100423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095575+0000","last_change":"2023-05-15T16:40:00.735846+0000","last_active":"2023-05-15T16:40:02.095575+0000","last_peered":"2023-05-15T16:40:02.095575+0000","last_clean":"2023-05-15T16:40:02.095575+0000","last_became_active":"2023-05-15T16:40:00.734223+0000","last_became_peered":"2023-05-15T16:40:00.734223+0000","last_unstale":"2023-05-15T16:40:02.095575+0000","last_undegraded":"2023-05-15T16:40:02.095575+0000","last_fullsized":"2023-05-15T16:40:02.095575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:05.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279676+0000","last_change":"2023-05-15T16:40:01.106280+0000","last_active":"2023-05-15T16:40:02.279676+0000","last_peered":"2023-05-15T16:40:02.279676+0000","last_clean":"2023-05-15T16:40:02.279676+0000","last_became_active":"2023-05-15T16:40:01.105962+0000","last_became_peered":"2023-05-15T16:40:01.105962+0000","last_unstale":"2023-05-15T16:40:02.279676+0000","last_undegraded":"2023-05-15T16:40:02.279676+0000","last_fullsized":"2023-05-15T16:40:02.279676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:24:01.307491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.125777+0000","last_change":"2023-05-15T16:39:50.637320+0000","last_active":"2023-05-15T16:40:01.125777+0000","last_peered":"2023-05-15T16:40:01.125777+0000","last_clean":"2023-05-15T16:40:01.125777+0000","last_became_active":"2023-05-15T16:39:50.636541+0000","last_became_peered":"2023-05-15T16:39:50.636541+0000","last_unstale":"2023-05-15T16:40:01.125777+0000","last_undegraded":"2023-05-15T16:40:01.125777+0000","last_fullsized":"2023-05-15T16:40:01.125777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:49.601783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:49.601783+0000","last_clean_scrub_stamp":"2023-05-15T16:39:49.601783+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:18:01.941203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.156165+0000","last_change":"2023-05-15T16:39:56.699270+0000","last_active":"2023-05-15T16:40:01.156165+0000","last_peered":"2023-05-15T16:40:01.156165+0000","last_clean":"2023-05-15T16:40:01.156165+0000","last_became_active":"2023-05-15T16:39:56.698429+0000","last_became_peered":"2023-05-15T16:39:56.698429+0000","last_unstale":"2023-05-15T16:40:01.156165+0000","last_undegraded":"2023-05-15T16:40:01.156165+0000","last_fullsized":"2023-05-15T16:40:01.156165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:31.428692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095161+0000","last_change":"2023-05-15T16:40:00.753212+0000","last_active":"2023-05-15T16:40:02.095161+0000","last_peered":"2023-05-15T16:40:02.095161+0000","last_clean":"2023-05-15T16:40:02.095161+0000","last_became_active":"2023-05-15T16:40:00.752900+0000","last_became_peered":"2023-05-15T16:40:00.752900+0000","last_unstale":"2023-05-15T16:40:02.095161+0000","last_undegraded":"2023-05-15T16:40:02.095161+0000","last_fullsized":"2023-05-15T16:40:02.095161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:30:28.823039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280571+0000","last_change":"2023-05-15T16:40:01.148321+0000","last_active":"2023-05-15T16:40:02.280571+0000","last_peered":"2023-05-15T16:40:02.280571+0000","last_clean":"2023-05-15T16:40:02.280571+0000","last_became_active":"2023-05-15T16:40:01.147687+0000","last_became_peered":"2023-05-15T16:40:01.147687+0000","last_unstale":"2023-05-15T16:40:02.280571+0000","last_undegraded":"2023-05-15T16:40:02.280571+0000","last_fullsized":"2023-05-15T16:40:02.280571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:51:43.391307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.125606+0000","last_change":"2023-05-15T16:39:56.700800+0000","last_active":"2023-05-15T16:40:01.125606+0000","last_peered":"2023-05-15T16:40:01.125606+0000","last_clean":"2023-05-15T16:40:01.125606+0000","last_became_active":"2023-05-15T16:39:56.700022+0000","last_became_peered":"2023-05-15T16:39:56.700022+0000","last_unstale":"2023-05-15T16:40:01.125606+0000","last_undegraded":"2023-05-15T16:40:01.125606+0000","last_fullsized":"2023-05-15T16:40:01.125606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:11:54.752932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097131+0000","last_change":"2023-05-15T16:40:00.762802+0000","last_active":"2023-05-15T16:40:02.097131+0000","last_peered":"2023-05-15T16:40:02.097131+0000","last_clean":"2023-05-15T16:40:02.097131+0000","last_became_active":"2023-05-15T16:40:00.762564+0000","last_became_peered":"2023-05-15T16:40:00.762564+0000","last_unstale":"2023-05-15T16:40:02.097131+0000","last_undegraded":"2023-05-15T16:40:02.097131+0000","last_fullsized":"2023-05-15T16:40:02.097131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:21:29.173379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097918+0000","last_change":"2023-05-15T16:40:01.111468+0000","last_active":"2023-05-15T16:40:02.097918+0000","last_peered":"2023-05-15T16:40:02.097918+0000","last_clean":"2023-05-15T16:40:02.097918+0000","last_became_active":"2023-05-15T16:40:01.108705+0000","last_became_peered":"2023-05-15T16:40:01.108705+0000","last_unstale":"2023-05-15T16:40:02.097918+0000","last_undegraded":"2023-05-15T16:40:02.097918+0000","last_fullsized":"2023-05-15T16:40:02.097918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:24:01.307491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.091019+0000","last_change":"2023-05-15T16:39:57.018815+0000","last_active":"2023-05-15T16:40:01.091019+0000","last_peered":"2023-05-15T16:40:01.091019+0000","last_clean":"2023-05-15T16:40:01.091019+0000","last_became_active":"2023-05-15T16:39:57.018404+0000","last_became_peered":"2023-05-15T16:39:57.018404+0000","last_unstale":"2023-05-15T16:40:01.091019+0000","last_undegraded":"2023-05-15T16:40:01.091019+0000","last_fullsized":"2023-05-15T16:40:01.091019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278644+0000","last_change":"2023-05-15T16:40:00.732605+0000","last_active":"2023-05-15T16:40:02.278644+0000","last_peered":"2023-05-15T16:40:02.278644+0000","last_clean":"2023-05-15T16:40:02.278644+0000","last_became_active":"2023-05-15T16:40:00.731996+0000","last_became_peered":"2023-05-15T16:40:00.731996+0000","last_unstale":"2023-05-15T16:40:02.278644+0000","last_undegraded":"2023-05-15T16:40:02.278644+0000","last_fullsized":"2023-05-15T16:40:02.278644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:30:28.823039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280039+0000","last_change":"2023-05-15T16:40:01.158076+0000","last_active":"2023-05-15T16:40:02.280039+0000","last_peered":"2023-05-15T16:40:02.280039+0000","last_clean":"2023-05-15T16:40:02.280039+0000","last_became_active":"2023-05-15T16:40:01.157836+0000","last_became_peered":"2023-05-15T16:40:01.157836+0000","last_unstale":"2023-05-15T16:40:02.280039+0000","last_undegraded":"2023-05-15T16:40:02.280039+0000","last_fullsized":"2023-05-15T16:40:02.280039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:26:45.774263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.156363+0000","last_change":"2023-05-15T16:39:56.701269+0000","last_active":"2023-05-15T16:40:01.156363+0000","last_peered":"2023-05-15T16:40:01.156363+0000","last_clean":"2023-05-15T16:40:01.156363+0000","last_became_active":"2023-05-15T16:39:56.700221+0000","last_became_peered":"2023-05-15T16:39:56.700221+0000","last_unstale":"2023-05-15T16:40:01.156363+0000","last_undegraded":"2023-05-15T16:40:01.156363+0000","last_fullsized":"2023-05-15T16:40:01.156363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099905+0000","last_change":"2023-05-15T16:40:00.749117+0000","last_active":"2023-05-15T16:40:02.099905+0000","last_peered":"2023-05-15T16:40:02.099905+0000","last_clean":"2023-05-15T16:40:02.099905+0000","last_became_active":"2023-05-15T16:40:00.748493+0000","last_became_peered":"2023-05-15T16:40:00.748493+0000","last_unstale":"2023-05-15T16:40:02.099905+0000","last_undegraded":"2023-05-15T16:40:02.099905+0000","last_fullsized":"2023-05-15T16:40:02.099905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279394+0000","last_change":"2023-05-15T16:40:01.108032+0000","last_active":"2023-05-15T16:40:02.279394+0000","last_peered":"2023-05-15T16:40:02.279394+0000","last_clean":"2023-05-15T16:40:02.279394+0000","last_became_active":"2023-05-15T16:40:01.107664+0000","last_became_peered":"2023-05-15T16:40:01.107664+0000","last_unstale":"2023-05-15T16:40:02.279394+0000","last_undegraded":"2023-05-15T16:40:02.279394+0000","last_fullsized":"2023-05-15T16:40:02.279394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:31:14.621756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.283078+0000","last_change":"2023-05-15T16:40:00.756830+0000","last_active":"2023-05-15T16:40:02.283078+0000","last_peered":"2023-05-15T16:40:02.283078+0000","last_clean":"2023-05-15T16:40:02.283078+0000","last_became_active":"2023-05-15T16:40:00.755791+0000","last_became_peered":"2023-05-15T16:40:00.755791+0000","last_unstale":"2023-05-15T16:40:02.283078+0000","last_undegraded":"2023-05-15T16:40:02.283078+0000","last_fullsized":"2023-05-15T16:40:02.283078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:21:29.173379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.101846+0000","last_change":"2023-05-15T16:39:56.692931+0000","last_active":"2023-05-15T16:40:01.101846+0000","last_peered":"2023-05-15T16:40:01.101846+0000","last_clean":"2023-05-15T16:40:01.101846+0000","last_became_active":"2023-05-15T16:39:56.692557+0000","last_became_peered":"2023-05-15T16:39:56.692557+0000","last_unstale":"2023-05-15T16:40:01.101846+0000","last_undegraded":"2023-05-15T16:40:01.101846+0000","last_fullsized":"2023-05-15T16:40:01.101846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279898+0000","last_change":"2023-05-15T16:40:01.143115+0000","last_active":"2023-05-15T16:40:02.279898+0000","last_peered":"2023-05-15T16:40:02.279898+0000","last_clean":"2023-05-15T16:40:02.279898+0000","last_became_active":"2023-05-15T16:40:01.142777+0000","last_became_peered":"2023-05-15T16:40:01.142777+0000","last_unstale":"2023-05-15T16:40:02.279898+0000","last_undegraded":"2023-05-15T16:40:02.279898+0000","last_fullsized":"2023-05-15T16:40:02.279898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279615+0000","last_change":"2023-05-15T16:40:00.732385+0000","last_active":"2023-05-15T16:40:02.279615+0000","last_peered":"2023-05-15T16:40:02.279615+0000","last_clean":"2023-05-15T16:40:02.279615+0000","last_became_active":"2023-05-15T16:40:00.731887+0000","last_became_peered":"2023-05-15T16:40:00.731887+0000","last_unstale":"2023-05-15T16:40:02.279615+0000","last_undegraded":"2023-05-15T16:40:02.279615+0000","last_fullsized":"2023-05-15T16:40:02.279615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.129045+0000","last_change":"2023-05-15T16:39:56.698079+0000","last_active":"2023-05-15T16:40:01.129045+0000","last_peered":"2023-05-15T16:40:01.129045+0000","last_clean":"2023-05-15T16:40:01.129045+0000","last_became_active":"2023-05-15T16:39:56.697298+0000","last_became_peered":"2023-05-15T16:39:56.697298+0000","last_unstale":"2023-05-15T16:40:01.129045+0000","last_undegraded":"2023-05-15T16:40:01.129045+0000","last_fullsized":"2023-05-15T16:40:01.129045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:32:01.734351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097558+0000","last_change":"2023-05-15T16:40:01.144386+0000","last_active":"2023-05-15T16:40:02.097558+0000","last_peered":"2023-05-15T16:40:02.097558+0000","last_clean":"2023-05-15T16:40:02.097558+0000","last_became_active":"2023-05-15T16:40:01.144046+0000","last_became_peered":"2023-05-15T16:40:01.144046+0000","last_unstale":"2023-05-15T16:40:02.097558+0000","last_undegraded":"2023-05-15T16:40:02.097558+0000","last_fullsized":"2023-05-15T16:40:02.097558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:50:32.789209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.096140+0000","last_change":"2023-05-15T16:40:00.740983+0000","last_active":"2023-05-15T16:40:02.096140+0000","last_peered":"2023-05-15T16:40:02.096140+0000","last_clean":"2023-05-15T16:40:02.096140+0000","last_became_active":"2023-05-15T16:40:00.739828+0000","last_became_peered":"2023-05-15T16:40:00.739828+0000","last_unstale":"2023-05-15T16:40:02.096140+0000","last_undegraded":"2023-05-15T16:40:02.096140+0000","last_fullsized":"2023-05-15T16:40:02.096140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.101796+0000","last_change":"2023-05-15T16:39:56.694298+0000","last_active":"2023-05-15T16:40:01.101796+0000","last_peered":"2023-05-15T16:40:01.101796+0000","last_clean":"2023-05-15T16:40:01.101796+0000","last_became_active":"2023-05-15T16:39:56.693723+0000","last_became_peered":"2023-05-15T16:39:56.693723+0000","last_unstale":"2023-05-15T16:40:01.101796+0000","last_undegraded":"2023-05-15T16:40:01.101796+0000","last_fullsized":"2023-05-15T16:40:01.101796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:31.428692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095317+0000","last_change":"2023-05-15T16:40:01.125833+0000","last_active":"2023-05-15T16:40:02.095317+0000","last_peered":"2023-05-15T16:40:02.095317+0000","last_clean":"2023-05-15T16:40:02.095317+0000","last_became_active":"2023-05-15T16:40:01.125641+0000","last_became_peered":"2023-05-15T16:40:01.125641+0000","last_unstale":"2023-05-15T16:40:02.095317+0000","last_undegraded":"2023-05-15T16:40:02.095317+0000","last_fullsized":"2023-05-15T16:40:02.095317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:48:42.521388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098109+0000","last_change":"2023-05-15T16:40:00.729163+0000","last_active":"2023-05-15T16:40:02.098109+0000","last_peered":"2023-05-15T16:40:02.098109+0000","last_clean":"2023-05-15T16:40:02.098109+0000","last_became_active":"2023-05-15T16:40:00.725627+0000","last_became_peered":"2023-05-15T16:40:00.725627+0000","last_unstale":"2023-05-15T16:40:02.098109+0000","last_undegraded":"2023-05-15T16:40:02.098109+0000","last_fullsized":"2023-05-15T16:40:02.098109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.115241+0000","last_change":"2023-05-15T16:39:56.697003+0000","last_active":"2023-05-15T16:40:01.115241+0000","last_peered":"2023-05-15T16:40:01.115241+0000","last_clean":"2023-05-15T16:40:01.115241+0000","last_became_active":"2023-05-15T16:39:56.696210+0000","last_became_peered":"2023-05-15T16:39:56.696210+0000","last_unstale":"2023-05-15T16:40:01.115241+0000","last_undegraded":"2023-05-15T16:40:01.115241+0000","last_fullsized":"2023-05-15T16:40:01.115241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:29:27.454964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099418+0000","last_change":"2023-05-15T16:40:01.146590+0000","last_active":"2023-05-15T16:40:02.099418+0000","last_peered":"2023-05-15T16:40:02.099418+0000","last_clean":"2023-05-15T16:40:02.099418+0000","last_became_active":"2023-05-15T16:40:01.145902+0000","last_became_peered":"2023-05-15T16:40:01.145902+0000","last_unstale":"2023-05-15T16:40:02.099418+0000","last_undegraded":"2023-05-15T16:40:02.099418+0000","last_fullsized":"2023-05-15T16:40:02.099418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:26:42.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099663+0000","last_change":"2023-05-15T16:40:01.137328+0000","last_active":"2023-05-15T16:40:02.099663+0000","last_peered":"2023-05-15T16:40:02.099663+0000","last_clean":"2023-05-15T16:40:02.099663+0000","last_became_active":"2023-05-15T16:40:01.135859+0000","last_became_peered":"2023-05-15T16:40:01.135859+0000","last_unstale":"2023-05-15T16:40:02.099663+0000","last_undegraded":"2023-05-15T16:40:02.099663+0000","last_fullsized":"2023-05-15T16:40:02.099663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:22:08.631817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100701+0000","last_change":"2023-05-15T16:40:00.741443+0000","last_active":"2023-05-15T16:40:02.100701+0000","last_peered":"2023-05-15T16:40:02.100701+0000","last_clean":"2023-05-15T16:40:02.100701+0000","last_became_active":"2023-05-15T16:40:00.737218+0000","last_became_peered":"2023-05-15T16:40:00.737218+0000","last_unstale":"2023-05-15T16:40:02.100701+0000","last_undegraded":"2023-05-15T16:40:02.100701+0000","last_fullsized":"2023-05-15T16:40:02.100701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:05.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279727+0000","last_change":"2023-05-15T16:40:01.119384+0000","last_active":"2023-05-15T16:40:02.279727+0000","last_peered":"2023-05-15T16:40:02.279727+0000","last_clean":"2023-05-15T16:40:02.279727+0000","last_became_active":"2023-05-15T16:40:01.119075+0000","last_became_peered":"2023-05-15T16:40:01.119075+0000","last_unstale":"2023-05-15T16:40:02.279727+0000","last_undegraded":"2023-05-15T16:40:02.279727+0000","last_fullsized":"2023-05-15T16:40:02.279727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:29:25.132530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281736+0000","last_change":"2023-05-15T16:40:00.744828+0000","last_active":"2023-05-15T16:40:02.281736+0000","last_peered":"2023-05-15T16:40:02.281736+0000","last_clean":"2023-05-15T16:40:02.281736+0000","last_became_active":"2023-05-15T16:40:00.744103+0000","last_became_peered":"2023-05-15T16:40:00.744103+0000","last_unstale":"2023-05-15T16:40:02.281736+0000","last_undegraded":"2023-05-15T16:40:02.281736+0000","last_fullsized":"2023-05-15T16:40:02.281736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:19:48.425765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282856+0000","last_change":"2023-05-15T16:40:00.754697+0000","last_active":"2023-05-15T16:40:02.282856+0000","last_peered":"2023-05-15T16:40:02.282856+0000","last_clean":"2023-05-15T16:40:02.282856+0000","last_became_active":"2023-05-15T16:40:00.754117+0000","last_became_peered":"2023-05-15T16:40:00.754117+0000","last_unstale":"2023-05-15T16:40:02.282856+0000","last_undegraded":"2023-05-15T16:40:02.282856+0000","last_fullsized":"2023-05-15T16:40:02.282856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:05.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095638+0000","last_change":"2023-05-15T16:40:01.148027+0000","last_active":"2023-05-15T16:40:02.095638+0000","last_peered":"2023-05-15T16:40:02.095638+0000","last_clean":"2023-05-15T16:40:02.095638+0000","last_became_active":"2023-05-15T16:40:01.147699+0000","last_became_peered":"2023-05-15T16:40:01.147699+0000","last_unstale":"2023-05-15T16:40:02.095638+0000","last_undegraded":"2023-05-15T16:40:02.095638+0000","last_fullsized":"2023-05-15T16:40:02.095638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:50:32.789209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098446+0000","last_change":"2023-05-15T16:40:00.753008+0000","last_active":"2023-05-15T16:40:02.098446+0000","last_peered":"2023-05-15T16:40:02.098446+0000","last_clean":"2023-05-15T16:40:02.098446+0000","last_became_active":"2023-05-15T16:40:00.752696+0000","last_became_peered":"2023-05-15T16:40:00.752696+0000","last_unstale":"2023-05-15T16:40:02.098446+0000","last_undegraded":"2023-05-15T16:40:02.098446+0000","last_fullsized":"2023-05-15T16:40:02.098446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:30:28.823039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095101+0000","last_change":"2023-05-15T16:40:01.102001+0000","last_active":"2023-05-15T16:40:02.095101+0000","last_peered":"2023-05-15T16:40:02.095101+0000","last_clean":"2023-05-15T16:40:02.095101+0000","last_became_active":"2023-05-15T16:40:01.101708+0000","last_became_peered":"2023-05-15T16:40:01.101708+0000","last_unstale":"2023-05-15T16:40:02.095101+0000","last_undegraded":"2023-05-15T16:40:02.095101+0000","last_fullsized":"2023-05-15T16:40:02.095101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:13:33.110131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280831+0000","last_change":"2023-05-15T16:40:01.161461+0000","last_active":"2023-05-15T16:40:02.280831+0000","last_peered":"2023-05-15T16:40:02.280831+0000","last_clean":"2023-05-15T16:40:02.280831+0000","last_became_active":"2023-05-15T16:40:01.160945+0000","last_became_peered":"2023-05-15T16:40:01.160945+0000","last_unstale":"2023-05-15T16:40:02.280831+0000","last_undegraded":"2023-05-15T16:40:02.280831+0000","last_fullsized":"2023-05-15T16:40:02.280831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:39:15.813849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095333+0000","last_change":"2023-05-15T16:40:00.740953+0000","last_active":"2023-05-15T16:40:02.095333+0000","last_peered":"2023-05-15T16:40:02.095333+0000","last_clean":"2023-05-15T16:40:02.095333+0000","last_became_active":"2023-05-15T16:40:00.739500+0000","last_became_peered":"2023-05-15T16:40:00.739500+0000","last_unstale":"2023-05-15T16:40:02.095333+0000","last_undegraded":"2023-05-15T16:40:02.095333+0000","last_fullsized":"2023-05-15T16:40:02.095333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:56:52.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097941+0000","last_change":"2023-05-15T16:40:01.147295+0000","last_active":"2023-05-15T16:40:02.097941+0000","last_peered":"2023-05-15T16:40:02.097941+0000","last_clean":"2023-05-15T16:40:02.097941+0000","last_became_active":"2023-05-15T16:40:01.146994+0000","last_became_peered":"2023-05-15T16:40:01.146994+0000","last_unstale":"2023-05-15T16:40:02.097941+0000","last_undegraded":"2023-05-15T16:40:02.097941+0000","last_fullsized":"2023-05-15T16:40:02.097941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:13:33.110131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279178+0000","last_change":"2023-05-15T16:40:00.733783+0000","last_active":"2023-05-15T16:40:02.279178+0000","last_peered":"2023-05-15T16:40:02.279178+0000","last_clean":"2023-05-15T16:40:02.279178+0000","last_became_active":"2023-05-15T16:40:00.733442+0000","last_became_peered":"2023-05-15T16:40:00.733442+0000","last_unstale":"2023-05-15T16:40:02.279178+0000","last_undegraded":"2023-05-15T16:40:02.279178+0000","last_fullsized":"2023-05-15T16:40:02.279178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:56:52.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095487+0000","last_change":"2023-05-15T16:40:01.108561+0000","last_active":"2023-05-15T16:40:02.095487+0000","last_peered":"2023-05-15T16:40:02.095487+0000","last_clean":"2023-05-15T16:40:02.095487+0000","last_became_active":"2023-05-15T16:40:01.108286+0000","last_became_peered":"2023-05-15T16:40:01.108286+0000","last_unstale":"2023-05-15T16:40:02.095487+0000","last_undegraded":"2023-05-15T16:40:02.095487+0000","last_fullsized":"2023-05-15T16:40:02.095487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:07:25.649507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099944+0000","last_change":"2023-05-15T16:40:00.748959+0000","last_active":"2023-05-15T16:40:02.099944+0000","last_peered":"2023-05-15T16:40:02.099944+0000","last_clean":"2023-05-15T16:40:02.099944+0000","last_became_active":"2023-05-15T16:40:00.744181+0000","last_became_peered":"2023-05-15T16:40:00.744181+0000","last_unstale":"2023-05-15T16:40:02.099944+0000","last_undegraded":"2023-05-15T16:40:02.099944+0000","last_fullsized":"2023-05-15T16:40:02.099944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:30:28.823039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278386+0000","last_change":"2023-05-15T16:40:01.111006+0000","last_active":"2023-05-15T16:40:02.278386+0000","last_peered":"2023-05-15T16:40:02.278386+0000","last_clean":"2023-05-15T16:40:02.278386+0000","last_became_active":"2023-05-15T16:40:01.110731+0000","last_became_peered":"2023-05-15T16:40:01.110731+0000","last_unstale":"2023-05-15T16:40:02.278386+0000","last_undegraded":"2023-05-15T16:40:02.278386+0000","last_fullsized":"2023-05-15T16:40:02.278386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:21:30.182882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097788+0000","last_change":"2023-05-15T16:40:00.760933+0000","last_active":"2023-05-15T16:40:02.097788+0000","last_peered":"2023-05-15T16:40:02.097788+0000","last_clean":"2023-05-15T16:40:02.097788+0000","last_became_active":"2023-05-15T16:40:00.760570+0000","last_became_peered":"2023-05-15T16:40:00.760570+0000","last_unstale":"2023-05-15T16:40:02.097788+0000","last_undegraded":"2023-05-15T16:40:02.097788+0000","last_fullsized":"2023-05-15T16:40:02.097788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:51:41.940063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099449+0000","last_change":"2023-05-15T16:40:01.137937+0000","last_active":"2023-05-15T16:40:02.099449+0000","last_peered":"2023-05-15T16:40:02.099449+0000","last_clean":"2023-05-15T16:40:02.099449+0000","last_became_active":"2023-05-15T16:40:01.136661+0000","last_became_peered":"2023-05-15T16:40:01.136661+0000","last_unstale":"2023-05-15T16:40:02.099449+0000","last_undegraded":"2023-05-15T16:40:02.099449+0000","last_fullsized":"2023-05-15T16:40:02.099449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:45:23.112789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282296+0000","last_change":"2023-05-15T16:40:00.765428+0000","last_active":"2023-05-15T16:40:02.282296+0000","last_peered":"2023-05-15T16:40:02.282296+0000","last_clean":"2023-05-15T16:40:02.282296+0000","last_became_active":"2023-05-15T16:40:00.764846+0000","last_became_peered":"2023-05-15T16:40:00.764846+0000","last_unstale":"2023-05-15T16:40:02.282296+0000","last_undegraded":"2023-05-15T16:40:02.282296+0000","last_fullsized":"2023-05-15T16:40:02.282296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:56:13.804754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099659+0000","last_change":"2023-05-15T16:40:01.138011+0000","last_active":"2023-05-15T16:40:02.099659+0000","last_peered":"2023-05-15T16:40:02.099659+0000","last_clean":"2023-05-15T16:40:02.099659+0000","last_became_active":"2023-05-15T16:40:01.136847+0000","last_became_peered":"2023-05-15T16:40:01.136847+0000","last_unstale":"2023-05-15T16:40:02.099659+0000","last_undegraded":"2023-05-15T16:40:02.099659+0000","last_fullsized":"2023-05-15T16:40:02.099659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:14:14.713803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282986+0000","last_change":"2023-05-15T16:40:00.765361+0000","last_active":"2023-05-15T16:40:02.282986+0000","last_peered":"2023-05-15T16:40:02.282986+0000","last_clean":"2023-05-15T16:40:02.282986+0000","last_became_active":"2023-05-15T16:40:00.764881+0000","last_became_peered":"2023-05-15T16:40:00.764881+0000","last_unstale":"2023-05-15T16:40:02.282986+0000","last_undegraded":"2023-05-15T16:40:02.282986+0000","last_fullsized":"2023-05-15T16:40:02.282986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:51:41.940063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095732+0000","last_change":"2023-05-15T16:40:01.102202+0000","last_active":"2023-05-15T16:40:02.095732+0000","last_peered":"2023-05-15T16:40:02.095732+0000","last_clean":"2023-05-15T16:40:02.095732+0000","last_became_active":"2023-05-15T16:40:01.101916+0000","last_became_peered":"2023-05-15T16:40:01.101916+0000","last_unstale":"2023-05-15T16:40:02.095732+0000","last_undegraded":"2023-05-15T16:40:02.095732+0000","last_fullsized":"2023-05-15T16:40:02.095732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:26:45.774263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095575+0000","last_change":"2023-05-15T16:40:00.736792+0000","last_active":"2023-05-15T16:40:02.095575+0000","last_peered":"2023-05-15T16:40:02.095575+0000","last_clean":"2023-05-15T16:40:02.095575+0000","last_became_active":"2023-05-15T16:40:00.736507+0000","last_became_peered":"2023-05-15T16:40:00.736507+0000","last_unstale":"2023-05-15T16:40:02.095575+0000","last_undegraded":"2023-05-15T16:40:02.095575+0000","last_fullsized":"2023-05-15T16:40:02.095575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:21:29.173379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099100+0000","last_change":"2023-05-15T16:40:01.134199+0000","last_active":"2023-05-15T16:40:02.099100+0000","last_peered":"2023-05-15T16:40:02.099100+0000","last_clean":"2023-05-15T16:40:02.099100+0000","last_became_active":"2023-05-15T16:40:01.133481+0000","last_became_peered":"2023-05-15T16:40:01.133481+0000","last_unstale":"2023-05-15T16:40:02.099100+0000","last_undegraded":"2023-05-15T16:40:02.099100+0000","last_fullsized":"2023-05-15T16:40:02.099100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098440+0000","last_change":"2023-05-15T16:40:00.753734+0000","last_active":"2023-05-15T16:40:02.098440+0000","last_peered":"2023-05-15T16:40:02.098440+0000","last_clean":"2023-05-15T16:40:02.098440+0000","last_became_active":"2023-05-15T16:40:00.753401+0000","last_became_peered":"2023-05-15T16:40:00.753401+0000","last_unstale":"2023-05-15T16:40:02.098440+0000","last_undegraded":"2023-05-15T16:40:02.098440+0000","last_fullsized":"2023-05-15T16:40:02.098440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:56:52.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9108,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362732,"statfs":{"total":96636764160,"available":96627437568,"internally_reserved":0,"allocated":864256,"data_stored":681731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1679999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2789999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574854,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91200000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71599999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0800000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58899999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68100000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":90235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69699999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79100000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.877}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2829999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.26}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":91203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91500000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.056}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97599999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.097}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88800000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574855,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8056,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363784,"statfs":{"total":96636764160,"available":96628514816,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3009999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.157}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4870000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4019999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7924,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363916,"statfs":{"total":96636764160,"available":96628649984,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8052,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363788,"statfs":{"total":96636764160,"available":96628518912,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":8.1560000000000006}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":6.3659999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.645}]}]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9084,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362756,"statfs":{"total":96636764160,"available":96627462144,"internally_reserved":0,"allocated":839680,"data_stored":680533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.466}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0129999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6140000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-15T16:40:09.611 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-15T16:40:09.612 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-05-15T16:40:09.612 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-05-15T16:40:09.613 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-05-15T16:40:09.613 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-05-15T16:40:09.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.767+0000 7f1ae111b640 1 Processor -- start 2023-05-15T16:40:09.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.767+0000 7f1ae111b640 1 -- start start 2023-05-15T16:40:09.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1ae111b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1adc070790 0x7f1adc06e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:09.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1ae111b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1adc06b8c0 0x7f1adc06bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:09.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1ae111b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1adc0b9900 con 0x7f1adc0b9030 2023-05-15T16:40:09.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1ae111b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1adc0b9510 con 0x7f1adc070790 2023-05-15T16:40:09.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1ae111b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1adc0b9b50 con 0x7f1adc06b8c0 2023-05-15T16:40:09.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1adad9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1adc070790 0x7f1adc06e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:09.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1ada59c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1adc0b9030 0x7f1adc1439f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37810/0 (socket says 172.21.15.62:37810) 2023-05-15T16:40:09.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1ada59c640 1 -- 172.21.15.62:0/1797157275 learned_addr learned my addr 172.21.15.62:0/1797157275 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:09.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1adb59e640 1 --2- 172.21.15.62:0/1797157275 >> v2:172.21.15.161:3300/0 conn(0x7f1adc06b8c0 0x7f1adc06bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:09.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1adad9d640 1 -- 172.21.15.62:0/1797157275 >> v2:172.21.15.161:3300/0 conn(0x7f1adc06b8c0 msgr2=0x7f1adc06bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:09.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1adad9d640 1 --2- 172.21.15.62:0/1797157275 >> v2:172.21.15.161:3300/0 conn(0x7f1adc06b8c0 0x7f1adc06bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:09.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1adad9d640 1 -- 172.21.15.62:0/1797157275 >> v1:172.21.15.62:6789/0 conn(0x7f1adc0b9030 legacy=0x7f1adc1439f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:09.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1adad9d640 1 -- 172.21.15.62:0/1797157275 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1adc0b9e30 con 0x7f1adc070790 2023-05-15T16:40:09.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1adad9d640 1 --2- 172.21.15.62:0/1797157275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1adc070790 0x7f1adc06e1a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1adc06ab90 tx=0x7f1ad001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af9e4bf8c4c77f4 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:09.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1ad9d9b640 1 -- 172.21.15.62:0/1797157275 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad00ab600 con 0x7f1adc070790 2023-05-15T16:40:09.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1ad9d9b640 1 -- 172.21.15.62:0/1797157275 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad00a7050 con 0x7f1adc070790 2023-05-15T16:40:09.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1ad9d9b640 1 -- 172.21.15.62:0/1797157275 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad00ab980 con 0x7f1adc070790 2023-05-15T16:40:09.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1ae111b640 1 -- 172.21.15.62:0/1797157275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1adc070790 msgr2=0x7f1adc06e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:09.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1ae111b640 1 --2- 172.21.15.62:0/1797157275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1adc070790 0x7f1adc06e1a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1adc06ab90 tx=0x7f1ad001c460 comp rx=0 tx=0).stop 2023-05-15T16:40:09.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1ae111b640 1 -- 172.21.15.62:0/1797157275 shutdown_connections 2023-05-15T16:40:09.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1ae111b640 1 --2- 172.21.15.62:0/1797157275 >> v2:172.21.15.161:3300/0 conn(0x7f1adc06b8c0 0x7f1adc06bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:09.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.771+0000 7f1ae111b640 1 --2- 172.21.15.62:0/1797157275 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1adc070790 0x7f1adc06e1a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:09.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1ae111b640 1 -- 172.21.15.62:0/1797157275 >> 172.21.15.62:0/1797157275 conn(0x7f1adc0ba820 msgr2=0x7f1adc0bac20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:09.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1ae111b640 1 -- 172.21.15.62:0/1797157275 shutdown_connections 2023-05-15T16:40:09.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1ae111b640 1 -- 172.21.15.62:0/1797157275 wait complete. 2023-05-15T16:40:09.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1ae111b640 1 Processor -- start 2023-05-15T16:40:09.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1ae111b640 1 -- start start 2023-05-15T16:40:09.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1ae111b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1adc06b8c0 0x7f1adc1e2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:09.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1ae111b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1adc070790 0x7f1adc0bcf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:09.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1ae111b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1adc0b9030 0x7f1adc136fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1ae111b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc1e2da0 con 0x7f1adc06b8c0 2023-05-15T16:40:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1ae111b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc1dcdb0 con 0x7f1adc070790 2023-05-15T16:40:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1ae111b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1adc1dbd50 con 0x7f1adc0b9030 2023-05-15T16:40:09.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1adad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1adc06b8c0 0x7f1adc1e2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:09.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1adad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1adc06b8c0 0x7f1adc1e2860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42618/0 (socket says 172.21.15.62:42618) 2023-05-15T16:40:09.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1adad9d640 1 -- 172.21.15.62:0/2744250032 learned_addr learned my addr 172.21.15.62:0/2744250032 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:09.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1ada59c640 1 --2- 172.21.15.62:0/2744250032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1adc070790 0x7f1adc0bcf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:09.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1adb59e640 1 --2- 172.21.15.62:0/2744250032 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1adc0b9030 0x7f1adc136fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:09.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1adad9d640 1 -- 172.21.15.62:0/2744250032 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1adc0b9030 msgr2=0x7f1adc136fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:09.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1adad9d640 1 --2- 172.21.15.62:0/2744250032 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1adc0b9030 0x7f1adc136fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:09.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1adad9d640 1 -- 172.21.15.62:0/2744250032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1adc070790 msgr2=0x7f1adc0bcf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:09.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1adad9d640 1 --2- 172.21.15.62:0/2744250032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1adc070790 0x7f1adc0bcf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:09.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1adad9d640 1 -- 172.21.15.62:0/2744250032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad0009420 con 0x7f1adc06b8c0 2023-05-15T16:40:09.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1ada59c640 1 --2- 172.21.15.62:0/2744250032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1adc070790 0x7f1adc0bcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:09.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1adad9d640 1 --2- 172.21.15.62:0/2744250032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1adc06b8c0 0x7f1adc1e2860 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1ad00ae040 tx=0x7f1ad0019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1ac37fe640 1 -- 172.21.15.62:0/2744250032 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad00b4840 con 0x7f1adc06b8c0 2023-05-15T16:40:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1ac37fe640 1 -- 172.21.15.62:0/2744250032 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ad00b49c0 con 0x7f1adc06b8c0 2023-05-15T16:40:09.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1ae111b640 1 -- 172.21.15.62:0/2744250032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1adc144100 con 0x7f1adc06b8c0 2023-05-15T16:40:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1ac37fe640 1 -- 172.21.15.62:0/2744250032 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ad00b4d70 con 0x7f1adc06b8c0 2023-05-15T16:40:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1ae111b640 1 -- 172.21.15.62:0/2744250032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1adc0b87b0 con 0x7f1adc06b8c0 2023-05-15T16:40:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.775+0000 7f1ae111b640 1 -- 172.21.15.62:0/2744250032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1adc156eb0 con 0x7f1adc06b8c0 2023-05-15T16:40:09.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.779+0000 7f1ac37fe640 1 -- 172.21.15.62:0/2744250032 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f1ad00b2040 con 0x7f1adc06b8c0 2023-05-15T16:40:09.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.779+0000 7f1ac37fe640 1 --2- 172.21.15.62:0/2744250032 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1ac8065380 0x7f1ac8067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:09.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.779+0000 7f1ac37fe640 1 -- 172.21.15.62:0/2744250032 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1ad011ccb0 con 0x7f1adc06b8c0 2023-05-15T16:40:09.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.779+0000 7f1ada59c640 1 --2- 172.21.15.62:0/2744250032 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1ac8065380 0x7f1ac8067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:09.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.779+0000 7f1ada59c640 1 --2- 172.21.15.62:0/2744250032 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1ac8065380 0x7f1ac8067830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1adc1e25d0 tx=0x7f1acc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:09.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.783+0000 7f1ac37fe640 1 -- 172.21.15.62:0/2744250032 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f1ad00ea930 con 0x7f1adc06b8c0 2023-05-15T16:40:09.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.971+0000 7f1ae111b640 1 -- 172.21.15.62:0/2744250032 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1adc04dc30 con 0x7f1adc06b8c0 2023-05-15T16:40:09.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.979+0000 7f1ac37fe640 1 -- 172.21.15.62:0/2744250032 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+162148 (secure 0 0 0) 0x7f1ad00b0090 con 0x7f1adc06b8c0 2023-05-15T16:40:09.986 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:09.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.983+0000 7f1ae111b640 1 -- 172.21.15.62:0/2744250032 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1ac8065380 msgr2=0x7f1ac8067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:09.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.983+0000 7f1ae111b640 1 --2- 172.21.15.62:0/2744250032 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1ac8065380 0x7f1ac8067830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f1adc1e25d0 tx=0x7f1acc009040 comp rx=0 tx=0).stop 2023-05-15T16:40:09.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.983+0000 7f1ae111b640 1 -- 172.21.15.62:0/2744250032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1adc06b8c0 msgr2=0x7f1adc1e2860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:09.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.983+0000 7f1ae111b640 1 --2- 172.21.15.62:0/2744250032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1adc06b8c0 0x7f1adc1e2860 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f1ad00ae040 tx=0x7f1ad0019200 comp rx=0 tx=0).stop 2023-05-15T16:40:09.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.983+0000 7f1ae111b640 1 -- 172.21.15.62:0/2744250032 shutdown_connections 2023-05-15T16:40:09.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.983+0000 7f1ae111b640 1 --2- 172.21.15.62:0/2744250032 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1adc0b9030 0x7f1adc136fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:09.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.983+0000 7f1ae111b640 1 --2- 172.21.15.62:0/2744250032 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1adc070790 0x7f1adc0bcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:09.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.983+0000 7f1ae111b640 1 --2- 172.21.15.62:0/2744250032 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1ac8065380 0x7f1ac8067830 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:09.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.983+0000 7f1ae111b640 1 --2- 172.21.15.62:0/2744250032 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1adc06b8c0 0x7f1adc1e2860 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:09.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.983+0000 7f1ae111b640 1 -- 172.21.15.62:0/2744250032 >> 172.21.15.62:0/2744250032 conn(0x7f1adc0ba820 msgr2=0x7f1adc13d910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:09.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.983+0000 7f1ae111b640 1 -- 172.21.15.62:0/2744250032 shutdown_connections 2023-05-15T16:40:09.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:09.983+0000 7f1ae111b640 1 -- 172.21.15.62:0/2744250032 wait complete. 2023-05-15T16:40:10.003 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":5,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6832","nonce":37541},{"type":"v1","addr":"172.21.15.161:6833","nonce":37541}]},"active_addr":"172.21.15.161:6833/37541","active_change":"2023-05-15T16:39:41.300403+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_password":{"name":"alertmanager_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web password","long_desc":"","tags":[],"see_also":[]},"alertmanager_web_user":{"name":"alertmanager_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Alertmanager web user","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"prometheus_web_password":{"name":"prometheus_web_password","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web password","long_desc":"","tags":[],"see_also":[]},"prometheus_web_user":{"name":"prometheus_web_user","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"Prometheus web user","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":3370100768}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":2341388881}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":1094624965}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.161:0","nonce":2177412748}]}]} 2023-05-15T16:40:10.008 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-05-15T16:40:10.008 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-05-15T16:40:10.009 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-15T16:40:10.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.115+0000 7f9dd4c6a640 1 Processor -- start 2023-05-15T16:40:10.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.115+0000 7f9dd4c6a640 1 -- start start 2023-05-15T16:40:10.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dd4c6a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9dd00bcd90 0x7f9dd014a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dd4c6a640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd0149c50 con 0x7f9dd00ba900 2023-05-15T16:40:10.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dd4c6a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dd006aca0 con 0x7f9dd006b050 2023-05-15T16:40:10.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dd4c6a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dd006b530 con 0x7f9dd00bcd90 2023-05-15T16:40:10.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dced9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9dd00ba900 0x7f9dd014d860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37826/0 (socket says 172.21.15.62:37826) 2023-05-15T16:40:10.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dced9d640 1 -- 172.21.15.62:0/676035377 learned_addr learned my addr 172.21.15.62:0/676035377 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:10.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dce59c640 1 --2- 172.21.15.62:0/676035377 >> v2:172.21.15.161:3300/0 conn(0x7f9dd00bcd90 0x7f9dd014a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dcd59a640 1 -- 172.21.15.62:0/676035377 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2993368689 0 0) 0x7f9dd0149c50 con 0x7f9dd00ba900 2023-05-15T16:40:10.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dcd59a640 1 -- 172.21.15.62:0/676035377 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9db8003530 con 0x7f9dd00ba900 2023-05-15T16:40:10.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dcd59a640 1 -- 172.21.15.62:0/676035377 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 431577848 0 0) 0x7f9db8003530 con 0x7f9dd00ba900 2023-05-15T16:40:10.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dcd59a640 1 -- 172.21.15.62:0/676035377 >> v2:172.21.15.161:3300/0 conn(0x7f9dd00bcd90 msgr2=0x7f9dd014a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:10.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dcd59a640 1 --2- 172.21.15.62:0/676035377 >> v2:172.21.15.161:3300/0 conn(0x7f9dd00bcd90 0x7f9dd014a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dcd59a640 1 -- 172.21.15.62:0/676035377 >> v1:172.21.15.161:6789/0 conn(0x7f9dd006b050 legacy=0x7f9dd014d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dcd59a640 1 -- 172.21.15.62:0/676035377 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd006b810 con 0x7f9dd00ba900 2023-05-15T16:40:10.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dcd59a640 1 -- 172.21.15.62:0/676035377 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7f9dc8001a00 con 0x7f9dd00ba900 2023-05-15T16:40:10.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dcd59a640 1 -- 172.21.15.62:0/676035377 >> v1:172.21.15.62:6789/0 conn(0x7f9dd00ba900 legacy=0x7f9dd014d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dcd59a640 1 --2- 172.21.15.62:0/676035377 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9db8003980 0x7f9db8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dcd59a640 1 --2- 172.21.15.62:0/676035377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9db80047d0 0x7f9db8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dcd59a640 1 --2- 172.21.15.62:0/676035377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9db8005180 0x7f9db800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dcd59a640 1 -- 172.21.15.62:0/676035377 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd006b530 con 0x7f9db8005180 2023-05-15T16:40:10.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dcd59a640 1 -- 172.21.15.62:0/676035377 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9db800c110 con 0x7f9db80047d0 2023-05-15T16:40:10.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dcd59a640 1 -- 172.21.15.62:0/676035377 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9db800c2d0 con 0x7f9db8003980 2023-05-15T16:40:10.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dced9d640 1 --2- 172.21.15.62:0/676035377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9db8005180 0x7f9db800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dcdd9b640 1 --2- 172.21.15.62:0/676035377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9db80047d0 0x7f9db8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dce59c640 1 --2- 172.21.15.62:0/676035377 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9db8003980 0x7f9db8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dced9d640 1 -- 172.21.15.62:0/676035377 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9db8003980 msgr2=0x7f9db8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:10.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dced9d640 1 --2- 172.21.15.62:0/676035377 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9db8003980 0x7f9db8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dced9d640 1 -- 172.21.15.62:0/676035377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9db80047d0 msgr2=0x7f9db8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:10.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dced9d640 1 --2- 172.21.15.62:0/676035377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9db80047d0 0x7f9db8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dced9d640 1 -- 172.21.15.62:0/676035377 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db8003530 con 0x7f9db8005180 2023-05-15T16:40:10.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dcdd9b640 1 --2- 172.21.15.62:0/676035377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9db80047d0 0x7f9db8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-15T16:40:10.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dced9d640 1 -- 172.21.15.62:0/676035377 reap_dead start 2023-05-15T16:40:10.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.119+0000 7f9dced9d640 1 --2- 172.21.15.62:0/676035377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9db8005180 0x7f9db800b990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800a800 tx=0x7f9dc801d300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d544a2a5c8be69 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dcd59a640 1 -- 172.21.15.62:0/676035377 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc80072d0 con 0x7f9db8005180 2023-05-15T16:40:10.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dcd59a640 1 -- 172.21.15.62:0/676035377 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc80a8070 con 0x7f9db8005180 2023-05-15T16:40:10.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dcd59a640 1 -- 172.21.15.62:0/676035377 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc8007670 con 0x7f9db8005180 2023-05-15T16:40:10.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dd4c6a640 1 -- 172.21.15.62:0/676035377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9db8005180 msgr2=0x7f9db800b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dd4c6a640 1 --2- 172.21.15.62:0/676035377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9db8005180 0x7f9db800b990 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9dc800a800 tx=0x7f9dc801d300 comp rx=0 tx=0).stop 2023-05-15T16:40:10.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dd4c6a640 1 -- 172.21.15.62:0/676035377 shutdown_connections 2023-05-15T16:40:10.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dd4c6a640 1 --2- 172.21.15.62:0/676035377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9db8005180 0x7f9db800b990 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dd4c6a640 1 -- 172.21.15.62:0/676035377 >> 172.21.15.62:0/676035377 conn(0x7f9dd00bff80 msgr2=0x7f9dd00c0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dd4c6a640 1 -- 172.21.15.62:0/676035377 shutdown_connections 2023-05-15T16:40:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dd4c6a640 1 -- 172.21.15.62:0/676035377 wait complete. 2023-05-15T16:40:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dd4c6a640 1 Processor -- start 2023-05-15T16:40:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dd4c6a640 1 -- start start 2023-05-15T16:40:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dd4c6a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9db8005180 0x7f9dd01492f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dd4c6a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dd00a44e0 0x7f9dd00b1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dd4c6a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9dd00a4930 0x7f9dd00b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dd4c6a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd00b22b0 con 0x7f9dd00a44e0 2023-05-15T16:40:10.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dd4c6a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd014a910 con 0x7f9db8005180 2023-05-15T16:40:10.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dd4c6a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dd00b7280 con 0x7f9dd00a4930 2023-05-15T16:40:10.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dcdd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dd00a44e0 0x7f9dd00b1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dcdd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dd00a44e0 0x7f9dd00b1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42632/0 (socket says 172.21.15.62:42632) 2023-05-15T16:40:10.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dcdd9b640 1 -- 172.21.15.62:0/2785871566 learned_addr learned my addr 172.21.15.62:0/2785871566 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:10.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dce59c640 1 --2- 172.21.15.62:0/2785871566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9db8005180 0x7f9dd01492f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dcdd9b640 1 -- 172.21.15.62:0/2785871566 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9dd00a4930 msgr2=0x7f9dd00b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dced9d640 1 --2- 172.21.15.62:0/2785871566 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9dd00a4930 0x7f9dd00b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dcdd9b640 1 --2- 172.21.15.62:0/2785871566 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9dd00a4930 0x7f9dd00b1d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dcdd9b640 1 -- 172.21.15.62:0/2785871566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9db8005180 msgr2=0x7f9dd01492f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dcdd9b640 1 --2- 172.21.15.62:0/2785871566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9db8005180 0x7f9dd01492f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dcdd9b640 1 -- 172.21.15.62:0/2785871566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd01475d0 con 0x7f9dd00a44e0 2023-05-15T16:40:10.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dcdd9b640 1 --2- 172.21.15.62:0/2785871566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dd00a44e0 0x7f9dd00b1830 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4000c10 tx=0x7f9dc400e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dbeffd640 1 -- 172.21.15.62:0/2785871566 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc40052e0 con 0x7f9dd00a44e0 2023-05-15T16:40:10.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dbeffd640 1 -- 172.21.15.62:0/2785871566 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dc4005440 con 0x7f9dd00a44e0 2023-05-15T16:40:10.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dd4c6a640 1 -- 172.21.15.62:0/2785871566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dd006baf0 con 0x7f9dd00a44e0 2023-05-15T16:40:10.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dbeffd640 1 -- 172.21.15.62:0/2785871566 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4003820 con 0x7f9dd00a44e0 2023-05-15T16:40:10.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.123+0000 7f9dd4c6a640 1 -- 172.21.15.62:0/2785871566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dd009f5f0 con 0x7f9dd00a44e0 2023-05-15T16:40:10.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.127+0000 7f9dd4c6a640 1 -- 172.21.15.62:0/2785871566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9dd0067960 con 0x7f9dd00a44e0 2023-05-15T16:40:10.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.127+0000 7f9dbeffd640 1 -- 172.21.15.62:0/2785871566 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f9dc4003980 con 0x7f9dd00a44e0 2023-05-15T16:40:10.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.127+0000 7f9dbeffd640 1 --2- 172.21.15.62:0/2785871566 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9db0065380 0x7f9db0067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.127+0000 7f9dbeffd640 1 -- 172.21.15.62:0/2785871566 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9dc4081ea0 con 0x7f9dd00a44e0 2023-05-15T16:40:10.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.127+0000 7f9dce59c640 1 --2- 172.21.15.62:0/2785871566 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9db0065380 0x7f9db0067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.127+0000 7f9dce59c640 1 --2- 172.21.15.62:0/2785871566 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9db0065380 0x7f9db0067830 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000e7c0 tx=0x7f9dc0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.131+0000 7f9dbeffd640 1 -- 172.21.15.62:0/2785871566 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f9dc404c620 con 0x7f9dd00a44e0 2023-05-15T16:40:10.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.283+0000 7f9dd4c6a640 1 -- 172.21.15.62:0/2785871566 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9dd004dbe0 con 0x7f9dd00a44e0 2023-05-15T16:40:10.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.287+0000 7f9dbeffd640 1 -- 172.21.15.62:0/2785871566 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17811 (secure 0 0 0) 0x7f9dc4019090 con 0x7f9dd00a44e0 2023-05-15T16:40:10.290 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:10.290 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:40:02.088078+0000","last_up_change":"2023-05-15T16:39:48.597049+0000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-15T16:39:49.394028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-15T16:39:55.208679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-15T16:39:59.547414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-15T16:40:00.055526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37594},{"type":"v1","addr":"172.21.15.62:6825","nonce":37594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37594},{"type":"v1","addr":"172.21.15.62:6827","nonce":37594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37594},{"type":"v1","addr":"172.21.15.62:6831","nonce":37594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37594},{"type":"v1","addr":"172.21.15.62:6829","nonce":37594}]},"public_addr":"172.21.15.62:6825/37594","cluster_addr":"172.21.15.62:6827/37594","heartbeat_back_addr":"172.21.15.62:6831/37594","heartbeat_front_addr":"172.21.15.62:6829/37594","state":["exists","up"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37592},{"type":"v1","addr":"172.21.15.62:6808","nonce":37592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":37592},{"type":"v1","addr":"172.21.15.62:6814","nonce":37592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6821","nonce":37592},{"type":"v1","addr":"172.21.15.62:6823","nonce":37592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37592},{"type":"v1","addr":"172.21.15.62:6818","nonce":37592}]},"public_addr":"172.21.15.62:6808/37592","cluster_addr":"172.21.15.62:6814/37592","heartbeat_back_addr":"172.21.15.62:6823/37592","heartbeat_front_addr":"172.21.15.62:6818/37592","state":["exists","up"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":37591},{"type":"v1","addr":"172.21.15.62:6810","nonce":37591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":37591},{"type":"v1","addr":"172.21.15.62:6815","nonce":37591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37591},{"type":"v1","addr":"172.21.15.62:6822","nonce":37591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":37591},{"type":"v1","addr":"172.21.15.62:6819","nonce":37591}]},"public_addr":"172.21.15.62:6810/37591","cluster_addr":"172.21.15.62:6815/37591","heartbeat_back_addr":"172.21.15.62:6822/37591","heartbeat_front_addr":"172.21.15.62:6819/37591","state":["exists","up"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37593},{"type":"v1","addr":"172.21.15.62:6801","nonce":37593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37593},{"type":"v1","addr":"172.21.15.62:6803","nonce":37593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":37593},{"type":"v1","addr":"172.21.15.62:6812","nonce":37593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37593},{"type":"v1","addr":"172.21.15.62:6805","nonce":37593}]},"public_addr":"172.21.15.62:6801/37593","cluster_addr":"172.21.15.62:6803/37593","heartbeat_back_addr":"172.21.15.62:6812/37593","heartbeat_front_addr":"172.21.15.62:6805/37593","state":["exists","up"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37854},{"type":"v1","addr":"172.21.15.161:6801","nonce":37854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37854},{"type":"v1","addr":"172.21.15.161:6803","nonce":37854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37854},{"type":"v1","addr":"172.21.15.161:6807","nonce":37854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37854},{"type":"v1","addr":"172.21.15.161:6805","nonce":37854}]},"public_addr":"172.21.15.161:6801/37854","cluster_addr":"172.21.15.161:6803/37854","heartbeat_back_addr":"172.21.15.161:6807/37854","heartbeat_front_addr":"172.21.15.161:6805/37854","state":["exists","up"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37855},{"type":"v1","addr":"172.21.15.161:6810","nonce":37855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37855},{"type":"v1","addr":"172.21.15.161:6815","nonce":37855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37855},{"type":"v1","addr":"172.21.15.161:6824","nonce":37855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37855},{"type":"v1","addr":"172.21.15.161:6820","nonce":37855}]},"public_addr":"172.21.15.161:6810/37855","cluster_addr":"172.21.15.161:6815/37855","heartbeat_back_addr":"172.21.15.161:6824/37855","heartbeat_front_addr":"172.21.15.161:6820/37855","state":["exists","up"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":37856},{"type":"v1","addr":"172.21.15.161:6814","nonce":37856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37856},{"type":"v1","addr":"172.21.15.161:6819","nonce":37856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":37856},{"type":"v1","addr":"172.21.15.161:6830","nonce":37856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37856},{"type":"v1","addr":"172.21.15.161:6826","nonce":37856}]},"public_addr":"172.21.15.161:6814/37856","cluster_addr":"172.21.15.161:6819/37856","heartbeat_back_addr":"172.21.15.161:6830/37856","heartbeat_front_addr":"172.21.15.161:6826/37856","state":["exists","up"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":37857},{"type":"v1","addr":"172.21.15.161:6813","nonce":37857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":37857},{"type":"v1","addr":"172.21.15.161:6821","nonce":37857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":37857},{"type":"v1","addr":"172.21.15.161:6831","nonce":37857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":37857},{"type":"v1","addr":"172.21.15.161:6827","nonce":37857}]},"public_addr":"172.21.15.161:6813/37857","cluster_addr":"172.21.15.161:6821/37857","heartbeat_back_addr":"172.21.15.161:6831/37857","heartbeat_front_addr":"172.21.15.161:6827/37857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.592907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.618143+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.641533+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.614355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.579293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.718353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.730135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.792887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:40:10.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.287+0000 7f9dd4c6a640 1 -- 172.21.15.62:0/2785871566 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9db0065380 msgr2=0x7f9db0067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.287+0000 7f9dd4c6a640 1 --2- 172.21.15.62:0/2785871566 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9db0065380 0x7f9db0067830 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9dc000e7c0 tx=0x7f9dc0008040 comp rx=0 tx=0).stop 2023-05-15T16:40:10.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.287+0000 7f9dd4c6a640 1 -- 172.21.15.62:0/2785871566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dd00a44e0 msgr2=0x7f9dd00b1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.287+0000 7f9dd4c6a640 1 --2- 172.21.15.62:0/2785871566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dd00a44e0 0x7f9dd00b1830 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9dc4000c10 tx=0x7f9dc400e820 comp rx=0 tx=0).stop 2023-05-15T16:40:10.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.287+0000 7f9dd4c6a640 1 -- 172.21.15.62:0/2785871566 shutdown_connections 2023-05-15T16:40:10.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.287+0000 7f9dd4c6a640 1 --2- 172.21.15.62:0/2785871566 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9dd00a4930 0x7f9dd00b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.287+0000 7f9dd4c6a640 1 --2- 172.21.15.62:0/2785871566 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9db0065380 0x7f9db0067830 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.287+0000 7f9dd4c6a640 1 --2- 172.21.15.62:0/2785871566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9dd00a44e0 0x7f9dd00b1830 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.287+0000 7f9dd4c6a640 1 --2- 172.21.15.62:0/2785871566 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9db8005180 0x7f9dd01492f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.287+0000 7f9dd4c6a640 1 -- 172.21.15.62:0/2785871566 >> 172.21.15.62:0/2785871566 conn(0x7f9dd00bff80 msgr2=0x7f9dd00bdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:10.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.287+0000 7f9dd4c6a640 1 -- 172.21.15.62:0/2785871566 shutdown_connections 2023-05-15T16:40:10.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.287+0000 7f9dd4c6a640 1 -- 172.21.15.62:0/2785871566 wait complete. 2023-05-15T16:40:10.309 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-05-15T16:40:10.310 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-15T16:40:10.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.419+0000 7f8f750b7640 1 Processor -- start 2023-05-15T16:40:10.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.419+0000 7f8f750b7640 1 -- start start 2023-05-15T16:40:10.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.423+0000 7f8f750b7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8f701450d0 0x7f8f700ba030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.423+0000 7f8f750b7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8f70147af0 0x7f8f700705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.423+0000 7f8f750b7640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f70148950 con 0x7f8f700b8950 2023-05-15T16:40:10.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.423+0000 7f8f750b7640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f700b5570 con 0x7f8f701450d0 2023-05-15T16:40:10.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.423+0000 7f8f750b7640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f70148020 con 0x7f8f70147af0 2023-05-15T16:40:10.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.423+0000 7f8f6ed9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8f701450d0 0x7f8f700ba030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.423+0000 7f8f6ed9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8f701450d0 0x7f8f700ba030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42648/0 (socket says 172.21.15.62:42648) 2023-05-15T16:40:10.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.423+0000 7f8f6ed9d640 1 -- 172.21.15.62:0/34595100 learned_addr learned my addr 172.21.15.62:0/34595100 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:10.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.423+0000 7f8f6e59c640 1 --2- 172.21.15.62:0/34595100 >> v2:172.21.15.161:3300/0 conn(0x7f8f70147af0 0x7f8f700705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.423+0000 7f8f6ed9d640 1 -- 172.21.15.62:0/34595100 >> v2:172.21.15.161:3300/0 conn(0x7f8f70147af0 msgr2=0x7f8f700705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:10.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.423+0000 7f8f6ed9d640 1 --2- 172.21.15.62:0/34595100 >> v2:172.21.15.161:3300/0 conn(0x7f8f70147af0 0x7f8f700705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.423+0000 7f8f6ed9d640 1 -- 172.21.15.62:0/34595100 >> v1:172.21.15.161:6789/0 conn(0x7f8f700b8950 legacy=0x7f8f700b8dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:10.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.423+0000 7f8f6ed9d640 1 -- 172.21.15.62:0/34595100 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f70148300 con 0x7f8f701450d0 2023-05-15T16:40:10.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.423+0000 7f8f6ed9d640 1 --2- 172.21.15.62:0/34595100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f701450d0 0x7f8f700ba030 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8f700bb9a0 tx=0x7f8f6401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e0f932988d123c2 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.423+0000 7f8f6dd9b640 1 -- 172.21.15.62:0/34595100 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f640ac620 con 0x7f8f701450d0 2023-05-15T16:40:10.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.423+0000 7f8f6dd9b640 1 -- 172.21.15.62:0/34595100 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f640ac780 con 0x7f8f701450d0 2023-05-15T16:40:10.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.423+0000 7f8f6dd9b640 1 -- 172.21.15.62:0/34595100 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f640acb10 con 0x7f8f701450d0 2023-05-15T16:40:10.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f750b7640 1 -- 172.21.15.62:0/34595100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f701450d0 msgr2=0x7f8f700ba030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f750b7640 1 --2- 172.21.15.62:0/34595100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f701450d0 0x7f8f700ba030 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8f700bb9a0 tx=0x7f8f6401c400 comp rx=0 tx=0).stop 2023-05-15T16:40:10.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f750b7640 1 -- 172.21.15.62:0/34595100 shutdown_connections 2023-05-15T16:40:10.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f750b7640 1 --2- 172.21.15.62:0/34595100 >> v2:172.21.15.161:3300/0 conn(0x7f8f70147af0 0x7f8f700705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f750b7640 1 --2- 172.21.15.62:0/34595100 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f701450d0 0x7f8f700ba030 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f750b7640 1 -- 172.21.15.62:0/34595100 >> 172.21.15.62:0/34595100 conn(0x7f8f700bde20 msgr2=0x7f8f700be220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:10.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f750b7640 1 -- 172.21.15.62:0/34595100 shutdown_connections 2023-05-15T16:40:10.431 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f750b7640 1 -- 172.21.15.62:0/34595100 wait complete. 2023-05-15T16:40:10.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f750b7640 1 Processor -- start 2023-05-15T16:40:10.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f750b7640 1 -- start start 2023-05-15T16:40:10.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f750b7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f700b8950 0x7f8f70143370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f750b7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f701450d0 0x7f8f701e0220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f750b7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f70147af0 0x7f8f701e0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f750b7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f701438b0 con 0x7f8f700b8950 2023-05-15T16:40:10.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f750b7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f701dfda0 con 0x7f8f70147af0 2023-05-15T16:40:10.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f750b7640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f700b4c50 con 0x7f8f701450d0 2023-05-15T16:40:10.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f6ed9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f700b8950 0x7f8f70143370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f6ed9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f700b8950 0x7f8f70143370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42652/0 (socket says 172.21.15.62:42652) 2023-05-15T16:40:10.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f6ed9d640 1 -- 172.21.15.62:0/1989136950 learned_addr learned my addr 172.21.15.62:0/1989136950 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:10.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f6ed9d640 1 -- 172.21.15.62:0/1989136950 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f701450d0 msgr2=0x7f8f701e0220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f6e59c640 1 --2- 172.21.15.62:0/1989136950 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f701450d0 0x7f8f701e0220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f6ed9d640 1 --2- 172.21.15.62:0/1989136950 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f701450d0 0x7f8f701e0220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f6ed9d640 1 -- 172.21.15.62:0/1989136950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f70147af0 msgr2=0x7f8f701e0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f6f59e640 1 --2- 172.21.15.62:0/1989136950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f70147af0 0x7f8f701e0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f6ed9d640 1 --2- 172.21.15.62:0/1989136950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f70147af0 0x7f8f701e0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f6ed9d640 1 -- 172.21.15.62:0/1989136950 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f640094d0 con 0x7f8f700b8950 2023-05-15T16:40:10.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f6ed9d640 1 --2- 172.21.15.62:0/1989136950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f700b8950 0x7f8f70143370 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8f6401aab0 tx=0x7f8f6401ac40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f577fe640 1 -- 172.21.15.62:0/1989136950 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f640b7620 con 0x7f8f700b8950 2023-05-15T16:40:10.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f577fe640 1 -- 172.21.15.62:0/1989136950 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f640b77a0 con 0x7f8f700b8950 2023-05-15T16:40:10.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f750b7640 1 -- 172.21.15.62:0/1989136950 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f70070b00 con 0x7f8f700b8950 2023-05-15T16:40:10.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f577fe640 1 -- 172.21.15.62:0/1989136950 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f640b7b50 con 0x7f8f700b8950 2023-05-15T16:40:10.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f750b7640 1 -- 172.21.15.62:0/1989136950 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f701454a0 con 0x7f8f700b8950 2023-05-15T16:40:10.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.427+0000 7f8f750b7640 1 -- 172.21.15.62:0/1989136950 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f70070c90 con 0x7f8f700b8950 2023-05-15T16:40:10.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.431+0000 7f8f577fe640 1 -- 172.21.15.62:0/1989136950 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f8f640b3040 con 0x7f8f700b8950 2023-05-15T16:40:10.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.431+0000 7f8f577fe640 1 --2- 172.21.15.62:0/1989136950 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8f5c065380 0x7f8f5c067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.431+0000 7f8f577fe640 1 -- 172.21.15.62:0/1989136950 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8f6411cf30 con 0x7f8f700b8950 2023-05-15T16:40:10.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.431+0000 7f8f6e59c640 1 --2- 172.21.15.62:0/1989136950 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8f5c065380 0x7f8f5c067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.431+0000 7f8f6e59c640 1 --2- 172.21.15.62:0/1989136950 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8f5c065380 0x7f8f5c067830 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8f700be540 tx=0x7f8f6000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.435+0000 7f8f577fe640 1 -- 172.21.15.62:0/1989136950 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f8f640eabb0 con 0x7f8f700b8950 2023-05-15T16:40:10.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.591+0000 7f8f750b7640 1 -- 172.21.15.62:0/1989136950 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8f70067960 con 0x7f8f700b8950 2023-05-15T16:40:10.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.591+0000 7f8f577fe640 1 -- 172.21.15.62:0/1989136950 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17811 (secure 0 0 0) 0x7f8f640ee1d0 con 0x7f8f700b8950 2023-05-15T16:40:10.598 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:10.598 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:40:02.088078+0000","last_up_change":"2023-05-15T16:39:48.597049+0000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-15T16:39:49.394028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-15T16:39:55.208679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-15T16:39:59.547414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-15T16:40:00.055526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37594},{"type":"v1","addr":"172.21.15.62:6825","nonce":37594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37594},{"type":"v1","addr":"172.21.15.62:6827","nonce":37594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37594},{"type":"v1","addr":"172.21.15.62:6831","nonce":37594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37594},{"type":"v1","addr":"172.21.15.62:6829","nonce":37594}]},"public_addr":"172.21.15.62:6825/37594","cluster_addr":"172.21.15.62:6827/37594","heartbeat_back_addr":"172.21.15.62:6831/37594","heartbeat_front_addr":"172.21.15.62:6829/37594","state":["exists","up"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37592},{"type":"v1","addr":"172.21.15.62:6808","nonce":37592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":37592},{"type":"v1","addr":"172.21.15.62:6814","nonce":37592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6821","nonce":37592},{"type":"v1","addr":"172.21.15.62:6823","nonce":37592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37592},{"type":"v1","addr":"172.21.15.62:6818","nonce":37592}]},"public_addr":"172.21.15.62:6808/37592","cluster_addr":"172.21.15.62:6814/37592","heartbeat_back_addr":"172.21.15.62:6823/37592","heartbeat_front_addr":"172.21.15.62:6818/37592","state":["exists","up"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":37591},{"type":"v1","addr":"172.21.15.62:6810","nonce":37591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":37591},{"type":"v1","addr":"172.21.15.62:6815","nonce":37591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37591},{"type":"v1","addr":"172.21.15.62:6822","nonce":37591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":37591},{"type":"v1","addr":"172.21.15.62:6819","nonce":37591}]},"public_addr":"172.21.15.62:6810/37591","cluster_addr":"172.21.15.62:6815/37591","heartbeat_back_addr":"172.21.15.62:6822/37591","heartbeat_front_addr":"172.21.15.62:6819/37591","state":["exists","up"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37593},{"type":"v1","addr":"172.21.15.62:6801","nonce":37593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37593},{"type":"v1","addr":"172.21.15.62:6803","nonce":37593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":37593},{"type":"v1","addr":"172.21.15.62:6812","nonce":37593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37593},{"type":"v1","addr":"172.21.15.62:6805","nonce":37593}]},"public_addr":"172.21.15.62:6801/37593","cluster_addr":"172.21.15.62:6803/37593","heartbeat_back_addr":"172.21.15.62:6812/37593","heartbeat_front_addr":"172.21.15.62:6805/37593","state":["exists","up"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37854},{"type":"v1","addr":"172.21.15.161:6801","nonce":37854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37854},{"type":"v1","addr":"172.21.15.161:6803","nonce":37854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37854},{"type":"v1","addr":"172.21.15.161:6807","nonce":37854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37854},{"type":"v1","addr":"172.21.15.161:6805","nonce":37854}]},"public_addr":"172.21.15.161:6801/37854","cluster_addr":"172.21.15.161:6803/37854","heartbeat_back_addr":"172.21.15.161:6807/37854","heartbeat_front_addr":"172.21.15.161:6805/37854","state":["exists","up"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37855},{"type":"v1","addr":"172.21.15.161:6810","nonce":37855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37855},{"type":"v1","addr":"172.21.15.161:6815","nonce":37855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37855},{"type":"v1","addr":"172.21.15.161:6824","nonce":37855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37855},{"type":"v1","addr":"172.21.15.161:6820","nonce":37855}]},"public_addr":"172.21.15.161:6810/37855","cluster_addr":"172.21.15.161:6815/37855","heartbeat_back_addr":"172.21.15.161:6824/37855","heartbeat_front_addr":"172.21.15.161:6820/37855","state":["exists","up"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":37856},{"type":"v1","addr":"172.21.15.161:6814","nonce":37856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37856},{"type":"v1","addr":"172.21.15.161:6819","nonce":37856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":37856},{"type":"v1","addr":"172.21.15.161:6830","nonce":37856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37856},{"type":"v1","addr":"172.21.15.161:6826","nonce":37856}]},"public_addr":"172.21.15.161:6814/37856","cluster_addr":"172.21.15.161:6819/37856","heartbeat_back_addr":"172.21.15.161:6830/37856","heartbeat_front_addr":"172.21.15.161:6826/37856","state":["exists","up"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":37857},{"type":"v1","addr":"172.21.15.161:6813","nonce":37857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":37857},{"type":"v1","addr":"172.21.15.161:6821","nonce":37857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":37857},{"type":"v1","addr":"172.21.15.161:6831","nonce":37857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":37857},{"type":"v1","addr":"172.21.15.161:6827","nonce":37857}]},"public_addr":"172.21.15.161:6813/37857","cluster_addr":"172.21.15.161:6821/37857","heartbeat_back_addr":"172.21.15.161:6831/37857","heartbeat_front_addr":"172.21.15.161:6827/37857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.592907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.618143+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.641533+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.614355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.579293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.718353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.730135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.792887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:40:10.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.595+0000 7f8f750b7640 1 -- 172.21.15.62:0/1989136950 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8f5c065380 msgr2=0x7f8f5c067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.595+0000 7f8f750b7640 1 --2- 172.21.15.62:0/1989136950 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8f5c065380 0x7f8f5c067830 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8f700be540 tx=0x7f8f6000b040 comp rx=0 tx=0).stop 2023-05-15T16:40:10.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.595+0000 7f8f750b7640 1 -- 172.21.15.62:0/1989136950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f700b8950 msgr2=0x7f8f70143370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.595+0000 7f8f750b7640 1 --2- 172.21.15.62:0/1989136950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f700b8950 0x7f8f70143370 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8f6401aab0 tx=0x7f8f6401ac40 comp rx=0 tx=0).stop 2023-05-15T16:40:10.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.595+0000 7f8f750b7640 1 -- 172.21.15.62:0/1989136950 shutdown_connections 2023-05-15T16:40:10.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.595+0000 7f8f750b7640 1 --2- 172.21.15.62:0/1989136950 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f70147af0 0x7f8f701e0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.595+0000 7f8f750b7640 1 --2- 172.21.15.62:0/1989136950 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f701450d0 0x7f8f701e0220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.595+0000 7f8f750b7640 1 --2- 172.21.15.62:0/1989136950 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8f5c065380 0x7f8f5c067830 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.595+0000 7f8f750b7640 1 --2- 172.21.15.62:0/1989136950 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f700b8950 0x7f8f70143370 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.595+0000 7f8f750b7640 1 -- 172.21.15.62:0/1989136950 >> 172.21.15.62:0/1989136950 conn(0x7f8f700bde20 msgr2=0x7f8f701441e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:10.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.595+0000 7f8f750b7640 1 -- 172.21.15.62:0/1989136950 shutdown_connections 2023-05-15T16:40:10.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.595+0000 7f8f750b7640 1 -- 172.21.15.62:0/1989136950 wait complete. 2023-05-15T16:40:10.617 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-05-15T16:40:10.619 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-05-15T16:40:10.620 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-05-15T16:40:10.620 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-05-15T16:40:10.621 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-05-15T16:40:10.621 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-05-15T16:40:10.622 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-05-15T16:40:10.622 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-05-15T16:40:10.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.795+0000 7febc55ca640 1 Processor -- start 2023-05-15T16:40:10.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.795+0000 7febc55ca640 1 -- start start 2023-05-15T16:40:10.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febc55ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febb803e970 0x7febb80d8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febc55ca640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb80cd8c0 con 0x7febb8039900 2023-05-15T16:40:10.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbf7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7febb8039900 0x7febb80c72a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37838/0 (socket says 172.21.15.62:37838) 2023-05-15T16:40:10.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbf7fe640 1 -- 172.21.15.62:0/880898114 learned_addr learned my addr 172.21.15.62:0/880898114 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:10.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febc55ca640 1 -- 172.21.15.62:0/880898114 --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb803bae0 con 0x7febb803f8f0 2023-05-15T16:40:10.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7f2b0359e640 1 Processor -- start 2023-05-15T16:40:10.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febc55ca640 1 -- 172.21.15.62:0/880898114 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb803c970 con 0x7febb803e970 2023-05-15T16:40:10.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febc4dc9640 1 --2- 172.21.15.62:0/880898114 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febb803e970 0x7febb80d8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbeffd640 1 -- 172.21.15.62:0/880898114 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1707458060 0 0) 0x7febb80cd8c0 con 0x7febb8039900 2023-05-15T16:40:10.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbeffd640 1 -- 172.21.15.62:0/880898114 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febb0003530 con 0x7febb8039900 2023-05-15T16:40:10.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbeffd640 1 -- 172.21.15.62:0/880898114 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1549653705 0 0) 0x7febb803bae0 con 0x7febb803f8f0 2023-05-15T16:40:10.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbeffd640 1 -- 172.21.15.62:0/880898114 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7febb80cd8c0 con 0x7febb803f8f0 2023-05-15T16:40:10.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7f2b0359e640 1 -- start start 2023-05-15T16:40:10.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbeffd640 1 -- 172.21.15.62:0/880898114 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 88518597 0 0) 0x7febb0003530 con 0x7febb8039900 2023-05-15T16:40:10.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbeffd640 1 -- 172.21.15.62:0/880898114 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febb803e970 msgr2=0x7febb80d8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:10.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbeffd640 1 --2- 172.21.15.62:0/880898114 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febb803e970 0x7febb80d8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbeffd640 1 -- 172.21.15.62:0/880898114 >> v1:172.21.15.161:6789/0 conn(0x7febb803f8f0 legacy=0x7febb80cdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbeffd640 1 -- 172.21.15.62:0/880898114 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb80cd550 con 0x7febb8039900 2023-05-15T16:40:10.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbeffd640 1 -- 172.21.15.62:0/880898114 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7febb4001680 con 0x7febb8039900 2023-05-15T16:40:10.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbeffd640 1 -- 172.21.15.62:0/880898114 >> v1:172.21.15.62:6789/0 conn(0x7febb8039900 legacy=0x7febb80c72a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbeffd640 1 --2- 172.21.15.62:0/880898114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febb0003b40 0x7febb0003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbeffd640 1 --2- 172.21.15.62:0/880898114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febb00047d0 0x7febb0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbeffd640 1 --2- 172.21.15.62:0/880898114 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febb0005180 0x7febb000ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbeffd640 1 -- 172.21.15.62:0/880898114 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb803c970 con 0x7febb00047d0 2023-05-15T16:40:10.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbeffd640 1 -- 172.21.15.62:0/880898114 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb00104e0 con 0x7febb0003b40 2023-05-15T16:40:10.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbeffd640 1 -- 172.21.15.62:0/880898114 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb0010620 con 0x7febb0005180 2023-05-15T16:40:10.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbf7fe640 1 --2- 172.21.15.62:0/880898114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febb00047d0 0x7febb0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febc4dc9640 1 --2- 172.21.15.62:0/880898114 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febb0005180 0x7febb000ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7f2b0359e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b0413fe60 0x7f2b04149950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbffff640 1 --2- 172.21.15.62:0/880898114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febb0003b40 0x7febb0003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7f2b0359e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f2b040b41b0 0x7f2b04145b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbf7fe640 1 -- 172.21.15.62:0/880898114 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febb0005180 msgr2=0x7febb000ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:10.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbf7fe640 1 --2- 172.21.15.62:0/880898114 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febb0005180 0x7febb000ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbf7fe640 1 -- 172.21.15.62:0/880898114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febb0003b40 msgr2=0x7febb0003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:10.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbf7fe640 1 --2- 172.21.15.62:0/880898114 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febb0003b40 0x7febb0003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7febbf7fe640 1 -- 172.21.15.62:0/880898114 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb80cd550 con 0x7febb00047d0 2023-05-15T16:40:10.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7f2b0359e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f2b040b4600 0x7f2b041460a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7f2b0359e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b040b5130 con 0x7f2b040b4600 2023-05-15T16:40:10.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7ff69bfde640 1 Processor -- start 2023-05-15T16:40:10.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7ff69bfde640 1 -- start start 2023-05-15T16:40:10.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7f2b0259c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b0413fe60 0x7f2b04149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7f2b0259c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b0413fe60 0x7f2b04149950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.62:37656/0 (socket says 172.21.15.62:37656) 2023-05-15T16:40:10.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7f2b0259c640 1 -- 172.21.15.62:0/3550558435 learned_addr learned my addr 172.21.15.62:0/3550558435 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:10.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7f2b0359e640 1 -- 172.21.15.62:0/3550558435 --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b040b7e10 con 0x7f2b040b41b0 2023-05-15T16:40:10.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7f2b0359e640 1 -- 172.21.15.62:0/3550558435 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b04149150 con 0x7f2b0413fe60 2023-05-15T16:40:10.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7f2afbfff640 1 --2- 172.21.15.62:0/3550558435 >> v2:172.21.15.161:3300/0 conn(0x7f2b040b41b0 0x7f2b04145b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7f2b02d9d640 1 --2- 172.21.15.62:0/3550558435 >> v2:172.21.15.62:3300/0 conn(0x7f2b040b4600 0x7f2b041460a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7ff69bfde640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6941481f0 0x7ff69406f350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7ff69bfde640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff6940bd150 0x7ff6940697b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7ff69bfde640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6941485c0 con 0x7ff6940bd580 2023-05-15T16:40:10.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7ff69bfde640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff69406f890 con 0x7ff6940bd150 2023-05-15T16:40:10.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7ff69bfde640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff694071c50 con 0x7ff6941481f0 2023-05-15T16:40:10.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7ff699d7a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6941481f0 0x7ff69406f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7ff69a57b640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7ff6940bd580 0x7ff6940b78b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.62:57870/0 (socket says 172.21.15.62:57870) 2023-05-15T16:40:10.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7ff69a57b640 1 -- 172.21.15.62:0/1334849359 learned_addr learned my addr 172.21.15.62:0/1334849359 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:10.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7ff699d7a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6941481f0 0x7ff69406f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.62:37664/0 (socket says 172.21.15.62:37664) 2023-05-15T16:40:10.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7ff699579640 1 --2- 172.21.15.62:0/1334849359 >> v2:172.21.15.62:3300/0 conn(0x7ff6940bd150 0x7ff6940697b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7f2b02d9d640 1 -- 172.21.15.62:0/3550558435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b0413fe60 msgr2=0x7f2b04149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:10.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7f2b02d9d640 1 --2- 172.21.15.62:0/3550558435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b0413fe60 0x7f2b04149950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7f2b02d9d640 1 -- 172.21.15.62:0/3550558435 >> v2:172.21.15.161:3300/0 conn(0x7f2b040b41b0 msgr2=0x7f2b04145b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:10.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7f2b02d9d640 1 --2- 172.21.15.62:0/3550558435 >> v2:172.21.15.161:3300/0 conn(0x7f2b040b41b0 0x7f2b04145b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7f2b02d9d640 1 -- 172.21.15.62:0/3550558435 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b04149430 con 0x7f2b040b4600 2023-05-15T16:40:10.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7ff699d7a640 1 -- 172.21.15.62:0/1334849359 >> v2:172.21.15.62:3300/0 conn(0x7ff6940bd150 msgr2=0x7ff6940697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:10.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff699d7a640 1 --2- 172.21.15.62:0/1334849359 >> v2:172.21.15.62:3300/0 conn(0x7ff6940bd150 0x7ff6940697b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff699d7a640 1 -- 172.21.15.62:0/1334849359 >> v1:172.21.15.161:6789/0 conn(0x7ff6940bd580 legacy=0x7ff6940b78b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff51d694640 1 Processor -- start 2023-05-15T16:40:10.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7fa5f3755640 1 Processor -- start 2023-05-15T16:40:10.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7fa5f3755640 1 -- start start 2023-05-15T16:40:10.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff699d7a640 1 -- 172.21.15.62:0/1334849359 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff694071170 con 0x7ff6941481f0 2023-05-15T16:40:10.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7ff647fff640 1 Processor -- start 2023-05-15T16:40:10.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.799+0000 7ff647fff640 1 -- start start 2023-05-15T16:40:10.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff647fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff6400075a0 0x7ff64003b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff647fff640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64003a360 con 0x7ff64003feb0 2023-05-15T16:40:10.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff647fff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff64003e860 con 0x7ff64003f9d0 2023-05-15T16:40:10.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff647fff640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff640039de0 con 0x7ff6400075a0 2023-05-15T16:40:10.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff51d694640 1 -- start start 2023-05-15T16:40:10.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff51d694640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7ff5100c7540 0x7ff510040540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff51d694640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff51003b410 0x7ff5100d0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff51d694640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51003fb60 con 0x7ff51003d790 2023-05-15T16:40:10.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff51d694640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51003fd80 con 0x7ff5100c7540 2023-05-15T16:40:10.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff51d694640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff51003b8b0 con 0x7ff51003b410 2023-05-15T16:40:10.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f336d085640 1 Processor -- start 2023-05-15T16:40:10.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff6467fc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff64003feb0 0x7ff6400ce950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37846/0 (socket says 172.21.15.62:37846) 2023-05-15T16:40:10.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff6467fc640 1 -- 172.21.15.62:0/1803325653 learned_addr learned my addr 172.21.15.62:0/1803325653 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:10.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff646ffd640 1 --2- 172.21.15.62:0/1803325653 >> v2:172.21.15.62:3300/0 conn(0x7ff6400075a0 0x7ff64003b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7fa5f3755640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa5ec0b8d90 0x7fa5ec141610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7fa5f3755640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa5ec0b7f60 0x7fa5ec147780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7fa5f3755640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5ec14b0c0 con 0x7fa5ec06e720 2023-05-15T16:40:10.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7fa5f3755640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ec06ccb0 con 0x7fa5ec0b7f60 2023-05-15T16:40:10.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7fa5f3755640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5ec14b3a0 con 0x7fa5ec0b8d90 2023-05-15T16:40:10.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7febbf7fe640 1 --2- 172.21.15.62:0/880898114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febb00047d0 0x7febb0004c40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7febb400c240 tx=0x7febb401f330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb8a930c3f5106bd server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f96dd211640 1 Processor -- start 2023-05-15T16:40:10.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff5177fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff51003b410 0x7ff5100d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff5177fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff51003b410 0x7ff5100d0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.62:36630/0 (socket says 172.21.15.62:36630) 2023-05-15T16:40:10.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff5177fe640 1 -- 172.21.15.62:0/537654008 learned_addr learned my addr 172.21.15.62:0/537654008 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:10.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff5177fe640 1 -- 172.21.15.62:0/537654008 >> v2:172.21.15.62:3300/0 conn(0x7ff5100c7540 msgr2=0x7ff510040540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:10.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff5177fe640 1 --2- 172.21.15.62:0/537654008 >> v2:172.21.15.62:3300/0 conn(0x7ff5100c7540 0x7ff510040540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff5177fe640 1 -- 172.21.15.62:0/537654008 >> v1:172.21.15.161:6789/0 conn(0x7ff51003d790 legacy=0x7ff51003f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:10.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff5177fe640 1 -- 172.21.15.62:0/537654008 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff51003bb90 con 0x7ff51003b410 2023-05-15T16:40:10.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f96dd211640 1 -- start start 2023-05-15T16:40:10.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f96dd211640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f96d8148640 0x7f96d814e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f96dd211640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d8065a70 con 0x7f96d806aa20 2023-05-15T16:40:10.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f96dd211640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d806ea80 con 0x7f96d80b2cb0 2023-05-15T16:40:10.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f96dd211640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d814e180 con 0x7f96d8148640 2023-05-15T16:40:10.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f2b02d9d640 1 --2- 172.21.15.62:0/3550558435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b040b4600 0x7f2b041460a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2b0406d870 tx=0x7f2afc01c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a215bcf3f9fc2dfb server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7febbeffd640 1 -- 172.21.15.62:0/880898114 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb4005ae0 con 0x7febb00047d0 2023-05-15T16:40:10.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7febbeffd640 1 -- 172.21.15.62:0/880898114 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb40ab070 con 0x7febb00047d0 2023-05-15T16:40:10.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7febbeffd640 1 -- 172.21.15.62:0/880898114 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb4007070 con 0x7febb00047d0 2023-05-15T16:40:10.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff646ffd640 1 -- 172.21.15.62:0/1803325653 >> v1:172.21.15.161:6789/0 conn(0x7ff64003f9d0 legacy=0x7ff6400df190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:10.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff646ffd640 1 -- 172.21.15.62:0/1803325653 >> v1:172.21.15.62:6789/0 conn(0x7ff64003feb0 legacy=0x7ff6400ce950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7ff646ffd640 1 -- 172.21.15.62:0/1803325653 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6400cf060 con 0x7ff6400075a0 2023-05-15T16:40:10.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f336d085640 1 -- start start 2023-05-15T16:40:10.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f336d085640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f336806aa20 0x7f3368147d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f96cffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f96d8148640 0x7f96d814e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f96cffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f96d8148640 0x7f96d814e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.62:36638/0 (socket says 172.21.15.62:36638) 2023-05-15T16:40:10.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f96cffff640 1 -- 172.21.15.62:0/58785367 learned_addr learned my addr 172.21.15.62:0/58785367 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:10.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f336d085640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3368071710 0x7f3368158770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f336d085640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33680b97e0 con 0x7f3368148280 2023-05-15T16:40:10.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f336d085640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33680b8430 con 0x7f3368071710 2023-05-15T16:40:10.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f336d085640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336806f0a0 con 0x7f336806aa20 2023-05-15T16:40:10.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7febc55ca640 1 -- 172.21.15.62:0/880898114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febb00047d0 msgr2=0x7febb0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7febc55ca640 1 --2- 172.21.15.62:0/880898114 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febb00047d0 0x7febb0004c40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7febb400c240 tx=0x7febb401f330 comp rx=0 tx=0).stop 2023-05-15T16:40:10.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7febc4dc9640 1 -- 172.21.15.62:0/880898114 reap_dead start 2023-05-15T16:40:10.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f336659c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f3368148280 0x7f3368071000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.62:57904/0 (socket says 172.21.15.62:57904) 2023-05-15T16:40:10.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f336659c640 1 -- 172.21.15.62:0/3278495101 learned_addr learned my addr 172.21.15.62:0/3278495101 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:10.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7fa5f1cf2640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa5ec06e720 0x7fa5ec0b4fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37852/0 (socket says 172.21.15.62:37852) 2023-05-15T16:40:10.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7fa5f1cf2640 1 -- 172.21.15.62:0/1874432167 learned_addr learned my addr 172.21.15.62:0/1874432167 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:10.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7fa5f0cf0640 1 --2- 172.21.15.62:0/1874432167 >> v2:172.21.15.62:3300/0 conn(0x7fa5ec0b7f60 0x7fa5ec147780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f336759e640 1 --2- 172.21.15.62:0/3278495101 >> v2:172.21.15.161:3300/0 conn(0x7f3368071710 0x7f3368158770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f3366d9d640 1 --2- 172.21.15.62:0/3278495101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f336806aa20 0x7f3368147d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7fa5f14f1640 1 --2- 172.21.15.62:0/1874432167 >> v2:172.21.15.161:3300/0 conn(0x7fa5ec0b8d90 0x7fa5ec141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f96cffff640 1 -- 172.21.15.62:0/58785367 >> v1:172.21.15.161:6789/0 conn(0x7f96d80b2cb0 legacy=0x7f96d8158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:10.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f96cffff640 1 -- 172.21.15.62:0/58785367 >> v1:172.21.15.62:6789/0 conn(0x7f96d806aa20 legacy=0x7f96d8147f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:10.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f96cffff640 1 -- 172.21.15.62:0/58785367 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d806ed60 con 0x7f96d8148640 2023-05-15T16:40:10.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f2b01d9b640 1 -- 172.21.15.62:0/3550558435 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc0a58a0 con 0x7f2b040b4600 2023-05-15T16:40:10.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f2b01d9b640 1 -- 172.21.15.62:0/3550558435 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2afc0a5a00 con 0x7f2b040b4600 2023-05-15T16:40:10.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.803+0000 7f2b01d9b640 1 -- 172.21.15.62:0/3550558435 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2afc0a5d90 con 0x7f2b040b4600 2023-05-15T16:40:10.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff699d7a640 1 --2- 172.21.15.62:0/1334849359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6941481f0 0x7ff69406f350 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009d90 tx=0x7ff68c01f130 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f13368db87886b7f server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2b0359e640 1 -- 172.21.15.62:0/3550558435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b040b4600 msgr2=0x7f2b041460a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2b0359e640 1 --2- 172.21.15.62:0/3550558435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b040b4600 0x7f2b041460a0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2b0406d870 tx=0x7f2afc01c880 comp rx=0 tx=0).stop 2023-05-15T16:40:10.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7febc55ca640 1 -- 172.21.15.62:0/880898114 shutdown_connections 2023-05-15T16:40:10.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7febc55ca640 1 -- 172.21.15.62:0/880898114 >> 172.21.15.62:0/880898114 conn(0x7febb8043190 msgr2=0x7febb803ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:10.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f336759e640 1 -- 172.21.15.62:0/3278495101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f336806aa20 msgr2=0x7f3368147d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:10.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f336759e640 1 --2- 172.21.15.62:0/3278495101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f336806aa20 0x7f3368147d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f336759e640 1 -- 172.21.15.62:0/3278495101 >> v1:172.21.15.161:6789/0 conn(0x7f3368148280 legacy=0x7f3368071000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f336759e640 1 -- 172.21.15.62:0/3278495101 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3368070b90 con 0x7f3368071710 2023-05-15T16:40:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2b0359e640 1 -- 172.21.15.62:0/3550558435 shutdown_connections 2023-05-15T16:40:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2b0359e640 1 --2- 172.21.15.62:0/3550558435 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b040b4600 0x7f2b041460a0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2b0359e640 1 --2- 172.21.15.62:0/3550558435 >> v2:172.21.15.161:3300/0 conn(0x7f2b040b41b0 0x7f2b04145b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2b0359e640 1 --2- 172.21.15.62:0/3550558435 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b0413fe60 0x7f2b04149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2b0359e640 1 -- 172.21.15.62:0/3550558435 >> 172.21.15.62:0/3550558435 conn(0x7f2b0406a3f0 msgr2=0x7f2b040bb940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:10.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff698d78640 1 -- 172.21.15.62:0/1334849359 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0af600 con 0x7ff6941481f0 2023-05-15T16:40:10.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2b0359e640 1 -- 172.21.15.62:0/3550558435 shutdown_connections 2023-05-15T16:40:10.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff646ffd640 1 --2- 172.21.15.62:0/1803325653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6400075a0 0x7ff64003b8b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff6380097c0 tx=0x7ff63801c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f92d84cf52226436 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2b0359e640 1 -- 172.21.15.62:0/3550558435 wait complete. 2023-05-15T16:40:10.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff645ffb640 1 -- 172.21.15.62:0/1803325653 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6380ab600 con 0x7ff6400075a0 2023-05-15T16:40:10.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff645ffb640 1 -- 172.21.15.62:0/1803325653 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6380a7050 con 0x7ff6400075a0 2023-05-15T16:40:10.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff645ffb640 1 -- 172.21.15.62:0/1803325653 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6380ab980 con 0x7ff6400075a0 2023-05-15T16:40:10.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff698d78640 1 -- 172.21.15.62:0/1334849359 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff68c0ab050 con 0x7ff6941481f0 2023-05-15T16:40:10.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff69bfde640 1 -- 172.21.15.62:0/1334849359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6941481f0 msgr2=0x7ff69406f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff698d78640 1 -- 172.21.15.62:0/1334849359 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff68c0af600 con 0x7ff6941481f0 2023-05-15T16:40:10.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff69bfde640 1 --2- 172.21.15.62:0/1334849359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6941481f0 0x7ff69406f350 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009d90 tx=0x7ff68c01f130 comp rx=0 tx=0).stop 2023-05-15T16:40:10.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff5177fe640 1 --2- 172.21.15.62:0/537654008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff51003b410 0x7ff5100d0870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff51000d360 tx=0x7ff50401ecd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4e4a5faab0753db0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff69bfde640 1 -- 172.21.15.62:0/1334849359 shutdown_connections 2023-05-15T16:40:10.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff69bfde640 1 --2- 172.21.15.62:0/1334849359 >> v2:172.21.15.62:3300/0 conn(0x7ff6940bd150 0x7ff6940697b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff69bfde640 1 --2- 172.21.15.62:0/1334849359 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6941481f0 0x7ff69406f350 secure :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff68c009d90 tx=0x7ff68c01f130 comp rx=0 tx=0).stop 2023-05-15T16:40:10.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff69bfde640 1 -- 172.21.15.62:0/1334849359 >> 172.21.15.62:0/1334849359 conn(0x7ff69406b4f0 msgr2=0x7ff6940bca40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:10.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff516ffd640 1 -- 172.21.15.62:0/537654008 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5040a89b0 con 0x7ff51003b410 2023-05-15T16:40:10.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f96cffff640 1 --2- 172.21.15.62:0/58785367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96d8148640 0x7f96d814e5d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009e50 tx=0x7f96c801f180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=695a042a8428a818 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff516ffd640 1 -- 172.21.15.62:0/537654008 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5040a8b10 con 0x7ff51003b410 2023-05-15T16:40:10.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff516ffd640 1 -- 172.21.15.62:0/537654008 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5040a89b0 con 0x7ff51003b410 2023-05-15T16:40:10.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f96d77fe640 1 -- 172.21.15.62:0/58785367 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c80af400 con 0x7f96d8148640 2023-05-15T16:40:10.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7fa5f0cf0640 1 -- 172.21.15.62:0/1874432167 >> v2:172.21.15.161:3300/0 conn(0x7fa5ec0b8d90 msgr2=0x7fa5ec141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:10.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7fa5f0cf0640 1 --2- 172.21.15.62:0/1874432167 >> v2:172.21.15.161:3300/0 conn(0x7fa5ec0b8d90 0x7fa5ec141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7fa5f0cf0640 1 -- 172.21.15.62:0/1874432167 >> v1:172.21.15.62:6789/0 conn(0x7fa5ec06e720 legacy=0x7fa5ec0b4fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7febc55ca640 1 -- 172.21.15.62:0/880898114 shutdown_connections 2023-05-15T16:40:10.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7fa5f0cf0640 1 -- 172.21.15.62:0/1874432167 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ec14b680 con 0x7fa5ec0b7f60 2023-05-15T16:40:10.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f96d77fe640 1 -- 172.21.15.62:0/58785367 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c80ab050 con 0x7f96d8148640 2023-05-15T16:40:10.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff647fff640 1 -- 172.21.15.62:0/1803325653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6400075a0 msgr2=0x7ff64003b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff647fff640 1 --2- 172.21.15.62:0/1803325653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6400075a0 0x7ff64003b8b0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff6380097c0 tx=0x7ff63801c360 comp rx=0 tx=0).stop 2023-05-15T16:40:10.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2b0359e640 1 Processor -- start 2023-05-15T16:40:10.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2b0359e640 1 -- start start 2023-05-15T16:40:10.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff647fff640 1 -- 172.21.15.62:0/1803325653 shutdown_connections 2023-05-15T16:40:10.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff647fff640 1 --2- 172.21.15.62:0/1803325653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6400075a0 0x7ff64003b8b0 secure :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff6380097c0 tx=0x7ff63801c360 comp rx=0 tx=0).stop 2023-05-15T16:40:10.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff647fff640 1 -- 172.21.15.62:0/1803325653 >> 172.21.15.62:0/1803325653 conn(0x7ff6400434d0 msgr2=0x7ff64003f2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:10.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2b0359e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b040b41b0 0x7f2b0413d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2b0359e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b040b4600 0x7f2b04200440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2b0359e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b0413fe60 0x7f2b040703a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2b0359e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b0414aa80 con 0x7f2b040b4600 2023-05-15T16:40:10.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2b0359e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b04142cd0 con 0x7f2b0413fe60 2023-05-15T16:40:10.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2b0359e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b041413a0 con 0x7f2b040b41b0 2023-05-15T16:40:10.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7fa5f0cf0640 1 --2- 172.21.15.62:0/1874432167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5ec0b7f60 0x7fa5ec147780 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80097c0 tx=0x7fa5e801c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de4130019ab199 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2afbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b040b4600 0x7f2b04200440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7febc55ca640 1 -- 172.21.15.62:0/880898114 wait complete. 2023-05-15T16:40:10.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2afbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b040b4600 0x7f2b04200440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42712/0 (socket says 172.21.15.62:42712) 2023-05-15T16:40:10.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2afbfff640 1 -- 172.21.15.62:0/1967928484 learned_addr learned my addr 172.21.15.62:0/1967928484 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:10.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f96dd211640 1 -- 172.21.15.62:0/58785367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96d8148640 msgr2=0x7f96d814e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f96dd211640 1 --2- 172.21.15.62:0/58785367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96d8148640 0x7f96d814e5d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009e50 tx=0x7f96c801f180 comp rx=0 tx=0).stop 2023-05-15T16:40:10.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2b02d9d640 1 --2- 172.21.15.62:0/1967928484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b0413fe60 0x7f2b040703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f96dd211640 1 -- 172.21.15.62:0/58785367 shutdown_connections 2023-05-15T16:40:10.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f96dd211640 1 --2- 172.21.15.62:0/58785367 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96d8148640 0x7f96d814e5d0 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f96c8009e50 tx=0x7f96c801f180 comp rx=0 tx=0).stop 2023-05-15T16:40:10.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f96dd211640 1 -- 172.21.15.62:0/58785367 >> 172.21.15.62:0/58785367 conn(0x7f96d80b8cc0 msgr2=0x7f96d80b90c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:10.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff51d694640 1 -- 172.21.15.62:0/537654008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff51003b410 msgr2=0x7ff5100d0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff51d694640 1 --2- 172.21.15.62:0/537654008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff51003b410 0x7ff5100d0870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff51000d360 tx=0x7ff50401ecd0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff647fff640 1 -- 172.21.15.62:0/1803325653 shutdown_connections 2023-05-15T16:40:10.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff69bfde640 1 -- 172.21.15.62:0/1334849359 shutdown_connections 2023-05-15T16:40:10.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7febc55ca640 1 Processor -- start 2023-05-15T16:40:10.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7febc55ca640 1 -- start start 2023-05-15T16:40:10.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff647fff640 1 -- 172.21.15.62:0/1803325653 wait complete. 2023-05-15T16:40:10.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff647fff640 1 Processor -- start 2023-05-15T16:40:10.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f336759e640 1 --2- 172.21.15.62:0/3278495101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3368071710 0x7f3368158770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3360009d90 tx=0x7f336001c900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a4ea1071f215cd4e server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7fa5e3fff640 1 -- 172.21.15.62:0/1874432167 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e80ab600 con 0x7fa5ec0b7f60 2023-05-15T16:40:10.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7fa5e3fff640 1 -- 172.21.15.62:0/1874432167 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e80a7050 con 0x7fa5ec0b7f60 2023-05-15T16:40:10.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7fa5e3fff640 1 -- 172.21.15.62:0/1874432167 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e80ab980 con 0x7fa5ec0b7f60 2023-05-15T16:40:10.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7fa5f3755640 1 -- 172.21.15.62:0/1874432167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5ec0b7f60 msgr2=0x7fa5ec147780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7fa5f3755640 1 --2- 172.21.15.62:0/1874432167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5ec0b7f60 0x7fa5ec147780 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80097c0 tx=0x7fa5e801c410 comp rx=0 tx=0).stop 2023-05-15T16:40:10.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7fa5f3755640 1 -- 172.21.15.62:0/1874432167 shutdown_connections 2023-05-15T16:40:10.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7fa5f3755640 1 --2- 172.21.15.62:0/1874432167 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5ec0b7f60 0x7fa5ec147780 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa5e80097c0 tx=0x7fa5e801c410 comp rx=0 tx=0).stop 2023-05-15T16:40:10.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7fa5f3755640 1 --2- 172.21.15.62:0/1874432167 >> v2:172.21.15.161:3300/0 conn(0x7fa5ec0b8d90 0x7fa5ec141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7fa5f3755640 1 -- 172.21.15.62:0/1874432167 >> 172.21.15.62:0/1874432167 conn(0x7fa5ec0bc5d0 msgr2=0x7fa5ec0b8420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:10.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7fa5f3755640 1 -- 172.21.15.62:0/1874432167 shutdown_connections 2023-05-15T16:40:10.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f96dd211640 1 -- 172.21.15.62:0/58785367 shutdown_connections 2023-05-15T16:40:10.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96dd211640 1 -- 172.21.15.62:0/58785367 wait complete. 2023-05-15T16:40:10.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96dd211640 1 Processor -- start 2023-05-15T16:40:10.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff51d694640 1 -- 172.21.15.62:0/537654008 shutdown_connections 2023-05-15T16:40:10.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff51d694640 1 --2- 172.21.15.62:0/537654008 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff51003b410 0x7ff5100d0870 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff51000d360 tx=0x7ff50401ecd0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff51d694640 1 --2- 172.21.15.62:0/537654008 >> v2:172.21.15.62:3300/0 conn(0x7ff5100c7540 0x7ff510040540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff51d694640 1 -- 172.21.15.62:0/537654008 >> 172.21.15.62:0/537654008 conn(0x7ff510007da0 msgr2=0x7ff5100081a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:10.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff51d694640 1 -- 172.21.15.62:0/537654008 shutdown_connections 2023-05-15T16:40:10.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff51d694640 1 -- 172.21.15.62:0/537654008 wait complete. 2023-05-15T16:40:10.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7ff69bfde640 1 -- 172.21.15.62:0/1334849359 wait complete. 2023-05-15T16:40:10.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff69bfde640 1 Processor -- start 2023-05-15T16:40:10.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2b0259c640 1 --2- 172.21.15.62:0/1967928484 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b040b41b0 0x7f2b0413d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2afbfff640 1 -- 172.21.15.62:0/1967928484 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b040b41b0 msgr2=0x7f2b0413d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2afbfff640 1 --2- 172.21.15.62:0/1967928484 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f2b040b41b0 0x7f2b0413d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2afbfff640 1 -- 172.21.15.62:0/1967928484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b0413fe60 msgr2=0x7f2b040703a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2afbfff640 1 --2- 172.21.15.62:0/1967928484 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f2b0413fe60 0x7f2b040703a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.807+0000 7f2afbfff640 1 -- 172.21.15.62:0/1967928484 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2afc009a70 con 0x7f2b040b4600 2023-05-15T16:40:10.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f2afbfff640 1 --2- 172.21.15.62:0/1967928484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b040b4600 0x7f2b04200440 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00d7c0 tx=0x7f2aec00dc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f2afaffd640 1 -- 172.21.15.62:0/1967928484 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec00a8c0 con 0x7f2b040b4600 2023-05-15T16:40:10.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f2afaffd640 1 -- 172.21.15.62:0/1967928484 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2aec00aa20 con 0x7f2b040b4600 2023-05-15T16:40:10.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f2afaffd640 1 -- 172.21.15.62:0/1967928484 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2aec00ad90 con 0x7f2b040b4600 2023-05-15T16:40:10.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7febc55ca640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febb80cc310 0x7febb80c8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7febc55ca640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febb80ca700 0x7febb80336a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f2b0359e640 1 -- 172.21.15.62:0/1967928484 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b040b62c0 con 0x7f2b040b4600 2023-05-15T16:40:10.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f2b0359e640 1 -- 172.21.15.62:0/1967928484 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b041469f0 con 0x7f2b040b4600 2023-05-15T16:40:10.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7febc55ca640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febb80cc6e0 0x7febb8027810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7febc55ca640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb803bdc0 con 0x7febb80ca700 2023-05-15T16:40:10.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7febc55ca640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb80ca270 con 0x7febb80cc310 2023-05-15T16:40:10.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7febc55ca640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb80c86b0 con 0x7febb80cc6e0 2023-05-15T16:40:10.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96dd211640 1 -- start start 2023-05-15T16:40:10.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96dd211640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96d806aa20 0x7f96d81d4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96dd211640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96d80b2cb0 0x7f96d81e6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96dd211640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d814dc20 0x7f96d81e7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96dd211640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d81d48a0 con 0x7f96d814dc20 2023-05-15T16:40:10.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96dd211640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d81d8450 con 0x7f96d80b2cb0 2023-05-15T16:40:10.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96dd211640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d81d8170 con 0x7f96d806aa20 2023-05-15T16:40:10.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96dca10640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d814dc20 0x7f96d81e7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96dca10640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d814dc20 0x7f96d81e7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42732/0 (socket says 172.21.15.62:42732) 2023-05-15T16:40:10.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96dca10640 1 -- 172.21.15.62:0/2401121182 learned_addr learned my addr 172.21.15.62:0/2401121182 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:10.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96d7fff640 1 --2- 172.21.15.62:0/2401121182 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96d806aa20 0x7f96d81d4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff647fff640 1 -- start start 2023-05-15T16:40:10.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96dca10640 1 -- 172.21.15.62:0/2401121182 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96d806aa20 msgr2=0x7f96d81d4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96dca10640 1 --2- 172.21.15.62:0/2401121182 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f96d806aa20 0x7f96d81d4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96dca10640 1 -- 172.21.15.62:0/2401121182 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96d80b2cb0 msgr2=0x7f96d81e6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96dca10640 1 --2- 172.21.15.62:0/2401121182 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f96d80b2cb0 0x7f96d81e6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96dca10640 1 -- 172.21.15.62:0/2401121182 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c8009b30 con 0x7f96d814dc20 2023-05-15T16:40:10.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7febc4dc9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febb80cc6e0 0x7febb8027810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff51d694640 1 Processor -- start 2023-05-15T16:40:10.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff69bfde640 1 -- start start 2023-05-15T16:40:10.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96dca10640 1 --2- 172.21.15.62:0/2401121182 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d814dc20 0x7f96d81e7400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f96d000c410 tx=0x7f96d000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff69bfde640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6940bd150 0x7ff6940bbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff69bfde640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6940bd580 0x7ff69413c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff69bfde640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6941e36e0 0x7ff6941e6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff69bfde640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6940bc010 con 0x7ff6940bd580 2023-05-15T16:40:10.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff69bfde640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff69413c640 con 0x7ff6940bd150 2023-05-15T16:40:10.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff69bfde640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6940b3800 con 0x7ff6941e36e0 2023-05-15T16:40:10.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff699579640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6940bd580 0x7ff69413c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff699579640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6940bd580 0x7ff69413c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42740/0 (socket says 172.21.15.62:42740) 2023-05-15T16:40:10.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff699579640 1 -- 172.21.15.62:0/404973920 learned_addr learned my addr 172.21.15.62:0/404973920 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:10.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7febc4dc9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febb80cc6e0 0x7febb8027810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.62:37688/0 (socket says 172.21.15.62:37688) 2023-05-15T16:40:10.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7febc4dc9640 1 -- 172.21.15.62:0/917185803 learned_addr learned my addr 172.21.15.62:0/917185803 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:10.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff69a57b640 1 --2- 172.21.15.62:0/404973920 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6941e36e0 0x7ff6941e6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7febbffff640 1 --2- 172.21.15.62:0/917185803 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febb80cc310 0x7febb80c8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff699d7a640 1 --2- 172.21.15.62:0/404973920 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6940bd150 0x7ff6940bbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7fa5f3755640 1 -- 172.21.15.62:0/1874432167 wait complete. 2023-05-15T16:40:10.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7fa5f3755640 1 Processor -- start 2023-05-15T16:40:10.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff699579640 1 -- 172.21.15.62:0/404973920 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6941e36e0 msgr2=0x7ff6941e6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff699579640 1 --2- 172.21.15.62:0/404973920 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6941e36e0 0x7ff6941e6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff699579640 1 -- 172.21.15.62:0/404973920 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6940bd150 msgr2=0x7ff6940bbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff699579640 1 --2- 172.21.15.62:0/404973920 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6940bd150 0x7ff6940bbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff699579640 1 -- 172.21.15.62:0/404973920 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff68c009a70 con 0x7ff6940bd580 2023-05-15T16:40:10.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96d57fa640 1 -- 172.21.15.62:0/2401121182 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0003600 con 0x7f96d814dc20 2023-05-15T16:40:10.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96d57fa640 1 -- 172.21.15.62:0/2401121182 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d0003760 con 0x7f96d814dc20 2023-05-15T16:40:10.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96d57fa640 1 -- 172.21.15.62:0/2401121182 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0003b10 con 0x7f96d814dc20 2023-05-15T16:40:10.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96dd211640 1 -- 172.21.15.62:0/2401121182 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d806f320 con 0x7f96d814dc20 2023-05-15T16:40:10.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f96dd211640 1 -- 172.21.15.62:0/2401121182 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d806f040 con 0x7f96d814dc20 2023-05-15T16:40:10.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7febbf7fe640 1 --2- 172.21.15.62:0/917185803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febb80ca700 0x7febb80336a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff647fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff64003f9d0 0x7ff640038450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff647fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff64003feb0 0x7ff6400d1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff647fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6400c6700 0x7ff6400c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff647fff640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400d5730 con 0x7ff64003f9d0 2023-05-15T16:40:10.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff647fff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6400d1dd0 con 0x7ff64003feb0 2023-05-15T16:40:10.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff647fff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff640037b70 con 0x7ff6400c6700 2023-05-15T16:40:10.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7febbffff640 1 -- 172.21.15.62:0/917185803 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febb80cc6e0 msgr2=0x7febb8027810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7febbffff640 1 --2- 172.21.15.62:0/917185803 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7febb80cc6e0 0x7febb8027810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7febbffff640 1 -- 172.21.15.62:0/917185803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febb80ca700 msgr2=0x7febb80336a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7febbffff640 1 --2- 172.21.15.62:0/917185803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7febb80ca700 0x7febb80336a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7febbffff640 1 -- 172.21.15.62:0/917185803 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb80c79b0 con 0x7febb80cc310 2023-05-15T16:40:10.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f2b0359e640 1 -- 172.21.15.62:0/1967928484 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2ae8000fd0 con 0x7f2b040b4600 2023-05-15T16:40:10.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff6467fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff64003feb0 0x7ff6400d1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff6467fc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff64003feb0 0x7ff6400d1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.62:36674/0 (socket says 172.21.15.62:36674) 2023-05-15T16:40:10.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff6467fc640 1 -- 172.21.15.62:0/1698268131 learned_addr learned my addr 172.21.15.62:0/1698268131 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:10.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff6477fe640 1 --2- 172.21.15.62:0/1698268131 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6400c6700 0x7ff6400c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7febbffff640 1 --2- 172.21.15.62:0/917185803 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febb80cc310 0x7febb80c8170 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7febac00e550 tx=0x7febac00ea10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f96dd211640 1 -- 172.21.15.62:0/2401121182 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f96d806adf0 con 0x7f96d814dc20 2023-05-15T16:40:10.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7ff51d694640 1 -- start start 2023-05-15T16:40:10.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff6467fc640 1 -- 172.21.15.62:0/1698268131 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6400c6700 msgr2=0x7ff6400c6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff6467fc640 1 --2- 172.21.15.62:0/1698268131 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6400c6700 0x7ff6400c6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff6467fc640 1 -- 172.21.15.62:0/1698268131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff64003f9d0 msgr2=0x7ff640038450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff6467fc640 1 --2- 172.21.15.62:0/1698268131 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff64003f9d0 0x7ff640038450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff6467fc640 1 -- 172.21.15.62:0/1698268131 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff638009420 con 0x7ff64003feb0 2023-05-15T16:40:10.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f3365d9b640 1 -- 172.21.15.62:0/3278495101 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33600a5830 con 0x7f3368071710 2023-05-15T16:40:10.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f3365d9b640 1 -- 172.21.15.62:0/3278495101 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33600a5990 con 0x7f3368071710 2023-05-15T16:40:10.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7f3365d9b640 1 -- 172.21.15.62:0/3278495101 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33600a5d60 con 0x7f3368071710 2023-05-15T16:40:10.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.811+0000 7fa5f3755640 1 -- start start 2023-05-15T16:40:10.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7fa5f3755640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5ec06e720 0x7fa5ec0b4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7fa5f3755640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5ec0b8d90 0x7fa5ec0b9780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7fa5f3755640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5ec0b9cc0 0x7fa5ec0b3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7fa5f3755640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec1e65b0 con 0x7fa5ec0b8d90 2023-05-15T16:40:10.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7fa5f3755640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec0bb7a0 con 0x7fa5ec06e720 2023-05-15T16:40:10.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7fa5f3755640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5ec1403f0 con 0x7fa5ec0b9cc0 2023-05-15T16:40:10.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7febbcff9640 1 -- 172.21.15.62:0/917185803 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac0052e0 con 0x7febb80cc310 2023-05-15T16:40:10.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff51d694640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff51003d790 0x7ff510039b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff6467fc640 1 --2- 172.21.15.62:0/1698268131 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff64003feb0 0x7ff6400d1890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009f30 tx=0x7ff63c00c4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f2afaffd640 1 -- 172.21.15.62:0/1967928484 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f2aec0123f0 con 0x7f2b040b4600 2023-05-15T16:40:10.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f2afaffd640 1 --2- 172.21.15.62:0/1967928484 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f2ae4065450 0x7f2ae4067900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f2afaffd640 1 -- 172.21.15.62:0/1967928484 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2aec0827d0 con 0x7f2b040b4600 2023-05-15T16:40:10.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f2afaffd640 1 --2- 172.21.15.62:0/1967928484 >> [v2:172.21.15.161:6809/37857,v1:172.21.15.161:6813/37857] conn(0x7f2ae406dc80 0x7f2ae4070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f2afaffd640 1 -- 172.21.15.62:0/1967928484 --> [v2:172.21.15.161:6809/37857,v1:172.21.15.161:6813/37857] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2ae4070740 con 0x7f2ae406dc80 2023-05-15T16:40:10.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff62ffff640 1 -- 172.21.15.62:0/1698268131 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c007af0 con 0x7ff64003feb0 2023-05-15T16:40:10.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7febbcff9640 1 -- 172.21.15.62:0/917185803 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febac005440 con 0x7febb80cc310 2023-05-15T16:40:10.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7febc55ca640 1 -- 172.21.15.62:0/917185803 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb8036050 con 0x7febb80cc310 2023-05-15T16:40:10.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7febc55ca640 1 -- 172.21.15.62:0/917185803 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb803fcc0 con 0x7febb80cc310 2023-05-15T16:40:10.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff62ffff640 1 -- 172.21.15.62:0/1698268131 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff63c007c50 con 0x7ff64003feb0 2023-05-15T16:40:10.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f336d085640 1 -- 172.21.15.62:0/3278495101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3368071710 msgr2=0x7f3368158770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f336d085640 1 --2- 172.21.15.62:0/3278495101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3368071710 0x7f3368158770 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f3360009d90 tx=0x7f336001c900 comp rx=0 tx=0).stop 2023-05-15T16:40:10.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff699579640 1 --2- 172.21.15.62:0/404973920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6940bd580 0x7ff69413c100 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff68400c7f0 tx=0x7ff68400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f2b02d9d640 1 --2- 172.21.15.62:0/1967928484 >> [v2:172.21.15.161:6809/37857,v1:172.21.15.161:6813/37857] conn(0x7f2ae406dc80 0x7f2ae4070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f2b0259c640 1 --2- 172.21.15.62:0/1967928484 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f2ae4065450 0x7f2ae4067900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7febc55ca640 1 -- 172.21.15.62:0/917185803 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7febb80054a0 con 0x7febb80cc310 2023-05-15T16:40:10.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7febbcff9640 1 -- 172.21.15.62:0/917185803 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac003840 con 0x7febb80cc310 2023-05-15T16:40:10.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f2afaffd640 1 -- 172.21.15.62:0/1967928484 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2aec005e70 con 0x7f2b040b4600 2023-05-15T16:40:10.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f336d085640 1 -- 172.21.15.62:0/3278495101 shutdown_connections 2023-05-15T16:40:10.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f336d085640 1 --2- 172.21.15.62:0/3278495101 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3368071710 0x7f3368158770 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f336d085640 1 --2- 172.21.15.62:0/3278495101 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f336806aa20 0x7f3368147d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f336d085640 1 -- 172.21.15.62:0/3278495101 >> 172.21.15.62:0/3278495101 conn(0x7f33680bcf30 msgr2=0x7f33680b8d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:10.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff68a7fc640 1 -- 172.21.15.62:0/404973920 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff684004220 con 0x7ff6940bd580 2023-05-15T16:40:10.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff647fff640 1 -- 172.21.15.62:0/1698268131 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff640036070 con 0x7ff64003feb0 2023-05-15T16:40:10.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff647fff640 1 -- 172.21.15.62:0/1698268131 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff64003a080 con 0x7ff64003feb0 2023-05-15T16:40:10.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f336d085640 1 -- 172.21.15.62:0/3278495101 shutdown_connections 2023-05-15T16:40:10.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff69bfde640 1 -- 172.21.15.62:0/404973920 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff694071730 con 0x7ff6940bd580 2023-05-15T16:40:10.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff69bfde640 1 -- 172.21.15.62:0/404973920 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff694071450 con 0x7ff6940bd580 2023-05-15T16:40:10.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff68a7fc640 1 -- 172.21.15.62:0/404973920 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6840043a0 con 0x7ff6940bd580 2023-05-15T16:40:10.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f96d57fa640 1 -- 172.21.15.62:0/2401121182 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f96d0003c70 con 0x7f96d814dc20 2023-05-15T16:40:10.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff62ffff640 1 -- 172.21.15.62:0/1698268131 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff63c00ce70 con 0x7ff64003feb0 2023-05-15T16:40:10.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7fa5f1cf2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5ec0b9cc0 0x7fa5ec0b3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7fa5f1cf2640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5ec0b9cc0 0x7fa5ec0b3090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.62:37710/0 (socket says 172.21.15.62:37710) 2023-05-15T16:40:10.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7fa5f1cf2640 1 -- 172.21.15.62:0/2554500690 learned_addr learned my addr 172.21.15.62:0/2554500690 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:10.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7fa5f1cf2640 1 -- 172.21.15.62:0/2554500690 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5ec06e720 msgr2=0x7fa5ec0b4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7fa5f1cf2640 1 --2- 172.21.15.62:0/2554500690 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa5ec06e720 0x7fa5ec0b4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7fa5f1cf2640 1 -- 172.21.15.62:0/2554500690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5ec0b8d90 msgr2=0x7fa5ec0b9780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-15T16:40:10.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7fa5f1cf2640 1 --2- 172.21.15.62:0/2554500690 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa5ec0b8d90 0x7fa5ec0b9780 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7fa5f1cf2640 1 -- 172.21.15.62:0/2554500690 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5e8009420 con 0x7fa5ec0b9cc0 2023-05-15T16:40:10.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7fa5f1cf2640 1 --2- 172.21.15.62:0/2554500690 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5ec0b9cc0 0x7fa5ec0b3090 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400caa0 tx=0x7fa5e400cf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7fa5e1ffb640 1 -- 172.21.15.62:0/2554500690 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e400ac00 con 0x7fa5ec0b9cc0 2023-05-15T16:40:10.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7fa5e1ffb640 1 -- 172.21.15.62:0/2554500690 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa5e400ad60 con 0x7fa5ec0b9cc0 2023-05-15T16:40:10.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7fa5e1ffb640 1 -- 172.21.15.62:0/2554500690 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5e4012600 con 0x7fa5ec0b9cc0 2023-05-15T16:40:10.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f336d085640 1 -- 172.21.15.62:0/3278495101 wait complete. 2023-05-15T16:40:10.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f96d57fa640 1 --2- 172.21.15.62:0/2401121182 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f96c4065540 0x7f96c40679f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f96d57fa640 1 -- 172.21.15.62:0/2401121182 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f96d0082540 con 0x7f96d814dc20 2023-05-15T16:40:10.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7fa5f3755640 1 -- 172.21.15.62:0/2554500690 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5ec0b9160 con 0x7fa5ec0b9cc0 2023-05-15T16:40:10.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7fa5f3755640 1 -- 172.21.15.62:0/2554500690 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5ec1480d0 con 0x7fa5ec0b9cc0 2023-05-15T16:40:10.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f96d57fa640 1 --2- 172.21.15.62:0/2401121182 >> [v2:172.21.15.161:6800/37854,v1:172.21.15.161:6801/37854] conn(0x7f96c406ddf0 0x7f96c4070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f96d57fa640 1 -- 172.21.15.62:0/2401121182 --> [v2:172.21.15.161:6800/37854,v1:172.21.15.161:6801/37854] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f96c40708b0 con 0x7f96c406ddf0 2023-05-15T16:40:10.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f96d57fa640 1 -- 172.21.15.62:0/2401121182 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f96d00828b0 con 0x7f96d814dc20 2023-05-15T16:40:10.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff517fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff51003d790 0x7ff510039b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff517fff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff51003d790 0x7ff510039b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.62:36682/0 (socket says 172.21.15.62:36682) 2023-05-15T16:40:10.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff69bfde640 1 -- 172.21.15.62:0/404973920 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff67c000fd0 con 0x7ff6940bd580 2023-05-15T16:40:10.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff68a7fc640 1 -- 172.21.15.62:0/404973920 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff684004510 con 0x7ff6940bd580 2023-05-15T16:40:10.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff517fff640 1 -- 172.21.15.62:0/260751304 learned_addr learned my addr 172.21.15.62:0/260751304 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:10.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff647fff640 1 -- 172.21.15.62:0/1698268131 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff640007970 con 0x7ff64003feb0 2023-05-15T16:40:10.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f96cffff640 1 --2- 172.21.15.62:0/2401121182 >> [v2:172.21.15.161:6800/37854,v1:172.21.15.161:6801/37854] conn(0x7f96c406ddf0 0x7f96c4070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff51d694640 1 --2- 172.21.15.62:0/260751304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5100c7540 0x7ff510037d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff51d694640 1 --2- 172.21.15.62:0/260751304 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5100cf880 0x7ff5100426a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff51d694640 1 -- 172.21.15.62:0/260751304 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff510042be0 con 0x7ff5100c7540 2023-05-15T16:40:10.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff51d694640 1 -- 172.21.15.62:0/260751304 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51003a150 con 0x7ff51003d790 2023-05-15T16:40:10.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7ff51d694640 1 -- 172.21.15.62:0/260751304 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5100391e0 con 0x7ff5100cf880 2023-05-15T16:40:10.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7f96d7fff640 1 --2- 172.21.15.62:0/2401121182 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f96c4065540 0x7f96c40679f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7fa5f3755640 1 -- 172.21.15.62:0/2554500690 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa5ec155100 con 0x7fa5ec0b9cc0 2023-05-15T16:40:10.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7f336d085640 1 Processor -- start 2023-05-15T16:40:10.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.815+0000 7f2b02d9d640 1 --2- 172.21.15.62:0/1967928484 >> [v2:172.21.15.161:6809/37857,v1:172.21.15.161:6813/37857] conn(0x7f2ae406dc80 0x7f2ae4070090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7f2b0259c640 1 --2- 172.21.15.62:0/1967928484 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f2ae4065450 0x7f2ae4067900 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2af400d8b0 tx=0x7f2af4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff517fff640 1 -- 172.21.15.62:0/260751304 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5100cf880 msgr2=0x7ff5100426a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-15T16:40:10.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff517fff640 1 --2- 172.21.15.62:0/260751304 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff5100cf880 0x7ff5100426a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff5177fe640 1 --2- 172.21.15.62:0/260751304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5100c7540 0x7ff510037d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff517fff640 1 -- 172.21.15.62:0/260751304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5100c7540 msgr2=0x7ff510037d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff517fff640 1 --2- 172.21.15.62:0/260751304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5100c7540 0x7ff510037d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff517fff640 1 -- 172.21.15.62:0/260751304 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5040094d0 con 0x7ff51003d790 2023-05-15T16:40:10.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7febbcff9640 1 -- 172.21.15.62:0/917185803 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7febac0039a0 con 0x7febb80cc310 2023-05-15T16:40:10.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7f96cffff640 1 --2- 172.21.15.62:0/2401121182 >> [v2:172.21.15.161:6800/37854,v1:172.21.15.161:6801/37854] conn(0x7f96c406ddf0 0x7f96c4070200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7f336d085640 1 -- start start 2023-05-15T16:40:10.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7f336d085640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f336806aa20 0x7f336814aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7f336d085640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3368071710 0x7f336814da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7febbcff9640 1 --2- 172.21.15.62:0/917185803 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7feba4065380 0x7feba4067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff517fff640 1 --2- 172.21.15.62:0/260751304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff51003d790 0x7ff510039b70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff50c00b470 tx=0x7ff50c00b930 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7febbcff9640 1 -- 172.21.15.62:0/917185803 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7febac083080 con 0x7febb80cc310 2023-05-15T16:40:10.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7febbcff9640 1 --2- 172.21.15.62:0/917185803 >> [v2:172.21.15.62:6824/37594,v1:172.21.15.62:6825/37594] conn(0x7feba406db30 0x7feba406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7febbcff9640 1 -- 172.21.15.62:0/917185803 --> [v2:172.21.15.62:6824/37594,v1:172.21.15.62:6825/37594] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7feba40705f0 con 0x7feba406db30 2023-05-15T16:40:10.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7febbcff9640 1 -- 172.21.15.62:0/917185803 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7febac0834d0 con 0x7febb80cc310 2023-05-15T16:40:10.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7f3366d9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f336806aa20 0x7f336814aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7f3366d9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f336806aa20 0x7f336814aad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.62:37740/0 (socket says 172.21.15.62:37740) 2023-05-15T16:40:10.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7febbf7fe640 1 --2- 172.21.15.62:0/917185803 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7feba4065380 0x7feba4067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7f96d7fff640 1 --2- 172.21.15.62:0/2401121182 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f96c4065540 0x7f96c40679f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f96c0007fd0 tx=0x7f96c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff5177fe640 1 --2- 172.21.15.62:0/260751304 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff5100c7540 0x7ff510037d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:10.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7f336659c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3368071710 0x7f336814da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7f336659c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3368071710 0x7f336814da90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42778/0 (socket says 172.21.15.62:42778) 2023-05-15T16:40:10.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff514ff9640 1 -- 172.21.15.62:0/260751304 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c011890 con 0x7ff51003d790 2023-05-15T16:40:10.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7f3366d9d640 1 -- 172.21.15.62:0/3280213609 learned_addr learned my addr 172.21.15.62:0/3280213609 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:10.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff51d694640 1 -- 172.21.15.62:0/260751304 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5100c7910 con 0x7ff51003d790 2023-05-15T16:40:10.899 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff51d694640 1 -- 172.21.15.62:0/260751304 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff510040020 con 0x7ff51003d790 2023-05-15T16:40:10.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff68a7fc640 1 -- 172.21.15.62:0/404973920 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7ff684003b30 con 0x7ff6940bd580 2023-05-15T16:40:10.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff68a7fc640 1 --2- 172.21.15.62:0/404973920 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff678065380 0x7ff678067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff68a7fc640 1 -- 172.21.15.62:0/404973920 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff684082e40 con 0x7ff6940bd580 2023-05-15T16:40:10.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff68a7fc640 1 --2- 172.21.15.62:0/404973920 >> [v2:172.21.15.161:6811/37856,v1:172.21.15.161:6814/37856] conn(0x7ff67806da40 0x7ff67806fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff68a7fc640 1 -- 172.21.15.62:0/404973920 --> [v2:172.21.15.161:6811/37856,v1:172.21.15.161:6814/37856] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff678070500 con 0x7ff67806da40 2023-05-15T16:40:10.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff68a7fc640 1 -- 172.21.15.62:0/404973920 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6840831b0 con 0x7ff6940bd580 2023-05-15T16:40:10.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff699d7a640 1 --2- 172.21.15.62:0/404973920 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff678065380 0x7ff678067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7f336d085640 1 --2- 172.21.15.62:0/3280213609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3368148280 0x7f336814dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7fa5e1ffb640 1 -- 172.21.15.62:0/2554500690 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fa5e4012760 con 0x7fa5ec0b9cc0 2023-05-15T16:40:10.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff62ffff640 1 -- 172.21.15.62:0/1698268131 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7ff63c009070 con 0x7ff64003feb0 2023-05-15T16:40:10.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff62ffff640 1 --2- 172.21.15.62:0/1698268131 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff6340653d0 0x7ff634067880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff62ffff640 1 -- 172.21.15.62:0/1698268131 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff63c085010 con 0x7ff64003feb0 2023-05-15T16:40:10.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff62ffff640 1 --2- 172.21.15.62:0/1698268131 >> [v2:172.21.15.62:6806/37592,v1:172.21.15.62:6808/37592] conn(0x7ff63406dc80 0x7ff634070090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff62ffff640 1 -- 172.21.15.62:0/1698268131 --> [v2:172.21.15.62:6806/37592,v1:172.21.15.62:6808/37592] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff634070740 con 0x7ff63406dc80 2023-05-15T16:40:10.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff62ffff640 1 -- 172.21.15.62:0/1698268131 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff63c0853c0 con 0x7ff64003feb0 2023-05-15T16:40:10.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff6477fe640 1 --2- 172.21.15.62:0/1698268131 >> [v2:172.21.15.62:6806/37592,v1:172.21.15.62:6808/37592] conn(0x7ff63406dc80 0x7ff634070090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7febc4dc9640 1 --2- 172.21.15.62:0/917185803 >> [v2:172.21.15.62:6824/37594,v1:172.21.15.62:6825/37594] conn(0x7feba406db30 0x7feba406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff646ffd640 1 --2- 172.21.15.62:0/1698268131 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff6340653d0 0x7ff634067880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7fa5e1ffb640 1 --2- 172.21.15.62:0/2554500690 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa5d0065380 0x7fa5d0067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7fa5e1ffb640 1 -- 172.21.15.62:0/2554500690 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa5e4082f30 con 0x7fa5ec0b9cc0 2023-05-15T16:40:10.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7fa5e1ffb640 1 --2- 172.21.15.62:0/2554500690 >> [v2:172.21.15.62:6800/37593,v1:172.21.15.62:6801/37593] conn(0x7fa5d006dc30 0x7fa5d0070040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7fa5e1ffb640 1 -- 172.21.15.62:0/2554500690 --> [v2:172.21.15.62:6800/37593,v1:172.21.15.62:6801/37593] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa5d00706f0 con 0x7fa5d006dc30 2023-05-15T16:40:10.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7febbf7fe640 1 --2- 172.21.15.62:0/917185803 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7feba4065380 0x7feba4067830 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7febb40af000 tx=0x7febb40aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7f336d085640 1 -- 172.21.15.62:0/3280213609 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336814be20 con 0x7f3368071710 2023-05-15T16:40:10.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7f336d085640 1 -- 172.21.15.62:0/3280213609 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3368146f00 con 0x7f3368148280 2023-05-15T16:40:10.905 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7f336d085640 1 -- 172.21.15.62:0/3280213609 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f336814cdd0 con 0x7f336806aa20 2023-05-15T16:40:10.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff514ff9640 1 -- 172.21.15.62:0/260751304 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50c0119f0 con 0x7ff51003d790 2023-05-15T16:40:10.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff514ff9640 1 -- 172.21.15.62:0/260751304 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50c011d80 con 0x7ff51003d790 2023-05-15T16:40:10.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff51d694640 1 -- 172.21.15.62:0/260751304 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff4f8000fd0 con 0x7ff51003d790 2023-05-15T16:40:10.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff699d7a640 1 --2- 172.21.15.62:0/404973920 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff678065380 0x7ff678067830 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0b1000 tx=0x7ff68c0aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7fa5e1ffb640 1 -- 172.21.15.62:0/2554500690 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa5e40832e0 con 0x7fa5ec0b9cc0 2023-05-15T16:40:10.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff69a57b640 1 --2- 172.21.15.62:0/404973920 >> [v2:172.21.15.161:6811/37856,v1:172.21.15.161:6814/37856] conn(0x7ff67806da40 0x7ff67806fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7f2afaffd640 1 -- 172.21.15.62:0/1967928484 <== osd.7 v2:172.21.15.161:6809/37857 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f2ae4070740 con 0x7f2ae406dc80 2023-05-15T16:40:10.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7ff6477fe640 1 --2- 172.21.15.62:0/1698268131 >> [v2:172.21.15.62:6806/37592,v1:172.21.15.62:6808/37592] conn(0x7ff63406dc80 0x7ff634070090 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7fa5f0cf0640 1 --2- 172.21.15.62:0/2554500690 >> [v2:172.21.15.62:6800/37593,v1:172.21.15.62:6801/37593] conn(0x7fa5d006dc30 0x7fa5d0070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7fa5f14f1640 1 --2- 172.21.15.62:0/2554500690 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa5d0065380 0x7fa5d0067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7febc4dc9640 1 --2- 172.21.15.62:0/917185803 >> [v2:172.21.15.62:6824/37594,v1:172.21.15.62:6825/37594] conn(0x7feba406db30 0x7feba406ff40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7f96d57fa640 1 -- 172.21.15.62:0/2401121182 <== osd.4 v2:172.21.15.161:6800/37854 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f96c40708b0 con 0x7f96c406ddf0 2023-05-15T16:40:10.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.819+0000 7fa5f0cf0640 1 --2- 172.21.15.62:0/2554500690 >> [v2:172.21.15.62:6800/37593,v1:172.21.15.62:6801/37593] conn(0x7fa5d006dc30 0x7fa5d0070040 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7f336659c640 1 -- 172.21.15.62:0/3280213609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f336806aa20 msgr2=0x7f336814aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7f336659c640 1 --2- 172.21.15.62:0/3280213609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f336806aa20 0x7f336814aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7f336659c640 1 -- 172.21.15.62:0/3280213609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3368148280 msgr2=0x7f336814dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7f336659c640 1 --2- 172.21.15.62:0/3280213609 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3368148280 0x7f336814dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7f336659c640 1 -- 172.21.15.62:0/3280213609 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3360009a70 con 0x7f3368071710 2023-05-15T16:40:10.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7f3366d9d640 1 --2- 172.21.15.62:0/3280213609 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f336806aa20 0x7f336814aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-15T16:40:10.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7ff646ffd640 1 --2- 172.21.15.62:0/1698268131 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff6340653d0 0x7ff634067880 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff6400d2520 tx=0x7ff638004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7ff69a57b640 1 --2- 172.21.15.62:0/404973920 >> [v2:172.21.15.161:6811/37856,v1:172.21.15.161:6814/37856] conn(0x7ff67806da40 0x7ff67806fe50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7febbcff9640 1 -- 172.21.15.62:0/917185803 <== osd.0 v2:172.21.15.62:6824/37594 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7feba40705f0 con 0x7feba406db30 2023-05-15T16:40:10.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7f336659c640 1 --2- 172.21.15.62:0/3280213609 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3368071710 0x7f336814da90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f335800c430 tx=0x7f335800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7fa5f14f1640 1 --2- 172.21.15.62:0/2554500690 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa5d0065380 0x7fa5d0067830 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc00b850 tx=0x7fa5dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7f334f7fe640 1 -- 172.21.15.62:0/3280213609 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3358005cf0 con 0x7f3368071710 2023-05-15T16:40:10.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7f334f7fe640 1 -- 172.21.15.62:0/3280213609 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3358005e50 con 0x7f3368071710 2023-05-15T16:40:10.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7f334f7fe640 1 -- 172.21.15.62:0/3280213609 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33580072d0 con 0x7f3368071710 2023-05-15T16:40:10.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7fa5e1ffb640 1 -- 172.21.15.62:0/2554500690 <== osd.3 v2:172.21.15.62:6800/37593 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7fa5d00706f0 con 0x7fa5d006dc30 2023-05-15T16:40:10.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7f336d085640 1 -- 172.21.15.62:0/3280213609 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f336806f660 con 0x7f3368071710 2023-05-15T16:40:10.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7f336d085640 1 -- 172.21.15.62:0/3280213609 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336806ee70 con 0x7f3368071710 2023-05-15T16:40:10.915 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7f334d7fa640 1 -- 172.21.15.62:0/3280213609 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f336806adf0 con 0x7f3368071710 2023-05-15T16:40:10.915 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7f334f7fe640 1 -- 172.21.15.62:0/3280213609 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f3358007430 con 0x7f3368071710 2023-05-15T16:40:10.915 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7f334f7fe640 1 --2- 172.21.15.62:0/3280213609 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3354065380 0x7f3354067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.915 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7ff68a7fc640 1 -- 172.21.15.62:0/404973920 <== osd.6 v2:172.21.15.161:6811/37856 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff678070500 con 0x7ff67806da40 2023-05-15T16:40:10.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7f334f7fe640 1 -- 172.21.15.62:0/3280213609 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f335805b540 con 0x7f3368071710 2023-05-15T16:40:10.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7f334f7fe640 1 --2- 172.21.15.62:0/3280213609 >> [v2:172.21.15.62:6807/37591,v1:172.21.15.62:6810/37591] conn(0x7f335406db30 0x7f335406ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7f334f7fe640 1 -- 172.21.15.62:0/3280213609 --> [v2:172.21.15.62:6807/37591,v1:172.21.15.62:6810/37591] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f33540705f0 con 0x7f335406db30 2023-05-15T16:40:10.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7f334f7fe640 1 -- 172.21.15.62:0/3280213609 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7f335804f810 con 0x7f3368071710 2023-05-15T16:40:10.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7ff514ff9640 1 -- 172.21.15.62:0/260751304 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7ff50c01a400 con 0x7ff51003d790 2023-05-15T16:40:10.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7ff514ff9640 1 --2- 172.21.15.62:0/260751304 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff4fc065380 0x7ff4fc067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7ff514ff9640 1 -- 172.21.15.62:0/260751304 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff50c083200 con 0x7ff51003d790 2023-05-15T16:40:10.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7ff514ff9640 1 --2- 172.21.15.62:0/260751304 >> [v2:172.21.15.161:6808/37855,v1:172.21.15.161:6810/37855] conn(0x7ff4fc06dc30 0x7ff4fc070040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:10.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7ff514ff9640 1 -- 172.21.15.62:0/260751304 --> [v2:172.21.15.161:6808/37855,v1:172.21.15.161:6810/37855] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff4fc0706f0 con 0x7ff4fc06dc30 2023-05-15T16:40:10.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7ff514ff9640 1 -- 172.21.15.62:0/260751304 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff50c0835b0 con 0x7ff51003d790 2023-05-15T16:40:10.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7ff5177fe640 1 --2- 172.21.15.62:0/260751304 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff4fc065380 0x7ff4fc067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7ff51ce93640 1 --2- 172.21.15.62:0/260751304 >> [v2:172.21.15.161:6808/37855,v1:172.21.15.161:6810/37855] conn(0x7ff4fc06dc30 0x7ff4fc070040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7f3366d9d640 1 --2- 172.21.15.62:0/3280213609 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3354065380 0x7f3354067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.823+0000 7f336759e640 1 --2- 172.21.15.62:0/3280213609 >> [v2:172.21.15.62:6807/37591,v1:172.21.15.62:6810/37591] conn(0x7f335406db30 0x7f335406ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:10.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.827+0000 7f336759e640 1 --2- 172.21.15.62:0/3280213609 >> [v2:172.21.15.62:6807/37591,v1:172.21.15.62:6810/37591] conn(0x7f335406db30 0x7f335406ff40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.827+0000 7ff51ce93640 1 --2- 172.21.15.62:0/260751304 >> [v2:172.21.15.161:6808/37855,v1:172.21.15.161:6810/37855] conn(0x7ff4fc06dc30 0x7ff4fc070040 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.827+0000 7f3366d9d640 1 --2- 172.21.15.62:0/3280213609 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3354065380 0x7f3354067830 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f335c00aee0 tx=0x7f335c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.827+0000 7f334f7fe640 1 -- 172.21.15.62:0/3280213609 <== osd.2 v2:172.21.15.62:6807/37591 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7f33540705f0 con 0x7f335406db30 2023-05-15T16:40:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.827+0000 7ff514ff9640 1 -- 172.21.15.62:0/260751304 <== osd.5 v2:172.21.15.161:6808/37855 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff4fc0706f0 con 0x7ff4fc06dc30 2023-05-15T16:40:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.827+0000 7ff5177fe640 1 --2- 172.21.15.62:0/260751304 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff4fc065380 0x7ff4fc067830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff5040b2000 tx=0x7ff5040aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.831+0000 7ff62ffff640 1 -- 172.21.15.62:0/1698268131 <== osd.1 v2:172.21.15.62:6806/37592 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+25106 (crc 0 0 0) 0x7ff634070740 con 0x7ff63406dc80 2023-05-15T16:40:10.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.839+0000 7f334d7fa640 1 -- 172.21.15.62:0/3280213609 --> [v2:172.21.15.62:6807/37591,v1:172.21.15.62:6810/37591] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3368073a90 con 0x7f335406db30 2023-05-15T16:40:10.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.839+0000 7f334f7fe640 1 -- 172.21.15.62:0/3280213609 <== osd.2 v2:172.21.15.62:6807/37591 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3368073a90 con 0x7f335406db30 2023-05-15T16:40:10.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.839+0000 7fa5f3755640 1 -- 172.21.15.62:0/2554500690 --> [v2:172.21.15.62:6800/37593,v1:172.21.15.62:6801/37593] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa5ec155100 con 0x7fa5d006dc30 2023-05-15T16:40:10.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.843+0000 7fa5e1ffb640 1 -- 172.21.15.62:0/2554500690 <== osd.3 v2:172.21.15.62:6800/37593 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa5ec155100 con 0x7fa5d006dc30 2023-05-15T16:40:10.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.843+0000 7fa5f3755640 1 -- 172.21.15.62:0/2554500690 >> [v2:172.21.15.62:6800/37593,v1:172.21.15.62:6801/37593] conn(0x7fa5d006dc30 msgr2=0x7fa5d0070040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.843+0000 7fa5f3755640 1 --2- 172.21.15.62:0/2554500690 >> [v2:172.21.15.62:6800/37593,v1:172.21.15.62:6801/37593] conn(0x7fa5d006dc30 0x7fa5d0070040 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.843+0000 7fa5f3755640 1 -- 172.21.15.62:0/2554500690 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa5d0065380 msgr2=0x7fa5d0067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.843+0000 7fa5f3755640 1 --2- 172.21.15.62:0/2554500690 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa5d0065380 0x7fa5d0067830 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa5dc00b850 tx=0x7fa5dc008040 comp rx=0 tx=0).stop 2023-05-15T16:40:10.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.843+0000 7fa5f3755640 1 -- 172.21.15.62:0/2554500690 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5ec0b9cc0 msgr2=0x7fa5ec0b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.843+0000 7fa5f3755640 1 --2- 172.21.15.62:0/2554500690 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa5ec0b9cc0 0x7fa5ec0b3090 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa5e400caa0 tx=0x7fa5e400cf60 comp rx=0 tx=0).stop 2023-05-15T16:40:10.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.843+0000 7fa5f1cf2640 1 -- 172.21.15.62:0/2554500690 reap_dead start 2023-05-15T16:40:10.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.843+0000 7fa5f3755640 1 -- 172.21.15.62:0/2554500690 shutdown_connections 2023-05-15T16:40:10.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.843+0000 7fa5f3755640 1 -- 172.21.15.62:0/2554500690 >> 172.21.15.62:0/2554500690 conn(0x7fa5ec0bc5d0 msgr2=0x7fa5ec13f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:10.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.843+0000 7fa5f3755640 1 -- 172.21.15.62:0/2554500690 shutdown_connections 2023-05-15T16:40:10.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.843+0000 7fa5f3755640 1 -- 172.21.15.62:0/2554500690 wait complete. 2023-05-15T16:40:10.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.847+0000 7febc55ca640 1 -- 172.21.15.62:0/917185803 --> [v2:172.21.15.62:6824/37594,v1:172.21.15.62:6825/37594] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7febb80ca3b0 con 0x7feba406db30 2023-05-15T16:40:10.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.847+0000 7febbcff9640 1 -- 172.21.15.62:0/917185803 <== osd.0 v2:172.21.15.62:6824/37594 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7febc0071040 con 0x7feba406db30 2023-05-15T16:40:10.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.847+0000 7febaa7fc640 1 -- 172.21.15.62:0/917185803 >> [v2:172.21.15.62:6824/37594,v1:172.21.15.62:6825/37594] conn(0x7feba406db30 msgr2=0x7feba406ff40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.847+0000 7febaa7fc640 1 --2- 172.21.15.62:0/917185803 >> [v2:172.21.15.62:6824/37594,v1:172.21.15.62:6825/37594] conn(0x7feba406db30 0x7feba406ff40 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.847+0000 7febaa7fc640 1 -- 172.21.15.62:0/917185803 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7feba4065380 msgr2=0x7feba4067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.847+0000 7febaa7fc640 1 --2- 172.21.15.62:0/917185803 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7feba4065380 0x7feba4067830 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7febb40af000 tx=0x7febb40aa000 comp rx=0 tx=0).stop 2023-05-15T16:40:10.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.847+0000 7febaa7fc640 1 -- 172.21.15.62:0/917185803 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febb80cc310 msgr2=0x7febb80c8170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.847+0000 7febaa7fc640 1 --2- 172.21.15.62:0/917185803 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7febb80cc310 0x7febb80c8170 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7febac00e550 tx=0x7febac00ea10 comp rx=0 tx=0).stop 2023-05-15T16:40:10.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.847+0000 7febc4dc9640 1 -- 172.21.15.62:0/917185803 reap_dead start 2023-05-15T16:40:10.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.847+0000 7febaa7fc640 1 -- 172.21.15.62:0/917185803 shutdown_connections 2023-05-15T16:40:10.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.847+0000 7febaa7fc640 1 -- 172.21.15.62:0/917185803 >> 172.21.15.62:0/917185803 conn(0x7febb8043190 msgr2=0x7febb8040400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:10.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.847+0000 7febaa7fc640 1 -- 172.21.15.62:0/917185803 shutdown_connections 2023-05-15T16:40:10.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.847+0000 7febaa7fc640 1 -- 172.21.15.62:0/917185803 wait complete. 2023-05-15T16:40:10.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.847+0000 7f96dd211640 1 -- 172.21.15.62:0/2401121182 --> [v2:172.21.15.161:6800/37854,v1:172.21.15.161:6801/37854] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f96d8073a90 con 0x7f96c406ddf0 2023-05-15T16:40:10.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.851+0000 7ff647fff640 1 -- 172.21.15.62:0/1698268131 --> [v2:172.21.15.62:6806/37592,v1:172.21.15.62:6808/37592] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff6400057a0 con 0x7ff63406dc80 2023-05-15T16:40:10.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.851+0000 7ff62ffff640 1 -- 172.21.15.62:0/1698268131 <== osd.1 v2:172.21.15.62:6806/37592 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff6400057a0 con 0x7ff63406dc80 2023-05-15T16:40:10.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.851+0000 7ff647fff640 1 -- 172.21.15.62:0/1698268131 >> [v2:172.21.15.62:6806/37592,v1:172.21.15.62:6808/37592] conn(0x7ff63406dc80 msgr2=0x7ff634070090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.851+0000 7ff647fff640 1 --2- 172.21.15.62:0/1698268131 >> [v2:172.21.15.62:6806/37592,v1:172.21.15.62:6808/37592] conn(0x7ff63406dc80 0x7ff634070090 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.851+0000 7ff647fff640 1 -- 172.21.15.62:0/1698268131 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff6340653d0 msgr2=0x7ff634067880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.851+0000 7ff647fff640 1 --2- 172.21.15.62:0/1698268131 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff6340653d0 0x7ff634067880 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff6400d2520 tx=0x7ff638004740 comp rx=0 tx=0).stop 2023-05-15T16:40:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.851+0000 7ff647fff640 1 -- 172.21.15.62:0/1698268131 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff64003feb0 msgr2=0x7ff6400d1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.851+0000 7ff647fff640 1 --2- 172.21.15.62:0/1698268131 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff64003feb0 0x7ff6400d1890 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ff63c009f30 tx=0x7ff63c00c4f0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.851+0000 7ff6477fe640 1 -- 172.21.15.62:0/1698268131 reap_dead start 2023-05-15T16:40:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.851+0000 7f334d7fa640 1 -- 172.21.15.62:0/3280213609 >> [v2:172.21.15.62:6807/37591,v1:172.21.15.62:6810/37591] conn(0x7f335406db30 msgr2=0x7f335406ff40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.851+0000 7f334d7fa640 1 --2- 172.21.15.62:0/3280213609 >> [v2:172.21.15.62:6807/37591,v1:172.21.15.62:6810/37591] conn(0x7f335406db30 0x7f335406ff40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.851+0000 7f334d7fa640 1 -- 172.21.15.62:0/3280213609 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3354065380 msgr2=0x7f3354067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.851+0000 7f334d7fa640 1 --2- 172.21.15.62:0/3280213609 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3354065380 0x7f3354067830 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f335c00aee0 tx=0x7f335c008040 comp rx=0 tx=0).stop 2023-05-15T16:40:10.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.851+0000 7f334d7fa640 1 -- 172.21.15.62:0/3280213609 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3368071710 msgr2=0x7f336814da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.851+0000 7f334d7fa640 1 --2- 172.21.15.62:0/3280213609 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3368071710 0x7f336814da90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f335800c430 tx=0x7f335800c8f0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.851+0000 7f336759e640 1 -- 172.21.15.62:0/3280213609 reap_dead start 2023-05-15T16:40:10.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.851+0000 7f334d7fa640 1 -- 172.21.15.62:0/3280213609 shutdown_connections 2023-05-15T16:40:10.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.851+0000 7f334d7fa640 1 -- 172.21.15.62:0/3280213609 >> 172.21.15.62:0/3280213609 conn(0x7f33680bcf30 msgr2=0x7f33680bb520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:10.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.851+0000 7f334d7fa640 1 -- 172.21.15.62:0/3280213609 shutdown_connections 2023-05-15T16:40:10.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.851+0000 7f334d7fa640 1 -- 172.21.15.62:0/3280213609 wait complete. 2023-05-15T16:40:10.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.851+0000 7f96d57fa640 1 -- 172.21.15.62:0/2401121182 <== osd.4 v2:172.21.15.161:6800/37854 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f96d8073a90 con 0x7f96c406ddf0 2023-05-15T16:40:10.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.855+0000 7f2b0359e640 1 -- 172.21.15.62:0/1967928484 --> [v2:172.21.15.161:6809/37857,v1:172.21.15.161:6813/37857] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2ae8002cc0 con 0x7f2ae406dc80 2023-05-15T16:40:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.855+0000 7ff647fff640 1 -- 172.21.15.62:0/1698268131 shutdown_connections 2023-05-15T16:40:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.855+0000 7ff647fff640 1 -- 172.21.15.62:0/1698268131 >> 172.21.15.62:0/1698268131 conn(0x7ff6400434d0 msgr2=0x7ff640006960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.855+0000 7ff647fff640 1 -- 172.21.15.62:0/1698268131 shutdown_connections 2023-05-15T16:40:10.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.855+0000 7ff647fff640 1 -- 172.21.15.62:0/1698268131 wait complete. 2023-05-15T16:40:10.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.855+0000 7f96ce7fc640 1 -- 172.21.15.62:0/2401121182 >> [v2:172.21.15.161:6800/37854,v1:172.21.15.161:6801/37854] conn(0x7f96c406ddf0 msgr2=0x7f96c4070200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.855+0000 7f96ce7fc640 1 --2- 172.21.15.62:0/2401121182 >> [v2:172.21.15.161:6800/37854,v1:172.21.15.161:6801/37854] conn(0x7f96c406ddf0 0x7f96c4070200 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.855+0000 7f96ce7fc640 1 -- 172.21.15.62:0/2401121182 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f96c4065540 msgr2=0x7f96c40679f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.855+0000 7f96ce7fc640 1 --2- 172.21.15.62:0/2401121182 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f96c4065540 0x7f96c40679f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f96c0007fd0 tx=0x7f96c0009040 comp rx=0 tx=0).stop 2023-05-15T16:40:10.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.855+0000 7f96ce7fc640 1 -- 172.21.15.62:0/2401121182 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d814dc20 msgr2=0x7f96d81e7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.855+0000 7f96ce7fc640 1 --2- 172.21.15.62:0/2401121182 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f96d814dc20 0x7f96d81e7400 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f96d000c410 tx=0x7f96d000c8d0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.855+0000 7f96dca10640 1 -- 172.21.15.62:0/2401121182 reap_dead start 2023-05-15T16:40:10.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.855+0000 7f96ce7fc640 1 -- 172.21.15.62:0/2401121182 shutdown_connections 2023-05-15T16:40:10.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.855+0000 7f96ce7fc640 1 -- 172.21.15.62:0/2401121182 >> 172.21.15.62:0/2401121182 conn(0x7f96d80b8cc0 msgr2=0x7f96d80b6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:10.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.855+0000 7f96ce7fc640 1 -- 172.21.15.62:0/2401121182 shutdown_connections 2023-05-15T16:40:10.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.855+0000 7f2afaffd640 1 -- 172.21.15.62:0/1967928484 <== osd.7 v2:172.21.15.161:6809/37857 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f2ae8002cc0 con 0x7f2ae406dc80 2023-05-15T16:40:10.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.855+0000 7f96ce7fc640 1 -- 172.21.15.62:0/2401121182 wait complete. 2023-05-15T16:40:10.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.859+0000 7f2b0359e640 1 -- 172.21.15.62:0/1967928484 >> [v2:172.21.15.161:6809/37857,v1:172.21.15.161:6813/37857] conn(0x7f2ae406dc80 msgr2=0x7f2ae4070090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.859+0000 7f2b0359e640 1 --2- 172.21.15.62:0/1967928484 >> [v2:172.21.15.161:6809/37857,v1:172.21.15.161:6813/37857] conn(0x7f2ae406dc80 0x7f2ae4070090 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.859+0000 7f2b0359e640 1 -- 172.21.15.62:0/1967928484 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f2ae4065450 msgr2=0x7f2ae4067900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.859+0000 7f2b0359e640 1 --2- 172.21.15.62:0/1967928484 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f2ae4065450 0x7f2ae4067900 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f2af400d8b0 tx=0x7f2af4008040 comp rx=0 tx=0).stop 2023-05-15T16:40:10.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.859+0000 7f2b0359e640 1 -- 172.21.15.62:0/1967928484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b040b4600 msgr2=0x7f2b04200440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.859+0000 7f2b0359e640 1 --2- 172.21.15.62:0/1967928484 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f2b040b4600 0x7f2b04200440 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f2aec00d7c0 tx=0x7f2aec00dc80 comp rx=0 tx=0).stop 2023-05-15T16:40:10.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.859+0000 7f2b02d9d640 1 -- 172.21.15.62:0/1967928484 reap_dead start 2023-05-15T16:40:10.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.859+0000 7f2b0359e640 1 -- 172.21.15.62:0/1967928484 shutdown_connections 2023-05-15T16:40:10.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.859+0000 7f2b0359e640 1 -- 172.21.15.62:0/1967928484 >> 172.21.15.62:0/1967928484 conn(0x7f2b0406a3f0 msgr2=0x7f2b04147e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:10.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.859+0000 7f2b0359e640 1 -- 172.21.15.62:0/1967928484 shutdown_connections 2023-05-15T16:40:10.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.859+0000 7f2b0359e640 1 -- 172.21.15.62:0/1967928484 wait complete. 2023-05-15T16:40:10.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.859+0000 7ff51d694640 1 -- 172.21.15.62:0/260751304 --> [v2:172.21.15.161:6808/37855,v1:172.21.15.161:6810/37855] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff4f8002cc0 con 0x7ff4fc06dc30 2023-05-15T16:40:10.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.859+0000 7ff514ff9640 1 -- 172.21.15.62:0/260751304 <== osd.5 v2:172.21.15.161:6808/37855 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff4f8002cc0 con 0x7ff4fc06dc30 2023-05-15T16:40:10.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.867+0000 7ff69bfde640 1 -- 172.21.15.62:0/404973920 --> [v2:172.21.15.161:6811/37856,v1:172.21.15.161:6814/37856] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff67c002cc0 con 0x7ff67806da40 2023-05-15T16:40:10.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.867+0000 7ff51d694640 1 -- 172.21.15.62:0/260751304 >> [v2:172.21.15.161:6808/37855,v1:172.21.15.161:6810/37855] conn(0x7ff4fc06dc30 msgr2=0x7ff4fc070040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.867+0000 7ff68a7fc640 1 -- 172.21.15.62:0/404973920 <== osd.6 v2:172.21.15.161:6811/37856 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff67c002cc0 con 0x7ff67806da40 2023-05-15T16:40:10.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.867+0000 7ff51d694640 1 --2- 172.21.15.62:0/260751304 >> [v2:172.21.15.161:6808/37855,v1:172.21.15.161:6810/37855] conn(0x7ff4fc06dc30 0x7ff4fc070040 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.867+0000 7ff51d694640 1 -- 172.21.15.62:0/260751304 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff4fc065380 msgr2=0x7ff4fc067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.867+0000 7ff51d694640 1 --2- 172.21.15.62:0/260751304 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff4fc065380 0x7ff4fc067830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff5040b2000 tx=0x7ff5040aa070 comp rx=0 tx=0).stop 2023-05-15T16:40:10.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.867+0000 7ff51d694640 1 -- 172.21.15.62:0/260751304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff51003d790 msgr2=0x7ff510039b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.867+0000 7ff51d694640 1 --2- 172.21.15.62:0/260751304 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff51003d790 0x7ff510039b70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff50c00b470 tx=0x7ff50c00b930 comp rx=0 tx=0).stop 2023-05-15T16:40:10.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.867+0000 7ff51ce93640 1 -- 172.21.15.62:0/260751304 reap_dead start 2023-05-15T16:40:10.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.867+0000 7ff51d694640 1 -- 172.21.15.62:0/260751304 shutdown_connections 2023-05-15T16:40:10.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.867+0000 7ff51d694640 1 -- 172.21.15.62:0/260751304 >> 172.21.15.62:0/260751304 conn(0x7ff510007da0 msgr2=0x7ff51003de90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:10.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.867+0000 7ff51d694640 1 -- 172.21.15.62:0/260751304 shutdown_connections 2023-05-15T16:40:10.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.867+0000 7ff51d694640 1 -- 172.21.15.62:0/260751304 wait complete. 2023-05-15T16:40:10.942 INFO:teuthology.orchestra.run.smithi062.stdout:55834574857 2023-05-15T16:40:10.943 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-15T16:40:10.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.871+0000 7ff677fff640 1 -- 172.21.15.62:0/404973920 >> [v2:172.21.15.161:6811/37856,v1:172.21.15.161:6814/37856] conn(0x7ff67806da40 msgr2=0x7ff67806fe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.871+0000 7ff677fff640 1 --2- 172.21.15.62:0/404973920 >> [v2:172.21.15.161:6811/37856,v1:172.21.15.161:6814/37856] conn(0x7ff67806da40 0x7ff67806fe50 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.871+0000 7ff677fff640 1 -- 172.21.15.62:0/404973920 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff678065380 msgr2=0x7ff678067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.871+0000 7ff677fff640 1 --2- 172.21.15.62:0/404973920 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff678065380 0x7ff678067830 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff68c0b1000 tx=0x7ff68c0aa000 comp rx=0 tx=0).stop 2023-05-15T16:40:10.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.871+0000 7ff677fff640 1 -- 172.21.15.62:0/404973920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6940bd580 msgr2=0x7ff69413c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:10.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.871+0000 7ff677fff640 1 --2- 172.21.15.62:0/404973920 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6940bd580 0x7ff69413c100 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff68400c7f0 tx=0x7ff68400ccb0 comp rx=0 tx=0).stop 2023-05-15T16:40:10.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.871+0000 7ff69a57b640 1 -- 172.21.15.62:0/404973920 reap_dead start 2023-05-15T16:40:10.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.871+0000 7ff677fff640 1 -- 172.21.15.62:0/404973920 shutdown_connections 2023-05-15T16:40:10.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.871+0000 7ff677fff640 1 -- 172.21.15.62:0/404973920 >> 172.21.15.62:0/404973920 conn(0x7ff69406b4f0 msgr2=0x7ff6940b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:10.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.875+0000 7ff677fff640 1 -- 172.21.15.62:0/404973920 shutdown_connections 2023-05-15T16:40:10.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:10.875+0000 7ff677fff640 1 -- 172.21.15.62:0/404973920 wait complete. 2023-05-15T16:40:10.946 INFO:teuthology.orchestra.run.smithi062.stdout:55834574857 2023-05-15T16:40:10.946 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-15T16:40:10.947 INFO:teuthology.orchestra.run.smithi062.stdout:55834574857 2023-05-15T16:40:10.947 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-15T16:40:10.948 INFO:teuthology.orchestra.run.smithi062.stdout:55834574857 2023-05-15T16:40:10.948 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-15T16:40:10.949 INFO:teuthology.orchestra.run.smithi062.stdout:55834574855 2023-05-15T16:40:10.949 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-15T16:40:10.950 INFO:teuthology.orchestra.run.smithi062.stdout:55834574856 2023-05-15T16:40:10.951 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-15T16:40:10.951 INFO:teuthology.orchestra.run.smithi062.stdout:55834574855 2023-05-15T16:40:10.952 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-15T16:40:10.952 INFO:teuthology.orchestra.run.smithi062.stdout:55834574856 2023-05-15T16:40:10.953 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-15T16:40:11.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.155+0000 7fad2613e640 1 Processor -- start 2023-05-15T16:40:11.255 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.155+0000 7fad2613e640 1 -- start start 2023-05-15T16:40:11.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.155+0000 7fad2613e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fad200b4470 0x7fad20145fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.155+0000 7fad2613e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fad2013feb0 0x7fad20146500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.256 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.155+0000 7fad2613e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad200b5b60 con 0x7fad200b7f80 2023-05-15T16:40:11.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.155+0000 7fad2613e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad20145ba0 con 0x7fad2013feb0 2023-05-15T16:40:11.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.155+0000 7fad2613e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad20071ed0 con 0x7fad200b4470 2023-05-15T16:40:11.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.155+0000 7fad1ffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fad2013feb0 0x7fad20146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.155+0000 7fad1ffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fad2013feb0 0x7fad20146500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42792/0 (socket says 172.21.15.62:42792) 2023-05-15T16:40:11.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.155+0000 7fad1ffff640 1 -- 172.21.15.62:0/1812730743 learned_addr learned my addr 172.21.15.62:0/1812730743 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:11.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.155+0000 7fad1f7fe640 1 --2- 172.21.15.62:0/1812730743 >> v2:172.21.15.161:3300/0 conn(0x7fad200b4470 0x7fad20145fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.155+0000 7fad1ffff640 1 -- 172.21.15.62:0/1812730743 >> v2:172.21.15.161:3300/0 conn(0x7fad200b4470 msgr2=0x7fad20145fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:11.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.155+0000 7fad1ffff640 1 --2- 172.21.15.62:0/1812730743 >> v2:172.21.15.161:3300/0 conn(0x7fad200b4470 0x7fad20145fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.155+0000 7fad1ffff640 1 -- 172.21.15.62:0/1812730743 >> v1:172.21.15.161:6789/0 conn(0x7fad200b7f80 legacy=0x7fad2013f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:11.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.155+0000 7fad1ffff640 1 -- 172.21.15.62:0/1812730743 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad200b2f20 con 0x7fad2013feb0 2023-05-15T16:40:11.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fb31b2c4640 1 Processor -- start 2023-05-15T16:40:11.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fb31b2c4640 1 -- start start 2023-05-15T16:40:11.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fb31b2c4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb314146e90 0x7fb3140b8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fb31b2c4640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31406d290 con 0x7fb314140c00 2023-05-15T16:40:11.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fb31b2c4640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb31414a070 con 0x7fb314140830 2023-05-15T16:40:11.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fb31b2c4640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3140b9360 con 0x7fb314146e90 2023-05-15T16:40:11.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fb31885f640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb314140c00 0x7fb314146780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37880/0 (socket says 172.21.15.62:37880) 2023-05-15T16:40:11.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fb31885f640 1 -- 172.21.15.62:0/1508138172 learned_addr learned my addr 172.21.15.62:0/1508138172 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:11.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fee0803a640 1 Processor -- start 2023-05-15T16:40:11.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fee0803a640 1 -- start start 2023-05-15T16:40:11.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fb319861640 1 --2- 172.21.15.62:0/1508138172 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb314146e90 0x7fb3140b8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fb30bfff640 1 -- 172.21.15.62:0/1508138172 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872291771 0 0) 0x7fb31406d290 con 0x7fb314140c00 2023-05-15T16:40:11.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fb30bfff640 1 -- 172.21.15.62:0/1508138172 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb300003530 con 0x7fb314140c00 2023-05-15T16:40:11.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fee0803a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedf80072c0 0x7fedf80f1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fee0803a640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf803e8e0 con 0x7fedf8006ef0 2023-05-15T16:40:11.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fee0803a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedf803eb60 con 0x7fedf80f1b80 2023-05-15T16:40:11.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fee0803a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf803a9b0 con 0x7fedf80072c0 2023-05-15T16:40:11.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fee05dd6640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fedf8006ef0 0x7fedf803e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37888/0 (socket says 172.21.15.62:37888) 2023-05-15T16:40:11.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fee05dd6640 1 -- 172.21.15.62:0/1992951234 learned_addr learned my addr 172.21.15.62:0/1992951234 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:11.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fb30bfff640 1 -- 172.21.15.62:0/1508138172 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3234165659 0 0) 0x7fb31414a070 con 0x7fb314140830 2023-05-15T16:40:11.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fb30bfff640 1 -- 172.21.15.62:0/1508138172 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb31406d290 con 0x7fb314140830 2023-05-15T16:40:11.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fb319861640 1 -- 172.21.15.62:0/1508138172 >> v1:172.21.15.161:6789/0 conn(0x7fb314140830 legacy=0x7fb31406cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fb319861640 1 -- 172.21.15.62:0/1508138172 >> v1:172.21.15.62:6789/0 conn(0x7fb314140c00 legacy=0x7fb314146780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fb319861640 1 -- 172.21.15.62:0/1508138172 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb31414a350 con 0x7fb314146e90 2023-05-15T16:40:11.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fd145ba8640 1 Processor -- start 2023-05-15T16:40:11.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fd145ba8640 1 -- start start 2023-05-15T16:40:11.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fee055d5640 1 --2- 172.21.15.62:0/1992951234 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedf80072c0 0x7fedf80f1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fee04dd4640 1 -- 172.21.15.62:0/1992951234 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 769499100 0 0) 0x7fedf803eb60 con 0x7fedf80f1b80 2023-05-15T16:40:11.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fee04dd4640 1 -- 172.21.15.62:0/1992951234 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedec003530 con 0x7fedf80f1b80 2023-05-15T16:40:11.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fee04dd4640 1 -- 172.21.15.62:0/1992951234 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2945631641 0 0) 0x7fedf803e8e0 con 0x7fedf8006ef0 2023-05-15T16:40:11.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fee04dd4640 1 -- 172.21.15.62:0/1992951234 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedf803eb60 con 0x7fedf8006ef0 2023-05-15T16:40:11.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fa2d59c8640 1 Processor -- start 2023-05-15T16:40:11.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.159+0000 7fa2d59c8640 1 -- start start 2023-05-15T16:40:11.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fee04dd4640 1 -- 172.21.15.62:0/1992951234 <== mon.1 v1:172.21.15.161:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1395614309 0 0) 0x7fedec003530 con 0x7fedf80f1b80 2023-05-15T16:40:11.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fee04dd4640 1 -- 172.21.15.62:0/1992951234 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedf80072c0 msgr2=0x7fedf80f1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:11.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fee04dd4640 1 --2- 172.21.15.62:0/1992951234 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedf80072c0 0x7fedf80f1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fee04dd4640 1 -- 172.21.15.62:0/1992951234 >> v1:172.21.15.62:6789/0 conn(0x7fedf8006ef0 legacy=0x7fedf803e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fee04dd4640 1 -- 172.21.15.62:0/1992951234 --> v1:172.21.15.161:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf8039ed0 con 0x7fedf80f1b80 2023-05-15T16:40:11.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fee04dd4640 1 -- 172.21.15.62:0/1992951234 <== mon.1 v1:172.21.15.161:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7fedf0001680 con 0x7fedf80f1b80 2023-05-15T16:40:11.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fee04dd4640 1 -- 172.21.15.62:0/1992951234 >> v1:172.21.15.161:6789/0 conn(0x7fedf80f1b80 legacy=0x7fedf80f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fee04dd4640 1 --2- 172.21.15.62:0/1992951234 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedec003b10 0x7fedec003f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fee04dd4640 1 --2- 172.21.15.62:0/1992951234 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedec0047d0 0x7fedec004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fee04dd4640 1 --2- 172.21.15.62:0/1992951234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedec009980 0x7fedec005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fee04dd4640 1 -- 172.21.15.62:0/1992951234 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf803a9b0 con 0x7fedec003b10 2023-05-15T16:40:11.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fee04dd4640 1 -- 172.21.15.62:0/1992951234 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedec014720 con 0x7fedec009980 2023-05-15T16:40:11.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fee04dd4640 1 -- 172.21.15.62:0/1992951234 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedec0148e0 con 0x7fedec0047d0 2023-05-15T16:40:11.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fad1ffff640 1 --2- 172.21.15.62:0/1812730743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad2013feb0 0x7fad20146500 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fad20065f50 tx=0x7fad1001ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e0d5c02a61b174 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fd145ba8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd140071a90 0x7fd1400b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fd145ba8640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fd1400b7ed0 0x7fd1400b1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fd145ba8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1400af610 con 0x7fd140145410 2023-05-15T16:40:11.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fd145ba8640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1401457e0 con 0x7fd1400b7ed0 2023-05-15T16:40:11.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fd145ba8640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1400afe90 con 0x7fd140071a90 2023-05-15T16:40:11.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fa2d59c8640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa2d00b8500 0x7fa2d00b77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fa2d59c8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa2d00b8950 0x7fa2d00b7d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fa2d59c8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2d0157780 con 0x7fa2d0071640 2023-05-15T16:40:11.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fa2d59c8640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d00b5170 con 0x7fa2d00b8500 2023-05-15T16:40:11.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fa2d59c8640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2d0071a10 con 0x7fa2d00b8950 2023-05-15T16:40:11.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fee065d7640 1 --2- 172.21.15.62:0/1992951234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedec009980 0x7fedec005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fee05dd6640 1 --2- 172.21.15.62:0/1992951234 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedec003b10 0x7fedec003f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fa2ce7fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa2d00b8500 0x7fa2d00b77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fa2ce7fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa2d00b8500 0x7fa2d00b77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42816/0 (socket says 172.21.15.62:42816) 2023-05-15T16:40:11.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fa2ce7fc640 1 -- 172.21.15.62:0/4108812916 learned_addr learned my addr 172.21.15.62:0/4108812916 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:11.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fd13f7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fd140145410 0x7fd1400b50d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.62:57948/0 (socket says 172.21.15.62:57948) 2023-05-15T16:40:11.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fd13f7fe640 1 -- 172.21.15.62:0/1133479321 learned_addr learned my addr 172.21.15.62:0/1133479321 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:11.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fd13ffff640 1 --2- 172.21.15.62:0/1133479321 >> v2:172.21.15.62:3300/0 conn(0x7fd1400b7ed0 0x7fd1400b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fd13effd640 1 --2- 172.21.15.62:0/1133479321 >> v2:172.21.15.161:3300/0 conn(0x7fd140071a90 0x7fd1400b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fee055d5640 1 --2- 172.21.15.62:0/1992951234 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedec0047d0 0x7fedec004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fee065d7640 1 -- 172.21.15.62:0/1992951234 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedec0047d0 msgr2=0x7fedec004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:11.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fee065d7640 1 --2- 172.21.15.62:0/1992951234 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedec0047d0 0x7fedec004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fee065d7640 1 -- 172.21.15.62:0/1992951234 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedec003b10 msgr2=0x7fedec003f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:11.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fee065d7640 1 --2- 172.21.15.62:0/1992951234 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedec003b10 0x7fedec003f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fee065d7640 1 -- 172.21.15.62:0/1992951234 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf8039ed0 con 0x7fedec009980 2023-05-15T16:40:11.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fad1e7fc640 1 -- 172.21.15.62:0/1812730743 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad100a89b0 con 0x7fad2013feb0 2023-05-15T16:40:11.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fad1e7fc640 1 -- 172.21.15.62:0/1812730743 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad100a8b10 con 0x7fad2013feb0 2023-05-15T16:40:11.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fad1e7fc640 1 -- 172.21.15.62:0/1812730743 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad100a8ea0 con 0x7fad2013feb0 2023-05-15T16:40:11.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fa2cf7fe640 1 --2- 172.21.15.62:0/4108812916 >> v2:172.21.15.161:3300/0 conn(0x7fa2d00b8950 0x7fa2d00b7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fd13ffff640 1 -- 172.21.15.62:0/1133479321 >> v2:172.21.15.161:3300/0 conn(0x7fd140071a90 msgr2=0x7fd1400b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:11.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fd13ffff640 1 --2- 172.21.15.62:0/1133479321 >> v2:172.21.15.161:3300/0 conn(0x7fd140071a90 0x7fd1400b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fd13ffff640 1 -- 172.21.15.62:0/1133479321 >> v1:172.21.15.161:6789/0 conn(0x7fd140145410 legacy=0x7fd1400b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:11.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fd13ffff640 1 -- 172.21.15.62:0/1133479321 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1400b7780 con 0x7fd1400b7ed0 2023-05-15T16:40:11.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fa2ce7fc640 1 -- 172.21.15.62:0/4108812916 >> v2:172.21.15.161:3300/0 conn(0x7fa2d00b8950 msgr2=0x7fa2d00b7d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:11.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fa2ce7fc640 1 --2- 172.21.15.62:0/4108812916 >> v2:172.21.15.161:3300/0 conn(0x7fa2d00b8950 0x7fa2d00b7d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fa2ce7fc640 1 -- 172.21.15.62:0/4108812916 >> v1:172.21.15.161:6789/0 conn(0x7fa2d0071640 legacy=0x7fa2d00b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fa2ce7fc640 1 -- 172.21.15.62:0/4108812916 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d00b5370 con 0x7fa2d00b8500 2023-05-15T16:40:11.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fad2613e640 1 -- 172.21.15.62:0/1812730743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad2013feb0 msgr2=0x7fad20146500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fad2613e640 1 --2- 172.21.15.62:0/1812730743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad2013feb0 0x7fad20146500 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fad20065f50 tx=0x7fad1001ecb0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7f52a92b6640 1 Processor -- start 2023-05-15T16:40:11.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7f10ba978640 1 Processor -- start 2023-05-15T16:40:11.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fb319861640 1 --2- 172.21.15.62:0/1508138172 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb314146e90 0x7fb3140b8e20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb30c009dc0 tx=0x7fb30c020d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=570be73fc0c7f863 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fad2613e640 1 -- 172.21.15.62:0/1812730743 shutdown_connections 2023-05-15T16:40:11.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fad2613e640 1 --2- 172.21.15.62:0/1812730743 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad2013feb0 0x7fad20146500 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fad2613e640 1 --2- 172.21.15.62:0/1812730743 >> v2:172.21.15.161:3300/0 conn(0x7fad200b4470 0x7fad20145fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fad2613e640 1 -- 172.21.15.62:0/1812730743 >> 172.21.15.62:0/1812730743 conn(0x7fad200bc5d0 msgr2=0x7fad200b8420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:11.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7f10ba978640 1 -- start start 2023-05-15T16:40:11.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7f52a92b6640 1 -- start start 2023-05-15T16:40:11.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fad2613e640 1 -- 172.21.15.62:0/1812730743 shutdown_connections 2023-05-15T16:40:11.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fb30bfff640 1 -- 172.21.15.62:0/1508138172 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c0a9d40 con 0x7fb314146e90 2023-05-15T16:40:11.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fb30bfff640 1 -- 172.21.15.62:0/1508138172 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30c0b1440 con 0x7fb314146e90 2023-05-15T16:40:11.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fb30bfff640 1 -- 172.21.15.62:0/1508138172 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30c0a9ea0 con 0x7fb314146e90 2023-05-15T16:40:11.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fad2613e640 1 -- 172.21.15.62:0/1812730743 wait complete. 2023-05-15T16:40:11.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7f10ba978640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10b40b2e20 0x7f10b406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7f10ba978640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f10b406a7c0 0x7f10b41513e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7f10ba978640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10b4070a30 con 0x7f10b4151920 2023-05-15T16:40:11.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7f10ba978640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10b406f5b0 con 0x7f10b406a7c0 2023-05-15T16:40:11.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7f10ba978640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b4070cb0 con 0x7f10b40b2e20 2023-05-15T16:40:11.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7f52a92b6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f52a4066ea0 0x7f52a413fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7f52a92b6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52a406caf0 0x7f52a4146670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7f52a92b6640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f52a40b0e90 0x7f52a40b2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7f52a92b6640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a4146bb0 con 0x7f52a4066ea0 2023-05-15T16:40:11.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7f52a92b6640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a41461e0 con 0x7f52a40b0e90 2023-05-15T16:40:11.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7f52a92b6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a40b1fe0 con 0x7f52a406caf0 2023-05-15T16:40:11.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fb31b2c4640 1 -- 172.21.15.62:0/1508138172 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb314146e90 msgr2=0x7fb3140b8e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fb31b2c4640 1 --2- 172.21.15.62:0/1508138172 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb314146e90 0x7fb3140b8e20 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb30c009dc0 tx=0x7fb30c020d50 comp rx=0 tx=0).stop 2023-05-15T16:40:11.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7f10b8f15640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f10b4151920 0x7f10b414de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.62:57972/0 (socket says 172.21.15.62:57972) 2023-05-15T16:40:11.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7f10b8f15640 1 -- 172.21.15.62:0/2081481353 learned_addr learned my addr 172.21.15.62:0/2081481353 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:11.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fb31b2c4640 1 -- 172.21.15.62:0/1508138172 shutdown_connections 2023-05-15T16:40:11.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fb31b2c4640 1 --2- 172.21.15.62:0/1508138172 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb314146e90 0x7fb3140b8e20 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7fb31b2c4640 1 -- 172.21.15.62:0/1508138172 >> 172.21.15.62:0/1508138172 conn(0x7fb3140bca30 msgr2=0x7fb3140bce30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:11.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7f52a37fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f52a40b0e90 0x7f52a40b2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7f52a37fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f52a40b0e90 0x7f52a40b2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.62:36732/0 (socket says 172.21.15.62:36732) 2023-05-15T16:40:11.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.163+0000 7f52a37fe640 1 -- 172.21.15.62:0/1895183431 learned_addr learned my addr 172.21.15.62:0/1895183431 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:11.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7f52a2ffd640 1 --2- 172.21.15.62:0/1895183431 >> v2:172.21.15.62:3300/0 conn(0x7f52a4066ea0 0x7f52a413fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7f529bfff640 1 --2- 172.21.15.62:0/1895183431 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52a406caf0 0x7f52a4146670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7f10b3fff640 1 --2- 172.21.15.62:0/2081481353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10b40b2e20 0x7f10b406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fb31b2c4640 1 -- 172.21.15.62:0/1508138172 shutdown_connections 2023-05-15T16:40:11.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7f10b2ffd640 1 -- 172.21.15.62:0/2081481353 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2316346699 0 0) 0x7f10b4070a30 con 0x7f10b4151920 2023-05-15T16:40:11.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7f10b2ffd640 1 -- 172.21.15.62:0/2081481353 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f109c003530 con 0x7f10b4151920 2023-05-15T16:40:11.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7f52a2ffd640 1 -- 172.21.15.62:0/1895183431 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52a406caf0 msgr2=0x7f52a4146670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:11.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7f52a2ffd640 1 --2- 172.21.15.62:0/1895183431 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52a406caf0 0x7f52a4146670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7f52a2ffd640 1 -- 172.21.15.62:0/1895183431 >> v2:172.21.15.161:3300/0 conn(0x7f52a40b0e90 msgr2=0x7f52a40b2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:11.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7f52a2ffd640 1 --2- 172.21.15.62:0/1895183431 >> v2:172.21.15.161:3300/0 conn(0x7f52a40b0e90 0x7f52a40b2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7f52a2ffd640 1 -- 172.21.15.62:0/1895183431 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a4145bd0 con 0x7f52a4066ea0 2023-05-15T16:40:11.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fee065d7640 1 --2- 172.21.15.62:0/1992951234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedec009980 0x7fedec005180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fedf80ef1c0 tx=0x7fedf001cb60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2f8190710888561 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fb31b2c4640 1 -- 172.21.15.62:0/1508138172 wait complete. 2023-05-15T16:40:11.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad2613e640 1 Processor -- start 2023-05-15T16:40:11.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fa2ce7fc640 1 --2- 172.21.15.62:0/4108812916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d00b8500 0x7fa2d00b77d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa2d006de70 tx=0x7fa2c001c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=365946ba65009c75 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fa2cdffb640 1 -- 172.21.15.62:0/4108812916 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c00a57a0 con 0x7fa2d00b8500 2023-05-15T16:40:11.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fa2cdffb640 1 -- 172.21.15.62:0/4108812916 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c00a5900 con 0x7fa2d00b8500 2023-05-15T16:40:11.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fa2cdffb640 1 -- 172.21.15.62:0/4108812916 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c00a5c90 con 0x7fa2d00b8500 2023-05-15T16:40:11.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7f10b3fff640 1 -- 172.21.15.62:0/2081481353 >> v2:172.21.15.161:3300/0 conn(0x7f10b406a7c0 msgr2=0x7f10b41513e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-15T16:40:11.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7f10b3fff640 1 --2- 172.21.15.62:0/2081481353 >> v2:172.21.15.161:3300/0 conn(0x7f10b406a7c0 0x7f10b41513e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7f10b3fff640 1 -- 172.21.15.62:0/2081481353 >> v1:172.21.15.161:6789/0 conn(0x7f10b4151920 legacy=0x7f10b414de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7f10b3fff640 1 -- 172.21.15.62:0/2081481353 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b4070f90 con 0x7f10b40b2e20 2023-05-15T16:40:11.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fee04dd4640 1 -- 172.21.15.62:0/1992951234 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00a5820 con 0x7fedec009980 2023-05-15T16:40:11.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fee04dd4640 1 -- 172.21.15.62:0/1992951234 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedf00a5980 con 0x7fedec009980 2023-05-15T16:40:11.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fee04dd4640 1 -- 172.21.15.62:0/1992951234 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedf00a5d30 con 0x7fedec009980 2023-05-15T16:40:11.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fb31b2c4640 1 Processor -- start 2023-05-15T16:40:11.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad2613e640 1 -- start start 2023-05-15T16:40:11.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad2613e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad200b4470 0x7fad2006fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad1f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad200b4470 0x7fad2006fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad1f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad200b4470 0x7fad2006fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42856/0 (socket says 172.21.15.62:42856) 2023-05-15T16:40:11.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad1f7fe640 1 -- 172.21.15.62:0/3829558507 learned_addr learned my addr 172.21.15.62:0/3829558507 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:11.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad2613e640 1 --2- 172.21.15.62:0/3829558507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad200b7f80 0x7fad200b6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fa2d59c8640 1 -- 172.21.15.62:0/4108812916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d00b8500 msgr2=0x7fa2d00b77d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fa2d59c8640 1 --2- 172.21.15.62:0/4108812916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d00b8500 0x7fa2d00b77d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa2d006de70 tx=0x7fa2c001c9d0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad2613e640 1 --2- 172.21.15.62:0/3829558507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad2013feb0 0x7fad20146cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad2613e640 1 -- 172.21.15.62:0/3829558507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad200b6ed0 con 0x7fad200b4470 2023-05-15T16:40:11.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad2613e640 1 -- 172.21.15.62:0/3829558507 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2006f390 con 0x7fad200b7f80 2023-05-15T16:40:11.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fee0803a640 1 -- 172.21.15.62:0/1992951234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedec009980 msgr2=0x7fedec005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fee0803a640 1 --2- 172.21.15.62:0/1992951234 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedec009980 0x7fedec005180 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fedf80ef1c0 tx=0x7fedf001cb60 comp rx=0 tx=0).stop 2023-05-15T16:40:11.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fee065d7640 1 -- 172.21.15.62:0/1992951234 reap_dead start 2023-05-15T16:40:11.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fd13ffff640 1 --2- 172.21.15.62:0/1133479321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1400b7ed0 0x7fd1400b1440 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd1400b9950 tx=0x7fd13001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd9e9efcbb38dff3 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fd13e7fc640 1 -- 172.21.15.62:0/1133479321 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1300ab400 con 0x7fd1400b7ed0 2023-05-15T16:40:11.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fd13e7fc640 1 -- 172.21.15.62:0/1133479321 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1300a7050 con 0x7fd1400b7ed0 2023-05-15T16:40:11.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fd13e7fc640 1 -- 172.21.15.62:0/1133479321 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1300ab780 con 0x7fd1400b7ed0 2023-05-15T16:40:11.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fa2d59c8640 1 -- 172.21.15.62:0/4108812916 shutdown_connections 2023-05-15T16:40:11.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fa2d59c8640 1 --2- 172.21.15.62:0/4108812916 >> v2:172.21.15.161:3300/0 conn(0x7fa2d00b8950 0x7fa2d00b7d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fa2d59c8640 1 --2- 172.21.15.62:0/4108812916 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d00b8500 0x7fa2d00b77d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fa2d59c8640 1 -- 172.21.15.62:0/4108812916 >> 172.21.15.62:0/4108812916 conn(0x7fa2d00697b0 msgr2=0x7fa2d0069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:11.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad1effd640 1 --2- 172.21.15.62:0/3829558507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad200b7f80 0x7fad200b6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad1ffff640 1 --2- 172.21.15.62:0/3829558507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad2013feb0 0x7fad20146cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad2613e640 1 -- 172.21.15.62:0/3829558507 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2006e8b0 con 0x7fad2013feb0 2023-05-15T16:40:11.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fd145ba8640 1 -- 172.21.15.62:0/1133479321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1400b7ed0 msgr2=0x7fd1400b1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fd145ba8640 1 --2- 172.21.15.62:0/1133479321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1400b7ed0 0x7fd1400b1440 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd1400b9950 tx=0x7fd13001c400 comp rx=0 tx=0).stop 2023-05-15T16:40:11.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fa2d59c8640 1 -- 172.21.15.62:0/4108812916 shutdown_connections 2023-05-15T16:40:11.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fee0803a640 1 -- 172.21.15.62:0/1992951234 shutdown_connections 2023-05-15T16:40:11.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fee0803a640 1 -- 172.21.15.62:0/1992951234 >> 172.21.15.62:0/1992951234 conn(0x7fedf8043080 msgr2=0x7fedf803ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:11.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fd145ba8640 1 -- 172.21.15.62:0/1133479321 shutdown_connections 2023-05-15T16:40:11.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fd145ba8640 1 --2- 172.21.15.62:0/1133479321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1400b7ed0 0x7fd1400b1440 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fd145ba8640 1 --2- 172.21.15.62:0/1133479321 >> v2:172.21.15.161:3300/0 conn(0x7fd140071a90 0x7fd1400b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fd145ba8640 1 -- 172.21.15.62:0/1133479321 >> 172.21.15.62:0/1133479321 conn(0x7fd1400697b0 msgr2=0x7fd140069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:11.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fee0803a640 1 -- 172.21.15.62:0/1992951234 shutdown_connections 2023-05-15T16:40:11.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad1f7fe640 1 -- 172.21.15.62:0/3829558507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad2013feb0 msgr2=0x7fad20146cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad1f7fe640 1 --2- 172.21.15.62:0/3829558507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad2013feb0 0x7fad20146cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad1f7fe640 1 -- 172.21.15.62:0/3829558507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad200b7f80 msgr2=0x7fad200b6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad1f7fe640 1 --2- 172.21.15.62:0/3829558507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad200b7f80 0x7fad200b6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad1f7fe640 1 -- 172.21.15.62:0/3829558507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad100094d0 con 0x7fad200b4470 2023-05-15T16:40:11.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad1f7fe640 1 --2- 172.21.15.62:0/3829558507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad200b4470 0x7fad2006fd40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fad0800d800 tx=0x7fad0800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fb31b2c4640 1 -- start start 2023-05-15T16:40:11.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fb31b2c4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb314140830 0x7fb314133200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fb31b2c4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb314140c00 0x7fb3140bbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fb31b2c4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb314146e90 0x7fb3140b5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fb31b2c4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3140b4240 con 0x7fb314146e90 2023-05-15T16:40:11.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fb31b2c4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb314133740 con 0x7fb314140c00 2023-05-15T16:40:11.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fb31b2c4640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3140b32c0 con 0x7fb314140830 2023-05-15T16:40:11.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fb319060640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb314140830 0x7fb314133200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fb31885f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb314140c00 0x7fb3140bbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fd145ba8640 1 -- 172.21.15.62:0/1133479321 shutdown_connections 2023-05-15T16:40:11.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fd145ba8640 1 -- 172.21.15.62:0/1133479321 wait complete. 2023-05-15T16:40:11.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fb319861640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb314146e90 0x7fb3140b5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fb319861640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb314146e90 0x7fb3140b5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42868/0 (socket says 172.21.15.62:42868) 2023-05-15T16:40:11.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fb319861640 1 -- 172.21.15.62:0/3871715964 learned_addr learned my addr 172.21.15.62:0/3871715964 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:11.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fa2d59c8640 1 -- 172.21.15.62:0/4108812916 wait complete. 2023-05-15T16:40:11.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad17fff640 1 -- 172.21.15.62:0/3829558507 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0800b6c0 con 0x7fad200b4470 2023-05-15T16:40:11.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad17fff640 1 -- 172.21.15.62:0/3829558507 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad0800b820 con 0x7fad200b4470 2023-05-15T16:40:11.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad17fff640 1 -- 172.21.15.62:0/3829558507 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad0800bb90 con 0x7fad200b4470 2023-05-15T16:40:11.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad2613e640 1 -- 172.21.15.62:0/3829558507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad200b34c0 con 0x7fad200b4470 2023-05-15T16:40:11.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fad2613e640 1 -- 172.21.15.62:0/3829558507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad200b31e0 con 0x7fad200b4470 2023-05-15T16:40:11.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7f10b3fff640 1 --2- 172.21.15.62:0/2081481353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10b40b2e20 0x7f10b406ef60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f10a80097c0 tx=0x7f10a801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbcd2a3465ea7237 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.167+0000 7fee0803a640 1 -- 172.21.15.62:0/1992951234 wait complete. 2023-05-15T16:40:11.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fee0803a640 1 Processor -- start 2023-05-15T16:40:11.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fee0803a640 1 -- start start 2023-05-15T16:40:11.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fee0803a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedec009980 0x7fedf80351f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fee0803a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedf8197900 0x7fedf80e60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fee0803a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedf8197d70 0x7fedf80e65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fee0803a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf80f7eb0 con 0x7fedf8197d70 2023-05-15T16:40:11.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fee0803a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedf8035730 con 0x7fedec009980 2023-05-15T16:40:11.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fee0803a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedf80f9440 con 0x7fedf8197900 2023-05-15T16:40:11.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fee065d7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedf8197d70 0x7fedf80e65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fee065d7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedf8197d70 0x7fedf80e65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42882/0 (socket says 172.21.15.62:42882) 2023-05-15T16:40:11.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fee065d7640 1 -- 172.21.15.62:0/3810384214 learned_addr learned my addr 172.21.15.62:0/3810384214 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:11.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fee055d5640 1 --2- 172.21.15.62:0/3810384214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedf8197900 0x7fedf80e60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fee05dd6640 1 --2- 172.21.15.62:0/3810384214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedec009980 0x7fedf80351f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fad2613e640 1 -- 172.21.15.62:0/3829558507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad200b4840 con 0x7fad200b4470 2023-05-15T16:40:11.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fad17fff640 1 -- 172.21.15.62:0/3829558507 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fad0800bcf0 con 0x7fad200b4470 2023-05-15T16:40:11.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fad17fff640 1 --2- 172.21.15.62:0/3829558507 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fad000653b0 0x7fad00067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fad17fff640 1 -- 172.21.15.62:0/3829558507 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fad08082c80 con 0x7fad200b4470 2023-05-15T16:40:11.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7f10b2ffd640 1 -- 172.21.15.62:0/2081481353 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a80a8990 con 0x7f10b40b2e20 2023-05-15T16:40:11.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7f10b2ffd640 1 -- 172.21.15.62:0/2081481353 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a80a8af0 con 0x7f10b40b2e20 2023-05-15T16:40:11.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7f10b2ffd640 1 -- 172.21.15.62:0/2081481353 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a80a8e60 con 0x7f10b40b2e20 2023-05-15T16:40:11.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7f10ba978640 1 -- 172.21.15.62:0/2081481353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10b40b2e20 msgr2=0x7f10b406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7f10ba978640 1 --2- 172.21.15.62:0/2081481353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10b40b2e20 0x7f10b406ef60 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f10a80097c0 tx=0x7f10a801ec90 comp rx=0 tx=0).stop 2023-05-15T16:40:11.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2d59c8640 1 Processor -- start 2023-05-15T16:40:11.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2d59c8640 1 -- start start 2023-05-15T16:40:11.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2d59c8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d0071640 0x7fa2d00baa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2d59c8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2d00b8500 0x7fa2d007a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2d59c8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2d00b8950 0x7fa2d00793e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2d59c8640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d01516b0 con 0x7fa2d0071640 2023-05-15T16:40:11.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2d59c8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d00bb2e0 con 0x7fa2d00b8500 2023-05-15T16:40:11.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2d59c8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d0082700 con 0x7fa2d00b8950 2023-05-15T16:40:11.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2ceffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d0071640 0x7fa2d00baa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2ceffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d0071640 0x7fa2d00baa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42878/0 (socket says 172.21.15.62:42878) 2023-05-15T16:40:11.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2ceffd640 1 -- 172.21.15.62:0/1931047710 learned_addr learned my addr 172.21.15.62:0/1931047710 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:11.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2cf7fe640 1 --2- 172.21.15.62:0/1931047710 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2d00b8950 0x7fa2d00793e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2ce7fc640 1 --2- 172.21.15.62:0/1931047710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2d00b8500 0x7fa2d007a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2ceffd640 1 -- 172.21.15.62:0/1931047710 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2d00b8950 msgr2=0x7fa2d00793e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2ceffd640 1 --2- 172.21.15.62:0/1931047710 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2d00b8950 0x7fa2d00793e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2ceffd640 1 -- 172.21.15.62:0/1931047710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2d00b8500 msgr2=0x7fa2d007a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2ceffd640 1 --2- 172.21.15.62:0/1931047710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2d00b8500 0x7fa2d007a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2ceffd640 1 -- 172.21.15.62:0/1931047710 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c0009b30 con 0x7fa2d0071640 2023-05-15T16:40:11.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2ceffd640 1 --2- 172.21.15.62:0/1931047710 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d0071640 0x7fa2d00baa20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400c3f0 tx=0x7fa2c400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2b7fff640 1 -- 172.21.15.62:0/1931047710 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c40052d0 con 0x7fa2d0071640 2023-05-15T16:40:11.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2b7fff640 1 -- 172.21.15.62:0/1931047710 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c4005430 con 0x7fa2d0071640 2023-05-15T16:40:11.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2d59c8640 1 -- 172.21.15.62:0/1931047710 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d015d9d0 con 0x7fa2d0071640 2023-05-15T16:40:11.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2d59c8640 1 -- 172.21.15.62:0/1931047710 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2d015d840 con 0x7fa2d0071640 2023-05-15T16:40:11.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fb319060640 1 -- 172.21.15.62:0/3871715964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb314140c00 msgr2=0x7fb3140bbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fb319060640 1 --2- 172.21.15.62:0/3871715964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb314140c00 0x7fb3140bbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fb319060640 1 -- 172.21.15.62:0/3871715964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb314146e90 msgr2=0x7fb3140b5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fb319060640 1 --2- 172.21.15.62:0/3871715964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb314146e90 0x7fb3140b5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fb319060640 1 -- 172.21.15.62:0/3871715964 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb30c009a70 con 0x7fb314140830 2023-05-15T16:40:11.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fb319060640 1 --2- 172.21.15.62:0/3871715964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb314140830 0x7fb314133200 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb31000c430 tx=0x7fb31000c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fd145ba8640 1 Processor -- start 2023-05-15T16:40:11.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fd145ba8640 1 -- start start 2023-05-15T16:40:11.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fd145ba8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd140071a90 0x7fd14013d750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fd145ba8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1400b7ed0 0x7fd1401f27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fd145ba8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd140145410 0x7fd1401f2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fd145ba8640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd14013dc90 con 0x7fd1400b7ed0 2023-05-15T16:40:11.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fd145ba8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1401f2340 con 0x7fd140071a90 2023-05-15T16:40:11.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fd145ba8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd140146a40 con 0x7fd140145410 2023-05-15T16:40:11.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fa2d59c8640 1 -- 172.21.15.62:0/1931047710 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2d015db60 con 0x7fa2d0071640 2023-05-15T16:40:11.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7f10ba978640 1 -- 172.21.15.62:0/2081481353 shutdown_connections 2023-05-15T16:40:11.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7f10ba978640 1 --2- 172.21.15.62:0/2081481353 >> v2:172.21.15.161:3300/0 conn(0x7f10b406a7c0 0x7f10b41513e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7f10ba978640 1 --2- 172.21.15.62:0/2081481353 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10b40b2e20 0x7f10b406ef60 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7f10ba978640 1 -- 172.21.15.62:0/2081481353 >> 172.21.15.62:0/2081481353 conn(0x7f10b40bce40 msgr2=0x7f10b40b8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:11.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fad1effd640 1 --2- 172.21.15.62:0/3829558507 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fad000653b0 0x7fad00067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7f10ba978640 1 -- 172.21.15.62:0/2081481353 shutdown_connections 2023-05-15T16:40:11.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7fad1effd640 1 --2- 172.21.15.62:0/3829558507 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fad000653b0 0x7fad00067860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fad2006c8d0 tx=0x7fad18003dd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7f10ba978640 1 -- 172.21.15.62:0/2081481353 wait complete. 2023-05-15T16:40:11.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7f10ba978640 1 Processor -- start 2023-05-15T16:40:11.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fd13effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1400b7ed0 0x7fd1401f27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fd13ffff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd140145410 0x7fd1401f2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fd13effd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1400b7ed0 0x7fd1401f27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42886/0 (socket says 172.21.15.62:42886) 2023-05-15T16:40:11.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fd13effd640 1 -- 172.21.15.62:0/1260610009 learned_addr learned my addr 172.21.15.62:0/1260610009 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:11.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fd13f7fe640 1 --2- 172.21.15.62:0/1260610009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd140071a90 0x7fd14013d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fd13f7fe640 1 -- 172.21.15.62:0/1260610009 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd140145410 msgr2=0x7fd1401f2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fd13f7fe640 1 --2- 172.21.15.62:0/1260610009 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd140145410 0x7fd1401f2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fd13f7fe640 1 -- 172.21.15.62:0/1260610009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1400b7ed0 msgr2=0x7fd1401f27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fd13f7fe640 1 --2- 172.21.15.62:0/1260610009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1400b7ed0 0x7fd1401f27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fd13f7fe640 1 -- 172.21.15.62:0/1260610009 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd130009420 con 0x7fd140071a90 2023-05-15T16:40:11.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fd13f7fe640 1 --2- 172.21.15.62:0/1260610009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd140071a90 0x7fd14013d750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd13800caf0 tx=0x7fd13800a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7fd127fff640 1 -- 172.21.15.62:0/1260610009 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd13800aca0 con 0x7fd140071a90 2023-05-15T16:40:11.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7fd127fff640 1 -- 172.21.15.62:0/1260610009 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13800ae00 con 0x7fd140071a90 2023-05-15T16:40:11.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7fd145ba8640 1 -- 172.21.15.62:0/1260610009 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1400b0ae0 con 0x7fd140071a90 2023-05-15T16:40:11.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7fd127fff640 1 -- 172.21.15.62:0/1260610009 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd138012640 con 0x7fd140071a90 2023-05-15T16:40:11.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7fd145ba8640 1 -- 172.21.15.62:0/1260610009 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1400b1980 con 0x7fd140071a90 2023-05-15T16:40:11.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7fd145ba8640 1 -- 172.21.15.62:0/1260610009 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd140156fb0 con 0x7fd140071a90 2023-05-15T16:40:11.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7f10ba978640 1 -- start start 2023-05-15T16:40:11.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7f10ba978640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10b406a7c0 0x7f10b40b51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7f10ba978640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10b40b2e20 0x7f10b40b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7f10ba978640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10b4151920 0x7f10b40b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7f10ba978640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b40b4ac0 con 0x7f10b40b2e20 2023-05-15T16:40:11.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7f10ba978640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10b40b56e0 con 0x7f10b4151920 2023-05-15T16:40:11.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7f10ba978640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10b40b36b0 con 0x7f10b406a7c0 2023-05-15T16:40:11.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7fd127fff640 1 -- 172.21.15.62:0/1260610009 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fd1380319d0 con 0x7fd140071a90 2023-05-15T16:40:11.323 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7f10b8f15640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10b4151920 0x7f10b40b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.323 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7f10b8f15640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10b4151920 0x7f10b40b5ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.62:36798/0 (socket says 172.21.15.62:36798) 2023-05-15T16:40:11.323 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7f10b8f15640 1 -- 172.21.15.62:0/235584819 learned_addr learned my addr 172.21.15.62:0/235584819 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:11.323 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7f10b3fff640 1 --2- 172.21.15.62:0/235584819 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10b406a7c0 0x7f10b40b51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.323 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7f10b8f15640 1 -- 172.21.15.62:0/235584819 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10b406a7c0 msgr2=0x7f10b40b51a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.324 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7f10b8f15640 1 --2- 172.21.15.62:0/235584819 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10b406a7c0 0x7f10b40b51a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.324 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7f10b8f15640 1 -- 172.21.15.62:0/235584819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10b40b2e20 msgr2=0x7f10b40b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.324 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7f10b8f15640 1 --2- 172.21.15.62:0/235584819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10b40b2e20 0x7f10b40b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.324 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7f10b8f15640 1 -- 172.21.15.62:0/235584819 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10a8009420 con 0x7f10b4151920 2023-05-15T16:40:11.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fb309ffb640 1 -- 172.21.15.62:0/3871715964 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3100052d0 con 0x7fb314140830 2023-05-15T16:40:11.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7fb31b2c4640 1 -- 172.21.15.62:0/3871715964 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3140b6ea0 con 0x7fb314140830 2023-05-15T16:40:11.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7fb31b2c4640 1 -- 172.21.15.62:0/3871715964 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3140b6d10 con 0x7fb314140830 2023-05-15T16:40:11.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7fb309ffb640 1 -- 172.21.15.62:0/3871715964 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb310005430 con 0x7fb314140830 2023-05-15T16:40:11.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7fb309ffb640 1 -- 172.21.15.62:0/3871715964 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb310003840 con 0x7fb314140830 2023-05-15T16:40:11.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7f10b8f15640 1 --2- 172.21.15.62:0/235584819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10b4151920 0x7f10b40b5ff0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f10a400c390 tx=0x7f10a400c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7fd127fff640 1 --2- 172.21.15.62:0/1260610009 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd12c065380 0x7fd12c067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.175+0000 7fd127fff640 1 -- 172.21.15.62:0/1260610009 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd138082b10 con 0x7fd140071a90 2023-05-15T16:40:11.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fee05dd6640 1 -- 172.21.15.62:0/3810384214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedf8197900 msgr2=0x7fedf80e60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fee05dd6640 1 --2- 172.21.15.62:0/3810384214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedf8197900 0x7fedf80e60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fee05dd6640 1 -- 172.21.15.62:0/3810384214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedf8197d70 msgr2=0x7fedf80e65f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fee05dd6640 1 --2- 172.21.15.62:0/3810384214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedf8197d70 0x7fedf80e65f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fee05dd6640 1 -- 172.21.15.62:0/3810384214 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedf80399f0 con 0x7fedec009980 2023-05-15T16:40:11.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fee05dd6640 1 --2- 172.21.15.62:0/3810384214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedec009980 0x7fedf80351f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fee00000b70 tx=0x7fee0006ab90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fedf67fc640 1 -- 172.21.15.62:0/3810384214 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee0007d070 con 0x7fedec009980 2023-05-15T16:40:11.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fedf67fc640 1 -- 172.21.15.62:0/3810384214 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee00071620 con 0x7fedec009980 2023-05-15T16:40:11.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.171+0000 7fedf67fc640 1 -- 172.21.15.62:0/3810384214 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee000719b0 con 0x7fedec009980 2023-05-15T16:40:11.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7fa2b7fff640 1 -- 172.21.15.62:0/1931047710 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c4003800 con 0x7fa2d0071640 2023-05-15T16:40:11.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7fb31b2c4640 1 -- 172.21.15.62:0/3871715964 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f4005260 con 0x7fb314140830 2023-05-15T16:40:11.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7f52a2ffd640 1 --2- 172.21.15.62:0/1895183431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52a4066ea0 0x7f52a413fc70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f52a406a8d0 tx=0x7f529401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2901ace7b5f71ec7 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7fee0803a640 1 -- 172.21.15.62:0/3810384214 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedf8039860 con 0x7fedec009980 2023-05-15T16:40:11.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7fee0803a640 1 -- 172.21.15.62:0/3810384214 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedf80fa900 con 0x7fedec009980 2023-05-15T16:40:11.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7fd13effd640 1 --2- 172.21.15.62:0/1260610009 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd12c065380 0x7fd12c067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7f52a27fc640 1 -- 172.21.15.62:0/1895183431 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52940ab5f0 con 0x7f52a4066ea0 2023-05-15T16:40:11.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7fad17fff640 1 -- 172.21.15.62:0/3829558507 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fad08089080 con 0x7fad200b4470 2023-05-15T16:40:11.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7f52a27fc640 1 -- 172.21.15.62:0/1895183431 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52940ab750 con 0x7f52a4066ea0 2023-05-15T16:40:11.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7f52a27fc640 1 -- 172.21.15.62:0/1895183431 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52940abae0 con 0x7f52a4066ea0 2023-05-15T16:40:11.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7fb309ffb640 1 -- 172.21.15.62:0/3871715964 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fb3100039a0 con 0x7fb314140830 2023-05-15T16:40:11.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7fb309ffb640 1 --2- 172.21.15.62:0/3871715964 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb2f80653d0 0x7fb2f8067880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7fd13effd640 1 --2- 172.21.15.62:0/1260610009 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd12c065380 0x7fd12c067830 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd140149320 tx=0x7fd134008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7fb309ffb640 1 -- 172.21.15.62:0/3871715964 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb3100820c0 con 0x7fb314140830 2023-05-15T16:40:11.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7f52a92b6640 1 -- 172.21.15.62:0/1895183431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52a4066ea0 msgr2=0x7f52a413fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7f52a92b6640 1 --2- 172.21.15.62:0/1895183431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52a4066ea0 0x7f52a413fc70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f52a406a8d0 tx=0x7f529401c450 comp rx=0 tx=0).stop 2023-05-15T16:40:11.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7f52a92b6640 1 -- 172.21.15.62:0/1895183431 shutdown_connections 2023-05-15T16:40:11.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7f52a92b6640 1 --2- 172.21.15.62:0/1895183431 >> v2:172.21.15.161:3300/0 conn(0x7f52a40b0e90 0x7f52a40b2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7f52a92b6640 1 --2- 172.21.15.62:0/1895183431 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52a406caf0 0x7f52a4146670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7f52a92b6640 1 --2- 172.21.15.62:0/1895183431 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52a4066ea0 0x7f52a413fc70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7f52a92b6640 1 -- 172.21.15.62:0/1895183431 >> 172.21.15.62:0/1895183431 conn(0x7f52a40b89f0 msgr2=0x7f52a40b8df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:11.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7f52a92b6640 1 -- 172.21.15.62:0/1895183431 shutdown_connections 2023-05-15T16:40:11.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.179+0000 7f52a92b6640 1 -- 172.21.15.62:0/1895183431 wait complete. 2023-05-15T16:40:11.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7fb31885f640 1 --2- 172.21.15.62:0/3871715964 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb2f80653d0 0x7fb2f8067880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7f52a92b6640 1 Processor -- start 2023-05-15T16:40:11.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7fee0803a640 1 -- 172.21.15.62:0/3810384214 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedf8005350 con 0x7fedec009980 2023-05-15T16:40:11.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7fa2b7fff640 1 -- 172.21.15.62:0/1931047710 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fa2c4003960 con 0x7fa2d0071640 2023-05-15T16:40:11.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7fa2b7fff640 1 --2- 172.21.15.62:0/1931047710 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa2bc0653d0 0x7fa2bc067880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7fa2b7fff640 1 -- 172.21.15.62:0/1931047710 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa2c40825a0 con 0x7fa2d0071640 2023-05-15T16:40:11.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7f52a92b6640 1 -- start start 2023-05-15T16:40:11.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7fa2ce7fc640 1 --2- 172.21.15.62:0/1931047710 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa2bc0653d0 0x7fa2bc067880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7fb31885f640 1 --2- 172.21.15.62:0/3871715964 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb2f80653d0 0x7fb2f8067880 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb3140b3bf0 tx=0x7fb304009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7f52a92b6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52a4066ea0 0x7f52a4132560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7f52a92b6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52a406caf0 0x7f52a412d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7f52a92b6640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52a40b0e90 0x7f52a412d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7f52a92b6640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a4132aa0 con 0x7f52a406caf0 2023-05-15T16:40:11.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7f52a92b6640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a413dc90 con 0x7f52a40b0e90 2023-05-15T16:40:11.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7f52a92b6640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a413df70 con 0x7f52a4066ea0 2023-05-15T16:40:11.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7f529bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52a406caf0 0x7f52a412d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7f529bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52a406caf0 0x7f52a412d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42916/0 (socket says 172.21.15.62:42916) 2023-05-15T16:40:11.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7f529bfff640 1 -- 172.21.15.62:0/3624490648 learned_addr learned my addr 172.21.15.62:0/3624490648 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:11.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7fa2ce7fc640 1 --2- 172.21.15.62:0/1931047710 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa2bc0653d0 0x7fa2bc067880 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00ae000 tx=0x7fa2c00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7f529bfff640 1 -- 172.21.15.62:0/3624490648 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52a4066ea0 msgr2=0x7f52a4132560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7f529bfff640 1 --2- 172.21.15.62:0/3624490648 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52a4066ea0 0x7f52a4132560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7f529bfff640 1 -- 172.21.15.62:0/3624490648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52a40b0e90 msgr2=0x7f52a412d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7f529bfff640 1 --2- 172.21.15.62:0/3624490648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52a40b0e90 0x7f52a412d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7f529bfff640 1 -- 172.21.15.62:0/3624490648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5294009420 con 0x7f52a406caf0 2023-05-15T16:40:11.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.183+0000 7f529bfff640 1 --2- 172.21.15.62:0/3624490648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52a406caf0 0x7f52a412d0e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f528c00c7f0 tx=0x7f528c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.187+0000 7f529b7fe640 1 -- 172.21.15.62:0/3624490648 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c004220 con 0x7f52a406caf0 2023-05-15T16:40:11.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.187+0000 7fa2b7fff640 1 -- 172.21.15.62:0/1931047710 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fa2c4050250 con 0x7fa2d0071640 2023-05-15T16:40:11.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.187+0000 7f52a92b6640 1 -- 172.21.15.62:0/3624490648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a41499b0 con 0x7f52a406caf0 2023-05-15T16:40:11.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.187+0000 7f52a92b6640 1 -- 172.21.15.62:0/3624490648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a40b2250 con 0x7f52a406caf0 2023-05-15T16:40:11.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.187+0000 7f529b7fe640 1 -- 172.21.15.62:0/3624490648 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f528c003620 con 0x7f52a406caf0 2023-05-15T16:40:11.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.187+0000 7f529b7fe640 1 -- 172.21.15.62:0/3624490648 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f528c003990 con 0x7f52a406caf0 2023-05-15T16:40:11.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.187+0000 7f52a92b6640 1 -- 172.21.15.62:0/3624490648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a4149b40 con 0x7f52a406caf0 2023-05-15T16:40:11.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.187+0000 7f529b7fe640 1 -- 172.21.15.62:0/3624490648 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f528c003af0 con 0x7f52a406caf0 2023-05-15T16:40:11.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.187+0000 7f529b7fe640 1 --2- 172.21.15.62:0/3624490648 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f52840653b0 0x7f5284067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.187+0000 7f529b7fe640 1 -- 172.21.15.62:0/3624490648 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f528c0827e0 con 0x7f52a406caf0 2023-05-15T16:40:11.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.191+0000 7f52a2ffd640 1 --2- 172.21.15.62:0/3624490648 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f52840653b0 0x7f5284067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.191+0000 7f52a2ffd640 1 --2- 172.21.15.62:0/3624490648 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f52840653b0 0x7f5284067860 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f52940af000 tx=0x7f5294008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.342 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.191+0000 7f10b0ff9640 1 -- 172.21.15.62:0/235584819 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a4005cf0 con 0x7f10b4151920 2023-05-15T16:40:11.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.191+0000 7f10ba978640 1 -- 172.21.15.62:0/235584819 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10b4071790 con 0x7f10b4151920 2023-05-15T16:40:11.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.191+0000 7f10ba978640 1 -- 172.21.15.62:0/235584819 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10b4071270 con 0x7f10b4151920 2023-05-15T16:40:11.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.191+0000 7fd127fff640 1 -- 172.21.15.62:0/1260610009 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fd138054250 con 0x7fd140071a90 2023-05-15T16:40:11.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.191+0000 7f10b0ff9640 1 -- 172.21.15.62:0/235584819 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10a4005e50 con 0x7f10b4151920 2023-05-15T16:40:11.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.191+0000 7f10b0ff9640 1 -- 172.21.15.62:0/235584819 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10a40072d0 con 0x7f10b4151920 2023-05-15T16:40:11.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.191+0000 7f30b4c3a640 1 Processor -- start 2023-05-15T16:40:11.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.191+0000 7f30b4c3a640 1 -- start start 2023-05-15T16:40:11.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.191+0000 7f10ba978640 1 -- 172.21.15.62:0/235584819 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1094005260 con 0x7f10b4151920 2023-05-15T16:40:11.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.191+0000 7fb309ffb640 1 -- 172.21.15.62:0/3871715964 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fb31004ff60 con 0x7fb314140830 2023-05-15T16:40:11.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.195+0000 7fedf67fc640 1 -- 172.21.15.62:0/3810384214 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fee00071b10 con 0x7fedec009980 2023-05-15T16:40:11.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.191+0000 7f30b4c3a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30a80d2170 0x7f30a803e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.191+0000 7f30b4c3a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f30a803ecd0 0x7f30a803c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.191+0000 7f30b4c3a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30a803d7b0 con 0x7f30a8007ea0 2023-05-15T16:40:11.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.191+0000 7f30b4c3a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a8036e30 con 0x7f30a803ecd0 2023-05-15T16:40:11.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.191+0000 7f30b4c3a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a803da90 con 0x7f30a80d2170 2023-05-15T16:40:11.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.191+0000 7f30affff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f30a803ecd0 0x7f30a803c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.195+0000 7f30affff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f30a803ecd0 0x7f30a803c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42932/0 (socket says 172.21.15.62:42932) 2023-05-15T16:40:11.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.195+0000 7f30affff640 1 -- 172.21.15.62:0/3179174463 learned_addr learned my addr 172.21.15.62:0/3179174463 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:11.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.195+0000 7f30affff640 1 -- 172.21.15.62:0/3179174463 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30a80d2170 msgr2=0x7f30a803e790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-15T16:40:11.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.195+0000 7f30affff640 1 --2- 172.21.15.62:0/3179174463 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30a80d2170 0x7f30a803e790 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.195+0000 7f30affff640 1 -- 172.21.15.62:0/3179174463 >> v1:172.21.15.161:6789/0 conn(0x7f30a8007ea0 legacy=0x7f30a80d1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.195+0000 7f30affff640 1 -- 172.21.15.62:0/3179174463 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a803dd70 con 0x7f30a803ecd0 2023-05-15T16:40:11.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.195+0000 7fedf67fc640 1 --2- 172.21.15.62:0/3810384214 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fede4065400 0x7fede40678b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.195+0000 7fedf67fc640 1 -- 172.21.15.62:0/3810384214 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fee000eae10 con 0x7fedec009980 2023-05-15T16:40:11.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.195+0000 7fee055d5640 1 --2- 172.21.15.62:0/3810384214 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fede4065400 0x7fede40678b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.195+0000 7fee055d5640 1 --2- 172.21.15.62:0/3810384214 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fede4065400 0x7fede40678b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fedf8033db0 tx=0x7fedfc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.195+0000 7f529b7fe640 1 -- 172.21.15.62:0/3624490648 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f528c0502c0 con 0x7f52a406caf0 2023-05-15T16:40:11.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.195+0000 7f30affff640 1 --2- 172.21.15.62:0/3179174463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a803ecd0 0x7f30a803c3a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f30b004e940 tx=0x7f30b0098870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38dac45f61ba5fb9 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.195+0000 7f30ae7fc640 1 -- 172.21.15.62:0/3179174463 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b012b070 con 0x7f30a803ecd0 2023-05-15T16:40:11.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.199+0000 7f30ae7fc640 1 -- 172.21.15.62:0/3179174463 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b0127500 con 0x7f30a803ecd0 2023-05-15T16:40:11.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.199+0000 7f30ae7fc640 1 -- 172.21.15.62:0/3179174463 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b0127930 con 0x7f30a803ecd0 2023-05-15T16:40:11.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.199+0000 7f30b4c3a640 1 -- 172.21.15.62:0/3179174463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a803ecd0 msgr2=0x7f30a803c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.199+0000 7f30b4c3a640 1 --2- 172.21.15.62:0/3179174463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a803ecd0 0x7f30a803c3a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f30b004e940 tx=0x7f30b0098870 comp rx=0 tx=0).stop 2023-05-15T16:40:11.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.199+0000 7f30b4c3a640 1 -- 172.21.15.62:0/3179174463 shutdown_connections 2023-05-15T16:40:11.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.199+0000 7f30b4c3a640 1 --2- 172.21.15.62:0/3179174463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a803ecd0 0x7f30a803c3a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.199+0000 7f30b4c3a640 1 --2- 172.21.15.62:0/3179174463 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30a80d2170 0x7f30a803e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.199+0000 7f30b4c3a640 1 -- 172.21.15.62:0/3179174463 >> 172.21.15.62:0/3179174463 conn(0x7f30a8043a20 msgr2=0x7f30a803f810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:11.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.199+0000 7f30b4c3a640 1 -- 172.21.15.62:0/3179174463 shutdown_connections 2023-05-15T16:40:11.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.199+0000 7f30b4c3a640 1 -- 172.21.15.62:0/3179174463 wait complete. 2023-05-15T16:40:11.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.199+0000 7f30b4c3a640 1 Processor -- start 2023-05-15T16:40:11.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.199+0000 7f30b4c3a640 1 -- start start 2023-05-15T16:40:11.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f30b4c3a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30a8007ea0 0x7f30a80d10b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f30b4c3a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30a803ecd0 0x7f30a80c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.352 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f30b4c3a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a80d2170 0x7f30a80caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f30b4c3a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a80d15f0 con 0x7f30a80d2170 2023-05-15T16:40:11.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f30b4c3a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a80ca9f0 con 0x7f30a803ecd0 2023-05-15T16:40:11.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f30b4c3a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a80c75a0 con 0x7f30a8007ea0 2023-05-15T16:40:11.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f30affff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a80d2170 0x7f30a80caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f30affff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a80d2170 0x7f30a80caf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42938/0 (socket says 172.21.15.62:42938) 2023-05-15T16:40:11.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f30affff640 1 -- 172.21.15.62:0/777545580 learned_addr learned my addr 172.21.15.62:0/777545580 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:11.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f30aeffd640 1 --2- 172.21.15.62:0/777545580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30a803ecd0 0x7f30a80c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f30af7fe640 1 --2- 172.21.15.62:0/777545580 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30a8007ea0 0x7f30a80d10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f30affff640 1 -- 172.21.15.62:0/777545580 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30a8007ea0 msgr2=0x7f30a80d10b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f30affff640 1 --2- 172.21.15.62:0/777545580 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30a8007ea0 0x7f30a80d10b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f30affff640 1 -- 172.21.15.62:0/777545580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30a803ecd0 msgr2=0x7f30a80c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f30affff640 1 --2- 172.21.15.62:0/777545580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30a803ecd0 0x7f30a80c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f30affff640 1 -- 172.21.15.62:0/777545580 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a8008270 con 0x7f30a80d2170 2023-05-15T16:40:11.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f30affff640 1 --2- 172.21.15.62:0/777545580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a80d2170 0x7f30a80caf80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f30b004ee20 tx=0x7f30b00956b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f309bfff640 1 -- 172.21.15.62:0/777545580 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b012b040 con 0x7f30a80d2170 2023-05-15T16:40:11.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f309bfff640 1 -- 172.21.15.62:0/777545580 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30b0130700 con 0x7f30a80d2170 2023-05-15T16:40:11.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f30b4c3a640 1 -- 172.21.15.62:0/777545580 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a803f150 con 0x7f30a80d2170 2023-05-15T16:40:11.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f309bfff640 1 -- 172.21.15.62:0/777545580 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30b0130ab0 con 0x7f30a80d2170 2023-05-15T16:40:11.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f30b4c3a640 1 -- 172.21.15.62:0/777545580 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a803c8e0 con 0x7f30a80d2170 2023-05-15T16:40:11.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7fedf67fc640 1 -- 172.21.15.62:0/3810384214 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fee000b8bb0 con 0x7fedec009980 2023-05-15T16:40:11.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.203+0000 7f3099ffb640 1 -- 172.21.15.62:0/777545580 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3088005260 con 0x7f30a80d2170 2023-05-15T16:40:11.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.207+0000 7f10b0ff9640 1 -- 172.21.15.62:0/235584819 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f10a4007430 con 0x7f10b4151920 2023-05-15T16:40:11.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.207+0000 7f309bfff640 1 -- 172.21.15.62:0/777545580 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f30b012e070 con 0x7f30a80d2170 2023-05-15T16:40:11.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.207+0000 7f309bfff640 1 --2- 172.21.15.62:0/777545580 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3094065380 0x7f3094067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.207+0000 7f309bfff640 1 -- 172.21.15.62:0/777545580 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f30b0198920 con 0x7f30a80d2170 2023-05-15T16:40:11.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.207+0000 7f10b0ff9640 1 --2- 172.21.15.62:0/235584819 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f10a0065380 0x7f10a0067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:11.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.207+0000 7f10b0ff9640 1 -- 172.21.15.62:0/235584819 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f10a4082570 con 0x7f10b4151920 2023-05-15T16:40:11.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.211+0000 7f30af7fe640 1 --2- 172.21.15.62:0/777545580 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3094065380 0x7f3094067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.211+0000 7f30af7fe640 1 --2- 172.21.15.62:0/777545580 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3094065380 0x7f3094067830 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f309c000f70 tx=0x7f309c00d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.215+0000 7f10b3fff640 1 --2- 172.21.15.62:0/235584819 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f10a0065380 0x7f10a0067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:11.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.215+0000 7f10b3fff640 1 --2- 172.21.15.62:0/235584819 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f10a0065380 0x7f10a0067830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f10a80b2000 tx=0x7f10a80aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:11.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.215+0000 7f309bfff640 1 -- 172.21.15.62:0/777545580 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f30b01665b0 con 0x7f30a80d2170 2023-05-15T16:40:11.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.219+0000 7f10b0ff9640 1 -- 172.21.15.62:0/235584819 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f10a4050290 con 0x7f10b4151920 2023-05-15T16:40:11.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.499+0000 7fad2613e640 1 -- 172.21.15.62:0/3829558507 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fad20073a90 con 0x7fad200b4470 2023-05-15T16:40:11.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.499+0000 7fb31b2c4640 1 -- 172.21.15.62:0/3871715964 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fb2f40057e0 con 0x7fb314140830 2023-05-15T16:40:11.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.499+0000 7fad17fff640 1 -- 172.21.15.62:0/3829558507 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fad080509a0 con 0x7fad200b4470 2023-05-15T16:40:11.505 INFO:teuthology.orchestra.run.smithi062.stdout:55834574855 2023-05-15T16:40:11.506 INFO:teuthology.orchestra.run.smithi062.stdout:55834574853 2023-05-15T16:40:11.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.499+0000 7fb309ffb640 1 -- 172.21.15.62:0/3871715964 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb310017020 con 0x7fb314140830 2023-05-15T16:40:11.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fa2d59c8640 1 -- 172.21.15.62:0/1931047710 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fa2d0067960 con 0x7fa2d0071640 2023-05-15T16:40:11.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fb2ff7fe640 1 -- 172.21.15.62:0/3871715964 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb2f80653d0 msgr2=0x7fb2f8067880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fb2ff7fe640 1 --2- 172.21.15.62:0/3871715964 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb2f80653d0 0x7fb2f8067880 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb3140b3bf0 tx=0x7fb304009040 comp rx=0 tx=0).stop 2023-05-15T16:40:11.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fb2ff7fe640 1 -- 172.21.15.62:0/3871715964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb314140830 msgr2=0x7fb314133200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fb2ff7fe640 1 --2- 172.21.15.62:0/3871715964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb314140830 0x7fb314133200 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb31000c430 tx=0x7fb31000c8f0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fb2ff7fe640 1 -- 172.21.15.62:0/3871715964 shutdown_connections 2023-05-15T16:40:11.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fb2ff7fe640 1 --2- 172.21.15.62:0/3871715964 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb2f80653d0 0x7fb2f8067880 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fb2ff7fe640 1 --2- 172.21.15.62:0/3871715964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb314146e90 0x7fb3140b5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fb2ff7fe640 1 --2- 172.21.15.62:0/3871715964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb314140c00 0x7fb3140bbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fb2ff7fe640 1 --2- 172.21.15.62:0/3871715964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb314140830 0x7fb314133200 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fb2ff7fe640 1 -- 172.21.15.62:0/3871715964 >> 172.21.15.62:0/3871715964 conn(0x7fb3140bca30 msgr2=0x7fb31406fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:11.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fa2b7fff640 1 -- 172.21.15.62:0/1931047710 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa2c4053870 con 0x7fa2d0071640 2023-05-15T16:40:11.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fb2ff7fe640 1 -- 172.21.15.62:0/3871715964 shutdown_connections 2023-05-15T16:40:11.509 INFO:teuthology.orchestra.run.smithi062.stdout:55834574855 2023-05-15T16:40:11.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fb2ff7fe640 1 -- 172.21.15.62:0/3871715964 wait complete. 2023-05-15T16:40:11.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fd145ba8640 1 -- 172.21.15.62:0/1260610009 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fd140067960 con 0x7fd140071a90 2023-05-15T16:40:11.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fa2d59c8640 1 -- 172.21.15.62:0/1931047710 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa2bc0653d0 msgr2=0x7fa2bc067880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fa2d59c8640 1 --2- 172.21.15.62:0/1931047710 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa2bc0653d0 0x7fa2bc067880 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa2c00ae000 tx=0x7fa2c00a7070 comp rx=0 tx=0).stop 2023-05-15T16:40:11.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fa2d59c8640 1 -- 172.21.15.62:0/1931047710 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d0071640 msgr2=0x7fa2d00baa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fa2d59c8640 1 --2- 172.21.15.62:0/1931047710 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d0071640 0x7fa2d00baa20 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa2c400c3f0 tx=0x7fa2c400c8b0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fa2d59c8640 1 -- 172.21.15.62:0/1931047710 shutdown_connections 2023-05-15T16:40:11.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fa2d59c8640 1 --2- 172.21.15.62:0/1931047710 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa2d00b8950 0x7fa2d00793e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fa2d59c8640 1 --2- 172.21.15.62:0/1931047710 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa2d00b8500 0x7fa2d007a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fa2d59c8640 1 --2- 172.21.15.62:0/1931047710 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa2bc0653d0 0x7fa2bc067880 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7fa2d59c8640 1 --2- 172.21.15.62:0/1931047710 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa2d0071640 0x7fa2d00baa20 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7fa2d59c8640 1 -- 172.21.15.62:0/1931047710 >> 172.21.15.62:0/1931047710 conn(0x7fa2d00697b0 msgr2=0x7fa2d01569a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:11.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7fa2d59c8640 1 -- 172.21.15.62:0/1931047710 shutdown_connections 2023-05-15T16:40:11.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7fa2d59c8640 1 -- 172.21.15.62:0/1931047710 wait complete. 2023-05-15T16:40:11.512 INFO:teuthology.orchestra.run.smithi062.stdout:55834574854 2023-05-15T16:40:11.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.503+0000 7fd127fff640 1 -- 172.21.15.62:0/1260610009 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd138036020 con 0x7fd140071a90 2023-05-15T16:40:11.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7f52a92b6640 1 -- 172.21.15.62:0/3624490648 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f52a4067960 con 0x7f52a406caf0 2023-05-15T16:40:11.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7fad15ffb640 1 -- 172.21.15.62:0/3829558507 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fad000653b0 msgr2=0x7fad00067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7fad15ffb640 1 --2- 172.21.15.62:0/3829558507 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fad000653b0 0x7fad00067860 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fad2006c8d0 tx=0x7fad18003dd0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7fad15ffb640 1 -- 172.21.15.62:0/3829558507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad200b4470 msgr2=0x7fad2006fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7fad15ffb640 1 --2- 172.21.15.62:0/3829558507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad200b4470 0x7fad2006fd40 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fad0800d800 tx=0x7fad0800dcc0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7f529b7fe640 1 -- 172.21.15.62:0/3624490648 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f528c01e090 con 0x7f52a406caf0 2023-05-15T16:40:11.514 INFO:teuthology.orchestra.run.smithi062.stdout:55834574853 2023-05-15T16:40:11.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7fd125ffb640 1 -- 172.21.15.62:0/1260610009 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd12c065380 msgr2=0x7fd12c067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7fd125ffb640 1 --2- 172.21.15.62:0/1260610009 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd12c065380 0x7fd12c067830 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd140149320 tx=0x7fd134008040 comp rx=0 tx=0).stop 2023-05-15T16:40:11.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7fd125ffb640 1 -- 172.21.15.62:0/1260610009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd140071a90 msgr2=0x7fd14013d750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7fd125ffb640 1 --2- 172.21.15.62:0/1260610009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd140071a90 0x7fd14013d750 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd13800caf0 tx=0x7fd13800a060 comp rx=0 tx=0).stop 2023-05-15T16:40:11.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7fd125ffb640 1 -- 172.21.15.62:0/1260610009 shutdown_connections 2023-05-15T16:40:11.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7fd125ffb640 1 --2- 172.21.15.62:0/1260610009 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd140145410 0x7fd1401f2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7fd125ffb640 1 --2- 172.21.15.62:0/1260610009 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd12c065380 0x7fd12c067830 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7fd125ffb640 1 --2- 172.21.15.62:0/1260610009 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd1400b7ed0 0x7fd1401f27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7fd125ffb640 1 --2- 172.21.15.62:0/1260610009 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd140071a90 0x7fd14013d750 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7fd125ffb640 1 -- 172.21.15.62:0/1260610009 >> 172.21.15.62:0/1260610009 conn(0x7fd1400697b0 msgr2=0x7fd1400b0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:11.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7fd125ffb640 1 -- 172.21.15.62:0/1260610009 shutdown_connections 2023-05-15T16:40:11.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.507+0000 7fd125ffb640 1 -- 172.21.15.62:0/1260610009 wait complete. 2023-05-15T16:40:11.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.511+0000 7fad15ffb640 1 -- 172.21.15.62:0/3829558507 shutdown_connections 2023-05-15T16:40:11.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.511+0000 7fad15ffb640 1 --2- 172.21.15.62:0/3829558507 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fad2013feb0 0x7fad20146cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.511+0000 7fad15ffb640 1 --2- 172.21.15.62:0/3829558507 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fad200b7f80 0x7fad200b6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.511+0000 7fad15ffb640 1 --2- 172.21.15.62:0/3829558507 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fad000653b0 0x7fad00067860 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.511+0000 7fad15ffb640 1 --2- 172.21.15.62:0/3829558507 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fad200b4470 0x7fad2006fd40 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.511+0000 7fad15ffb640 1 -- 172.21.15.62:0/3829558507 >> 172.21.15.62:0/3829558507 conn(0x7fad200bc5d0 msgr2=0x7fad2006bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:11.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.511+0000 7f52a92b6640 1 -- 172.21.15.62:0/3624490648 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f52840653b0 msgr2=0x7f5284067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.511+0000 7f52a92b6640 1 --2- 172.21.15.62:0/3624490648 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f52840653b0 0x7f5284067860 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f52940af000 tx=0x7f5294008040 comp rx=0 tx=0).stop 2023-05-15T16:40:11.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.511+0000 7f52a92b6640 1 -- 172.21.15.62:0/3624490648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52a406caf0 msgr2=0x7f52a412d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.511+0000 7f52a92b6640 1 --2- 172.21.15.62:0/3624490648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52a406caf0 0x7f52a412d0e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f528c00c7f0 tx=0x7f528c00ccb0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.511+0000 7f52a92b6640 1 -- 172.21.15.62:0/3624490648 shutdown_connections 2023-05-15T16:40:11.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.511+0000 7f52a92b6640 1 --2- 172.21.15.62:0/3624490648 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f52a40b0e90 0x7f52a412d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.511+0000 7f52a92b6640 1 --2- 172.21.15.62:0/3624490648 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f52840653b0 0x7f5284067860 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.511+0000 7f52a92b6640 1 --2- 172.21.15.62:0/3624490648 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f52a406caf0 0x7f52a412d0e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.511+0000 7f52a92b6640 1 --2- 172.21.15.62:0/3624490648 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f52a4066ea0 0x7f52a4132560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.511+0000 7f52a92b6640 1 -- 172.21.15.62:0/3624490648 >> 172.21.15.62:0/3624490648 conn(0x7f52a40b89f0 msgr2=0x7f52a40b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:11.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.511+0000 7f52a92b6640 1 -- 172.21.15.62:0/3624490648 shutdown_connections 2023-05-15T16:40:11.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.511+0000 7f52a92b6640 1 -- 172.21.15.62:0/3624490648 wait complete. 2023-05-15T16:40:11.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.519+0000 7fee0803a640 1 -- 172.21.15.62:0/3810384214 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fedf8041170 con 0x7fedec009980 2023-05-15T16:40:11.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.519+0000 7fad15ffb640 1 -- 172.21.15.62:0/3829558507 shutdown_connections 2023-05-15T16:40:11.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.519+0000 7fad15ffb640 1 -- 172.21.15.62:0/3829558507 wait complete. 2023-05-15T16:40:11.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.519+0000 7fedf67fc640 1 -- 172.21.15.62:0/3810384214 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fee000bc1d0 con 0x7fedec009980 2023-05-15T16:40:11.525 INFO:teuthology.orchestra.run.smithi062.stdout:55834574855 2023-05-15T16:40:11.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.527+0000 7fee0803a640 1 -- 172.21.15.62:0/3810384214 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fede4065400 msgr2=0x7fede40678b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.527+0000 7fee0803a640 1 --2- 172.21.15.62:0/3810384214 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fede4065400 0x7fede40678b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fedf8033db0 tx=0x7fedfc008040 comp rx=0 tx=0).stop 2023-05-15T16:40:11.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.527+0000 7fee0803a640 1 -- 172.21.15.62:0/3810384214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedec009980 msgr2=0x7fedf80351f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.527+0000 7fee0803a640 1 --2- 172.21.15.62:0/3810384214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedec009980 0x7fedf80351f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fee00000b70 tx=0x7fee0006ab90 comp rx=0 tx=0).stop 2023-05-15T16:40:11.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.527+0000 7fee0803a640 1 -- 172.21.15.62:0/3810384214 shutdown_connections 2023-05-15T16:40:11.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.527+0000 7fee0803a640 1 --2- 172.21.15.62:0/3810384214 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fede4065400 0x7fede40678b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.527+0000 7fee0803a640 1 --2- 172.21.15.62:0/3810384214 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fedf8197d70 0x7fedf80e65f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.527+0000 7fee0803a640 1 --2- 172.21.15.62:0/3810384214 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fedf8197900 0x7fedf80e60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.527+0000 7fee0803a640 1 --2- 172.21.15.62:0/3810384214 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fedec009980 0x7fedf80351f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.527+0000 7fee0803a640 1 -- 172.21.15.62:0/3810384214 >> 172.21.15.62:0/3810384214 conn(0x7fedf8043080 msgr2=0x7fedf80e7710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:11.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.527+0000 7fee0803a640 1 -- 172.21.15.62:0/3810384214 shutdown_connections 2023-05-15T16:40:11.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.527+0000 7fee0803a640 1 -- 172.21.15.62:0/3810384214 wait complete. 2023-05-15T16:40:11.537 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.1 2023-05-15T16:40:11.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.535+0000 7f3099ffb640 1 -- 172.21.15.62:0/777545580 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3088005510 con 0x7f30a80d2170 2023-05-15T16:40:11.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.535+0000 7f309bfff640 1 -- 172.21.15.62:0/777545580 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f30b0169bd0 con 0x7f30a80d2170 2023-05-15T16:40:11.539 INFO:teuthology.orchestra.run.smithi062.stdout:55834574854 2023-05-15T16:40:11.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.535+0000 7f3099ffb640 1 -- 172.21.15.62:0/777545580 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3094065380 msgr2=0x7f3094067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.535+0000 7f3099ffb640 1 --2- 172.21.15.62:0/777545580 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3094065380 0x7f3094067830 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f309c000f70 tx=0x7f309c00d040 comp rx=0 tx=0).stop 2023-05-15T16:40:11.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.535+0000 7f3099ffb640 1 -- 172.21.15.62:0/777545580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a80d2170 msgr2=0x7f30a80caf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.535+0000 7f3099ffb640 1 --2- 172.21.15.62:0/777545580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a80d2170 0x7f30a80caf80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f30b004ee20 tx=0x7f30b00956b0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.535+0000 7f3099ffb640 1 -- 172.21.15.62:0/777545580 shutdown_connections 2023-05-15T16:40:11.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.535+0000 7f3099ffb640 1 --2- 172.21.15.62:0/777545580 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3094065380 0x7f3094067830 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.535+0000 7f3099ffb640 1 --2- 172.21.15.62:0/777545580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f30a80d2170 0x7f30a80caf80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.535+0000 7f3099ffb640 1 --2- 172.21.15.62:0/777545580 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f30a803ecd0 0x7f30a80c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.535+0000 7f3099ffb640 1 --2- 172.21.15.62:0/777545580 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f30a8007ea0 0x7f30a80d10b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.535+0000 7f3099ffb640 1 -- 172.21.15.62:0/777545580 >> 172.21.15.62:0/777545580 conn(0x7f30a8043a20 msgr2=0x7f30a80c4f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:11.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.7 2023-05-15T16:40:11.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.535+0000 7f3099ffb640 1 -- 172.21.15.62:0/777545580 shutdown_connections 2023-05-15T16:40:11.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.535+0000 7f3099ffb640 1 -- 172.21.15.62:0/777545580 wait complete. 2023-05-15T16:40:11.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.539+0000 7f10ba978640 1 -- 172.21.15.62:0/235584819 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f10940057e0 con 0x7f10b4151920 2023-05-15T16:40:11.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.539+0000 7f10b0ff9640 1 -- 172.21.15.62:0/235584819 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f10a40538b0 con 0x7f10b4151920 2023-05-15T16:40:11.544 INFO:teuthology.orchestra.run.smithi062.stdout:55834574855 2023-05-15T16:40:11.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.539+0000 7f10ba978640 1 -- 172.21.15.62:0/235584819 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f10a0065380 msgr2=0x7f10a0067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.539+0000 7f10ba978640 1 --2- 172.21.15.62:0/235584819 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f10a0065380 0x7f10a0067830 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f10a80b2000 tx=0x7f10a80aa070 comp rx=0 tx=0).stop 2023-05-15T16:40:11.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.539+0000 7f10ba978640 1 -- 172.21.15.62:0/235584819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10b4151920 msgr2=0x7f10b40b5ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:11.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.539+0000 7f10ba978640 1 --2- 172.21.15.62:0/235584819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10b4151920 0x7f10b40b5ff0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f10a400c390 tx=0x7f10a400c850 comp rx=0 tx=0).stop 2023-05-15T16:40:11.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.539+0000 7f10ba978640 1 -- 172.21.15.62:0/235584819 shutdown_connections 2023-05-15T16:40:11.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.539+0000 7f10ba978640 1 --2- 172.21.15.62:0/235584819 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f10b4151920 0x7f10b40b5ff0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.539+0000 7f10ba978640 1 --2- 172.21.15.62:0/235584819 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f10a0065380 0x7f10a0067830 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.539+0000 7f10ba978640 1 --2- 172.21.15.62:0/235584819 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f10b40b2e20 0x7f10b40b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.539+0000 7f10ba978640 1 --2- 172.21.15.62:0/235584819 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f10b406a7c0 0x7f10b40b51a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:11.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.539+0000 7f10ba978640 1 -- 172.21.15.62:0/235584819 >> 172.21.15.62:0/235584819 conn(0x7f10b40bce40 msgr2=0x7f10b40bb960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:11.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.4 2023-05-15T16:40:11.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.539+0000 7f10ba978640 1 -- 172.21.15.62:0/235584819 shutdown_connections 2023-05-15T16:40:11.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:11.539+0000 7f10ba978640 1 -- 172.21.15.62:0/235584819 wait complete. 2023-05-15T16:40:11.550 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574853 for osd.5 2023-05-15T16:40:11.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.3 2023-05-15T16:40:11.558 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.0 2023-05-15T16:40:11.563 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.6 2023-05-15T16:40:11.565 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574855 for osd.2 2023-05-15T16:40:12.538 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-05-15T16:40:12.544 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-05-15T16:40:12.549 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-05-15T16:40:12.551 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-05-15T16:40:12.553 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-05-15T16:40:12.559 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-05-15T16:40:12.563 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-05-15T16:40:12.566 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-05-15T16:40:12.722 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.719+0000 7fbe1ccff640 1 Processor -- start 2023-05-15T16:40:12.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.719+0000 7fbe1ccff640 1 -- start start 2023-05-15T16:40:12.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.719+0000 7fbe1ccff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbe180b4470 0x7fbe18145fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.719+0000 7fbe1ccff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe180b7f80 0x7fbe18146500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.719+0000 7fbe1ccff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbe1813f7a0 0x7fbe1813fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.719+0000 7fbe1ccff640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe18145ba0 con 0x7fbe180b4470 2023-05-15T16:40:12.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.719+0000 7fbe1ccff640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe18071ed0 con 0x7fbe1813f7a0 2023-05-15T16:40:12.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.719+0000 7fbe1ccff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe180b5b60 con 0x7fbe180b7f80 2023-05-15T16:40:12.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.719+0000 7fbe1659c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbe180b4470 0x7fbe18145fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.726 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.719+0000 7fbe1659c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbe180b4470 0x7fbe18145fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42942/0 (socket says 172.21.15.62:42942) 2023-05-15T16:40:12.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.719+0000 7fbe1659c640 1 -- 172.21.15.62:0/3395426152 learned_addr learned my addr 172.21.15.62:0/3395426152 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:12.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.719+0000 7fbe16d9d640 1 --2- 172.21.15.62:0/3395426152 >> v2:172.21.15.161:3300/0 conn(0x7fbe1813f7a0 0x7fbe1813fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.719+0000 7fbe15d9b640 1 --2- 172.21.15.62:0/3395426152 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe180b7f80 0x7fbe18146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.719+0000 7fbe1659c640 1 -- 172.21.15.62:0/3395426152 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe180b7f80 msgr2=0x7fbe18146500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:12.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.719+0000 7fbe1659c640 1 --2- 172.21.15.62:0/3395426152 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe180b7f80 0x7fbe18146500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.719+0000 7fbe1659c640 1 -- 172.21.15.62:0/3395426152 >> v2:172.21.15.161:3300/0 conn(0x7fbe1813f7a0 msgr2=0x7fbe1813fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:12.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.719+0000 7fbe1659c640 1 --2- 172.21.15.62:0/3395426152 >> v2:172.21.15.161:3300/0 conn(0x7fbe1813f7a0 0x7fbe1813fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.719+0000 7fbe1659c640 1 -- 172.21.15.62:0/3395426152 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe180b2f20 con 0x7fbe180b4470 2023-05-15T16:40:12.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.723+0000 7fbe1659c640 1 --2- 172.21.15.62:0/3395426152 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe180b4470 0x7fbe18145fc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbe180b3110 tx=0x7fbe0c01ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e35941d86483941 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.723+0000 7fbe1559a640 1 -- 172.21.15.62:0/3395426152 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe0c0a8d60 con 0x7fbe180b4470 2023-05-15T16:40:12.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.723+0000 7fbe1559a640 1 -- 172.21.15.62:0/3395426152 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe0c004030 con 0x7fbe180b4470 2023-05-15T16:40:12.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.727+0000 7fbe1ccff640 1 -- 172.21.15.62:0/3395426152 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe180b4470 msgr2=0x7fbe18145fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.727+0000 7fbe1ccff640 1 --2- 172.21.15.62:0/3395426152 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe180b4470 0x7fbe18145fc0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fbe180b3110 tx=0x7fbe0c01ef90 comp rx=0 tx=0).stop 2023-05-15T16:40:12.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.727+0000 7fbe1ccff640 1 -- 172.21.15.62:0/3395426152 shutdown_connections 2023-05-15T16:40:12.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.727+0000 7fbe1ccff640 1 --2- 172.21.15.62:0/3395426152 >> v2:172.21.15.161:3300/0 conn(0x7fbe1813f7a0 0x7fbe1813fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.727+0000 7fbe1ccff640 1 --2- 172.21.15.62:0/3395426152 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe180b7f80 0x7fbe18146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.727+0000 7fbe1ccff640 1 --2- 172.21.15.62:0/3395426152 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe180b4470 0x7fbe18145fc0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.727+0000 7fbe1ccff640 1 -- 172.21.15.62:0/3395426152 >> 172.21.15.62:0/3395426152 conn(0x7fbe180bc5d0 msgr2=0x7fbe180b8420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:12.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.727+0000 7fbe1ccff640 1 -- 172.21.15.62:0/3395426152 shutdown_connections 2023-05-15T16:40:12.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.727+0000 7fbe1ccff640 1 -- 172.21.15.62:0/3395426152 wait complete. 2023-05-15T16:40:12.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.727+0000 7fbe1ccff640 1 Processor -- start 2023-05-15T16:40:12.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.727+0000 7fbe1ccff640 1 -- start start 2023-05-15T16:40:12.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.727+0000 7fbe1ccff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe180b4470 0x7fbe18070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.727+0000 7fbe1ccff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe180b7f80 0x7fbe1806f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.727+0000 7fbe1ccff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe1813f7a0 0x7fbe181e04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.727+0000 7fbe1ccff640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1806fdd0 con 0x7fbe1813f7a0 2023-05-15T16:40:12.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.727+0000 7fbe1ccff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe18147080 con 0x7fbe180b7f80 2023-05-15T16:40:12.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.727+0000 7fbe1ccff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe1806e370 con 0x7fbe180b4470 2023-05-15T16:40:12.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.727+0000 7fbe16d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe1813f7a0 0x7fbe181e04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.727+0000 7fbe16d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe1813f7a0 0x7fbe181e04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42954/0 (socket says 172.21.15.62:42954) 2023-05-15T16:40:12.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.727+0000 7fbe16d9d640 1 -- 172.21.15.62:0/3965465179 learned_addr learned my addr 172.21.15.62:0/3965465179 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:12.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.727+0000 7fbe1659c640 1 --2- 172.21.15.62:0/3965465179 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe180b4470 0x7fbe18070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.731+0000 7fbe15d9b640 1 --2- 172.21.15.62:0/3965465179 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe180b7f80 0x7fbe1806f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.731+0000 7fbe16d9d640 1 -- 172.21.15.62:0/3965465179 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe180b4470 msgr2=0x7fbe18070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.731+0000 7fbe16d9d640 1 --2- 172.21.15.62:0/3965465179 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe180b4470 0x7fbe18070ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.731+0000 7fbe16d9d640 1 -- 172.21.15.62:0/3965465179 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe180b7f80 msgr2=0x7fbe1806f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.731+0000 7fbe16d9d640 1 --2- 172.21.15.62:0/3965465179 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe180b7f80 0x7fbe1806f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.731+0000 7fbe16d9d640 1 -- 172.21.15.62:0/3965465179 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe0c00a580 con 0x7fbe1813f7a0 2023-05-15T16:40:12.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.731+0000 7fbe16d9d640 1 --2- 172.21.15.62:0/3965465179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe1813f7a0 0x7fbe181e04f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000fae0 tx=0x7fbe1000e160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.731+0000 7fbe06ffd640 1 -- 172.21.15.62:0/3965465179 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1000ed40 con 0x7fbe1813f7a0 2023-05-15T16:40:12.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.731+0000 7fbe1ccff640 1 -- 172.21.15.62:0/3965465179 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe180b34c0 con 0x7fbe1813f7a0 2023-05-15T16:40:12.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.731+0000 7fbe1ccff640 1 -- 172.21.15.62:0/3965465179 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe180b31e0 con 0x7fbe1813f7a0 2023-05-15T16:40:12.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.731+0000 7fbe06ffd640 1 -- 172.21.15.62:0/3965465179 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe1001a460 con 0x7fbe1813f7a0 2023-05-15T16:40:12.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.731+0000 7fbe06ffd640 1 -- 172.21.15.62:0/3965465179 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe1000eea0 con 0x7fbe1813f7a0 2023-05-15T16:40:12.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.731+0000 7fbe1ccff640 1 -- 172.21.15.62:0/3965465179 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe180b4840 con 0x7fbe1813f7a0 2023-05-15T16:40:12.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.731+0000 7fbe06ffd640 1 -- 172.21.15.62:0/3965465179 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fbe10011440 con 0x7fbe1813f7a0 2023-05-15T16:40:12.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.731+0000 7fbe06ffd640 1 --2- 172.21.15.62:0/3965465179 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbe00065540 0x7fbe000679f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.731+0000 7fbe06ffd640 1 -- 172.21.15.62:0/3965465179 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbe10082e80 con 0x7fbe1813f7a0 2023-05-15T16:40:12.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.739+0000 7fbe1659c640 1 --2- 172.21.15.62:0/3965465179 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbe00065540 0x7fbe000679f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.739+0000 7fbe06ffd640 1 -- 172.21.15.62:0/3965465179 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fbe10050c10 con 0x7fbe1813f7a0 2023-05-15T16:40:12.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.751+0000 7fbe1659c640 1 --2- 172.21.15.62:0/3965465179 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbe00065540 0x7fbe000679f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0b1000 tx=0x7fbe0c0aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7fbdaa695640 1 Processor -- start 2023-05-15T16:40:12.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7fbdaa695640 1 -- start start 2023-05-15T16:40:12.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f4a07111640 1 Processor -- start 2023-05-15T16:40:12.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f4a07111640 1 -- start start 2023-05-15T16:40:12.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f4a07111640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a000b4310 0x7f4a0014deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f4a07111640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a0014e580 con 0x7f4a000b8e60 2023-05-15T16:40:12.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f4a07111640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a0014e860 con 0x7f4a000ba730 2023-05-15T16:40:12.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f4a07111640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a0014ee20 con 0x7f4a000b4310 2023-05-15T16:40:12.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f4a0590e640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4a000b8e60 0x7f4a00147bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37898/0 (socket says 172.21.15.62:37898) 2023-05-15T16:40:12.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f4a0590e640 1 -- 172.21.15.62:0/780252613 learned_addr learned my addr 172.21.15.62:0/780252613 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:12.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f4a0610f640 1 --2- 172.21.15.62:0/780252613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a000b4310 0x7f4a0014deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7fbdaa695640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd9c0cee10 0x7fbd9c03df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7fbdaa695640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd9c040a90 con 0x7fbd9c0091a0 2023-05-15T16:40:12.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7fbda9e94640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fbd9c0091a0 0x7fbd9c0df3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37894/0 (socket says 172.21.15.62:37894) 2023-05-15T16:40:12.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7fbda9e94640 1 -- 172.21.15.62:0/104149428 learned_addr learned my addr 172.21.15.62:0/104149428 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:12.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7fbdaa695640 1 -- 172.21.15.62:0/104149428 --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd9c0d8080 con 0x7fbd9c008d50 2023-05-15T16:40:12.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7fbdaa695640 1 -- 172.21.15.62:0/104149428 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c0d8360 con 0x7fbd9c0cee10 2023-05-15T16:40:12.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7fbda9693640 1 --2- 172.21.15.62:0/104149428 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd9c0cee10 0x7fbd9c03df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f36b29a1640 1 Processor -- start 2023-05-15T16:40:12.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f36b29a1640 1 -- start start 2023-05-15T16:40:12.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7fbd9bfff640 1 -- 172.21.15.62:0/104149428 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570389305 0 0) 0x7fbd9c040a90 con 0x7fbd9c0091a0 2023-05-15T16:40:12.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7fbd9bfff640 1 -- 172.21.15.62:0/104149428 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd90003530 con 0x7fbd9c0091a0 2023-05-15T16:40:12.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7fbda9693640 1 -- 172.21.15.62:0/104149428 >> v1:172.21.15.161:6789/0 conn(0x7fbd9c008d50 legacy=0x7fbd9c0d4b30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-15T16:40:12.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7fbda9693640 1 -- 172.21.15.62:0/104149428 >> v1:172.21.15.62:6789/0 conn(0x7fbd9c0091a0 legacy=0x7fbd9c0df3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7fbda9693640 1 -- 172.21.15.62:0/104149428 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd9c0d8640 con 0x7fbd9c0cee10 2023-05-15T16:40:12.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7faa404ad640 1 Processor -- start 2023-05-15T16:40:12.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7faa404ad640 1 -- start start 2023-05-15T16:40:12.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f36b29a1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f36a403f7e0 0x7f36a403a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f36b29a1640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f36a40d0030 0x7f36a40d6f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f36b29a1640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a403aa60 con 0x7f36a40cfbe0 2023-05-15T16:40:12.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f36b29a1640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a403c860 con 0x7f36a403f7e0 2023-05-15T16:40:12.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f36b29a1640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a403aef0 con 0x7f36a40d0030 2023-05-15T16:40:12.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f4a0610f640 1 -- 172.21.15.62:0/780252613 >> v1:172.21.15.161:6789/0 conn(0x7f4a000ba730 legacy=0x7f4a000bab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f4a0510d640 1 -- 172.21.15.62:0/780252613 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33881634 0 0) 0x7f4a0014e860 con 0x7f4a000ba730 2023-05-15T16:40:12.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f4a0610f640 1 -- 172.21.15.62:0/780252613 >> v1:172.21.15.62:6789/0 conn(0x7f4a000b8e60 legacy=0x7f4a00147bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f4a0610f640 1 -- 172.21.15.62:0/780252613 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a0014eb40 con 0x7f4a000b4310 2023-05-15T16:40:12.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f36abfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f36a403f7e0 0x7f36a403a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f36abfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f36a403f7e0 0x7f36a403a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42970/0 (socket says 172.21.15.62:42970) 2023-05-15T16:40:12.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.767+0000 7f36abfff640 1 -- 172.21.15.62:0/2182854466 learned_addr learned my addr 172.21.15.62:0/2182854466 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:12.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7f36aaffd640 1 -- 172.21.15.62:0/2182854466 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1241367113 0 0) 0x7f36a403aa60 con 0x7f36a40cfbe0 2023-05-15T16:40:12.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7f36abfff640 1 -- 172.21.15.62:0/2182854466 >> v2:172.21.15.161:3300/0 conn(0x7f36a40d0030 msgr2=0x7f36a40d6f10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-15T16:40:12.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7f36abfff640 1 --2- 172.21.15.62:0/2182854466 >> v2:172.21.15.161:3300/0 conn(0x7f36a40d0030 0x7f36a40d6f10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7f36abfff640 1 -- 172.21.15.62:0/2182854466 >> v1:172.21.15.161:6789/0 conn(0x7f36a40cfbe0 legacy=0x7f36a40c6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7f36abfff640 1 -- 172.21.15.62:0/2182854466 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a4039990 con 0x7f36a403f7e0 2023-05-15T16:40:12.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7faa404ad640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faa3003ef80 0x7faa3003f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7faa404ad640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa300ce8b0 0x7faa300ced30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7faa404ad640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa30009a80 con 0x7faa30007480 2023-05-15T16:40:12.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7faa404ad640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa30008dc0 con 0x7faa3003ef80 2023-05-15T16:40:12.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7faa404ad640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa300d4b10 con 0x7faa300ce8b0 2023-05-15T16:40:12.781 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fcbe1238640 1 Processor -- start 2023-05-15T16:40:12.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fcbe1238640 1 -- start start 2023-05-15T16:40:12.782 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fbda9693640 1 --2- 172.21.15.62:0/104149428 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd9c0cee10 0x7fbd9c03df90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbd940097f0 tx=0x7fbd9401c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=487b9553b1243595 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7faa3da48640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faa3003ef80 0x7faa3003f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7faa3da48640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7faa3003ef80 0x7faa3003f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42984/0 (socket says 172.21.15.62:42984) 2023-05-15T16:40:12.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7faa3da48640 1 -- 172.21.15.62:0/1662128803 learned_addr learned my addr 172.21.15.62:0/1662128803 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:12.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fbd9bfff640 1 -- 172.21.15.62:0/104149428 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd940ab600 con 0x7fbd9c0cee10 2023-05-15T16:40:12.783 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fbd9bfff640 1 -- 172.21.15.62:0/104149428 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd940a7050 con 0x7fbd9c0cee10 2023-05-15T16:40:12.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fbd9bfff640 1 -- 172.21.15.62:0/104149428 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd940ab960 con 0x7fbd9c0cee10 2023-05-15T16:40:12.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fcbe1238640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbdc14de90 0x7fcbdc159720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fcbe1238640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbdc0b9240 con 0x7fcbdc0b8010 2023-05-15T16:40:12.784 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fcbe1238640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbdc0b2a90 con 0x7fcbdc071950 2023-05-15T16:40:12.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fcbe1238640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc0b4fc0 con 0x7fcbdc14de90 2023-05-15T16:40:12.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7faa3da48640 1 -- 172.21.15.62:0/1662128803 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa300ce8b0 msgr2=0x7faa300ced30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-05-15T16:40:12.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7faa3da48640 1 --2- 172.21.15.62:0/1662128803 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa300ce8b0 0x7faa300ced30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7faa3da48640 1 -- 172.21.15.62:0/1662128803 >> v1:172.21.15.62:6789/0 conn(0x7faa30007480 legacy=0x7faa300080f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:12.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7faa3da48640 1 -- 172.21.15.62:0/1662128803 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa300cf270 con 0x7faa3003ef80 2023-05-15T16:40:12.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fcbdb59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbdc14de90 0x7fcbdc159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fcbdb59e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbdc14de90 0x7fcbdc159720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.62:37928/0 (socket says 172.21.15.62:37928) 2023-05-15T16:40:12.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fcbdb59e640 1 -- 172.21.15.62:0/4012217544 learned_addr learned my addr 172.21.15.62:0/4012217544 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:12.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7f4a0610f640 1 --2- 172.21.15.62:0/780252613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a000b4310 0x7f4a0014deb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0097f0 tx=0x7f49fc01c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=175ab04f286fff17 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fcbdb59e640 1 -- 172.21.15.62:0/4012217544 >> v1:172.21.15.161:6789/0 conn(0x7fcbdc071950 legacy=0x7fcbdc151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fcbdb59e640 1 -- 172.21.15.62:0/4012217544 >> v1:172.21.15.62:6789/0 conn(0x7fcbdc0b8010 legacy=0x7fcbdc0b8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:12.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fbdaa695640 1 -- 172.21.15.62:0/104149428 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd9c0cee10 msgr2=0x7fbd9c03df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fbdaa695640 1 --2- 172.21.15.62:0/104149428 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd9c0cee10 0x7fbd9c03df90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbd940097f0 tx=0x7fbd9401c3f0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fbdaa695640 1 -- 172.21.15.62:0/104149428 shutdown_connections 2023-05-15T16:40:12.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fbdaa695640 1 --2- 172.21.15.62:0/104149428 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd9c0cee10 0x7fbd9c03df90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fbdaa695640 1 -- 172.21.15.62:0/104149428 >> 172.21.15.62:0/104149428 conn(0x7fbd9c0442a0 msgr2=0x7fbd9c040090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:12.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fbdaa695640 1 -- 172.21.15.62:0/104149428 shutdown_connections 2023-05-15T16:40:12.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fbdaa695640 1 -- 172.21.15.62:0/104149428 wait complete. 2023-05-15T16:40:12.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7f4a0510d640 1 -- 172.21.15.62:0/780252613 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc0ac630 con 0x7f4a000b4310 2023-05-15T16:40:12.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7f4a0510d640 1 -- 172.21.15.62:0/780252613 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc0ac790 con 0x7f4a000b4310 2023-05-15T16:40:12.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7f4a0510d640 1 -- 172.21.15.62:0/780252613 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc0acb20 con 0x7f4a000b4310 2023-05-15T16:40:12.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.771+0000 7fcbdb59e640 1 -- 172.21.15.62:0/4012217544 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc0b5c20 con 0x7fcbdc14de90 2023-05-15T16:40:12.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f4a07111640 1 -- 172.21.15.62:0/780252613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a000b4310 msgr2=0x7f4a0014deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f4a07111640 1 --2- 172.21.15.62:0/780252613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a000b4310 0x7f4a0014deb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0097f0 tx=0x7f49fc01c4c0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbdaa695640 1 Processor -- start 2023-05-15T16:40:12.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbdaa695640 1 -- start start 2023-05-15T16:40:12.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f4a07111640 1 -- 172.21.15.62:0/780252613 shutdown_connections 2023-05-15T16:40:12.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f4a07111640 1 --2- 172.21.15.62:0/780252613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a000b4310 0x7f4a0014deb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f4a07111640 1 -- 172.21.15.62:0/780252613 >> 172.21.15.62:0/780252613 conn(0x7f4a0006def0 msgr2=0x7f4a0006e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:12.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7faa3da48640 1 --2- 172.21.15.62:0/1662128803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa3003ef80 0x7faa3003f3b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faa340098a0 tx=0x7faa3401c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff33b0a138580e7 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f36abfff640 1 --2- 172.21.15.62:0/2182854466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36a403f7e0 0x7f36a403a300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f36ac068e90 tx=0x7f36ac09ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfdcd473368ffa01 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f4a07111640 1 -- 172.21.15.62:0/780252613 shutdown_connections 2023-05-15T16:40:12.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f4a07111640 1 -- 172.21.15.62:0/780252613 wait complete. 2023-05-15T16:40:12.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbdaa695640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd9c008d50 0x7fbd9c0c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7faa3d247640 1 -- 172.21.15.62:0/1662128803 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa340ac410 con 0x7faa3003ef80 2023-05-15T16:40:12.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbdaa695640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd9c0091a0 0x7fbd9c0cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbdaa695640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd9c0cee10 0x7fbd9c0c5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbdaa695640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c0ca1f0 con 0x7fbd9c0cee10 2023-05-15T16:40:12.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbdaa695640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c0ce580 con 0x7fbd9c0091a0 2023-05-15T16:40:12.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbdaa695640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9c0ce7f0 con 0x7fbd9c008d50 2023-05-15T16:40:12.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f36aaffd640 1 -- 172.21.15.62:0/2182854466 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac126c10 con 0x7f36a403f7e0 2023-05-15T16:40:12.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7faa3d247640 1 -- 172.21.15.62:0/1662128803 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa340ac570 con 0x7faa3003ef80 2023-05-15T16:40:12.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7faa3d247640 1 -- 172.21.15.62:0/1662128803 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa340ac900 con 0x7faa3003ef80 2023-05-15T16:40:12.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f36aaffd640 1 -- 172.21.15.62:0/2182854466 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac12a070 con 0x7f36a403f7e0 2023-05-15T16:40:12.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fabfbfff640 1 Processor -- start 2023-05-15T16:40:12.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbda9e94640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd9c0cee10 0x7fbd9c0c5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f36aaffd640 1 -- 172.21.15.62:0/2182854466 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac130600 con 0x7f36a403f7e0 2023-05-15T16:40:12.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fabfbfff640 1 -- start start 2023-05-15T16:40:12.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbda9e94640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd9c0cee10 0x7fbd9c0c5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:42986/0 (socket says 172.21.15.62:42986) 2023-05-15T16:40:12.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbda9e94640 1 -- 172.21.15.62:0/740373109 learned_addr learned my addr 172.21.15.62:0/740373109 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:12.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbda9e94640 1 -- 172.21.15.62:0/740373109 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd9c008d50 msgr2=0x7fbd9c0c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbda9e94640 1 --2- 172.21.15.62:0/740373109 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd9c008d50 0x7fbd9c0c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbda9e94640 1 -- 172.21.15.62:0/740373109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd9c0091a0 msgr2=0x7fbd9c0cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbda9e94640 1 --2- 172.21.15.62:0/740373109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd9c0091a0 0x7fbd9c0cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbda9e94640 1 -- 172.21.15.62:0/740373109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd94009420 con 0x7fbd9c0cee10 2023-05-15T16:40:12.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbda9e94640 1 --2- 172.21.15.62:0/740373109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd9c0cee10 0x7fbd9c0c5b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbda4078db0 tx=0x7fbda404de90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbd99ffb640 1 -- 172.21.15.62:0/740373109 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda406b310 con 0x7fbd9c0cee10 2023-05-15T16:40:12.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbd99ffb640 1 -- 172.21.15.62:0/740373109 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda408d070 con 0x7fbd9c0cee10 2023-05-15T16:40:12.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbdaa695640 1 -- 172.21.15.62:0/740373109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd9c03a3a0 con 0x7fbd9c0cee10 2023-05-15T16:40:12.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f36b29a1640 1 -- 172.21.15.62:0/2182854466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36a403f7e0 msgr2=0x7f36a403a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f36b29a1640 1 --2- 172.21.15.62:0/2182854466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36a403f7e0 0x7f36a403a300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f36ac068e90 tx=0x7f36ac09ce60 comp rx=0 tx=0).stop 2023-05-15T16:40:12.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f4a07111640 1 Processor -- start 2023-05-15T16:40:12.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f36b29a1640 1 -- 172.21.15.62:0/2182854466 shutdown_connections 2023-05-15T16:40:12.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f36b29a1640 1 --2- 172.21.15.62:0/2182854466 >> v2:172.21.15.161:3300/0 conn(0x7f36a40d0030 0x7f36a40d6f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f36b29a1640 1 --2- 172.21.15.62:0/2182854466 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36a403f7e0 0x7f36a403a300 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f36b29a1640 1 -- 172.21.15.62:0/2182854466 >> 172.21.15.62:0/2182854466 conn(0x7f36a4043080 msgr2=0x7f36a403ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:12.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fcbdb59e640 1 --2- 172.21.15.62:0/4012217544 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbdc14de90 0x7fcbdc159720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0098a0 tx=0x7fcbcc01c4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4778c59076035d2e server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f36b29a1640 1 -- 172.21.15.62:0/2182854466 shutdown_connections 2023-05-15T16:40:12.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7faa404ad640 1 -- 172.21.15.62:0/1662128803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa3003ef80 msgr2=0x7faa3003f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7faa404ad640 1 --2- 172.21.15.62:0/1662128803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa3003ef80 0x7faa3003f3b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faa340098a0 tx=0x7faa3401c500 comp rx=0 tx=0).stop 2023-05-15T16:40:12.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7faa404ad640 1 -- 172.21.15.62:0/1662128803 shutdown_connections 2023-05-15T16:40:12.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7faa404ad640 1 --2- 172.21.15.62:0/1662128803 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa300ce8b0 0x7faa300ced30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7faa404ad640 1 --2- 172.21.15.62:0/1662128803 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa3003ef80 0x7faa3003f3b0 secure :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7faa340098a0 tx=0x7faa3401c500 comp rx=0 tx=0).stop 2023-05-15T16:40:12.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7faa404ad640 1 -- 172.21.15.62:0/1662128803 >> 172.21.15.62:0/1662128803 conn(0x7faa30045290 msgr2=0x7faa30041080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:12.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f36b29a1640 1 -- 172.21.15.62:0/2182854466 wait complete. 2023-05-15T16:40:12.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fabfbfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fabfc143d90 0x7fabfc0bd170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fabfbfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabfc0b90a0 0x7fabfc14d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fabfbfff640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabfc071450 con 0x7fabfc070e90 2023-05-15T16:40:12.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fabfbfff640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabfc144160 con 0x7fabfc143d90 2023-05-15T16:40:12.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fabfbfff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc06f010 con 0x7fabfc0b90a0 2023-05-15T16:40:12.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fabfb7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fabfc070e90 0x7fabfc0697b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.62:58022/0 (socket says 172.21.15.62:58022) 2023-05-15T16:40:12.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fabfb7fe640 1 -- 172.21.15.62:0/3084676417 learned_addr learned my addr 172.21.15.62:0/3084676417 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:12.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fabfa7fc640 1 --2- 172.21.15.62:0/3084676417 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabfc0b90a0 0x7fabfc14d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbd99ffb640 1 -- 172.21.15.62:0/740373109 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda40697b0 con 0x7fbd9c0cee10 2023-05-15T16:40:12.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbdaa695640 1 -- 172.21.15.62:0/740373109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd9c0cf1e0 con 0x7fbd9c0cee10 2023-05-15T16:40:12.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fcbd9d9b640 1 -- 172.21.15.62:0/4012217544 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc0aa650 con 0x7fcbdc14de90 2023-05-15T16:40:12.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fcbd9d9b640 1 -- 172.21.15.62:0/4012217544 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc0aa7b0 con 0x7fcbdc14de90 2023-05-15T16:40:12.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fcbd9d9b640 1 -- 172.21.15.62:0/4012217544 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc0aab40 con 0x7fcbdc14de90 2023-05-15T16:40:12.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7fbdaa695640 1 -- 172.21.15.62:0/740373109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd9c0e3700 con 0x7fbd9c0cee10 2023-05-15T16:40:12.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7fabfa7fc640 1 -- 172.21.15.62:0/3084676417 >> v2:172.21.15.62:3300/0 conn(0x7fabfc143d90 msgr2=0x7fabfc0bd170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-05-15T16:40:12.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7fabfa7fc640 1 --2- 172.21.15.62:0/3084676417 >> v2:172.21.15.62:3300/0 conn(0x7fabfc143d90 0x7fabfc0bd170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7fabfa7fc640 1 -- 172.21.15.62:0/3084676417 >> v1:172.21.15.161:6789/0 conn(0x7fabfc070e90 legacy=0x7fabfc0697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7fabfa7fc640 1 -- 172.21.15.62:0/3084676417 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabfc071730 con 0x7fabfc0b90a0 2023-05-15T16:40:12.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f4a07111640 1 -- start start 2023-05-15T16:40:12.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f4a07111640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a000b4310 0x7f4a001e6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f4a07111640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a000b8e60 0x7f4a000b6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.775+0000 7f4a07111640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a000ba730 0x7f4a00135e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f4a07111640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a000bda60 con 0x7f4a000b4310 2023-05-15T16:40:12.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f4a07111640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a000b80c0 con 0x7f4a000ba730 2023-05-15T16:40:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f4a07111640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a000b4e20 con 0x7f4a000b8e60 2023-05-15T16:40:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f4a0610f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a000b4310 0x7f4a001e6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f4a0610f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a000b4310 0x7f4a001e6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43002/0 (socket says 172.21.15.62:43002) 2023-05-15T16:40:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f4a0610f640 1 -- 172.21.15.62:0/561255512 learned_addr learned my addr 172.21.15.62:0/561255512 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f4a0610f640 1 -- 172.21.15.62:0/561255512 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a000b8e60 msgr2=0x7f4a000b6140 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-15T16:40:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f4a0610f640 1 --2- 172.21.15.62:0/561255512 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a000b8e60 0x7f4a000b6140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f4a0610f640 1 -- 172.21.15.62:0/561255512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a000ba730 msgr2=0x7f4a00135e60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-15T16:40:12.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f4a0610f640 1 --2- 172.21.15.62:0/561255512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a000ba730 0x7f4a00135e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f4a0610f640 1 -- 172.21.15.62:0/561255512 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49fc009420 con 0x7f4a000b4310 2023-05-15T16:40:12.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f4a0610f640 1 --2- 172.21.15.62:0/561255512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a000b4310 0x7f4a001e6420 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0190d0 tx=0x7f49fc019260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7fbd99ffb640 1 -- 172.21.15.62:0/740373109 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fbda4069910 con 0x7fbd9c0cee10 2023-05-15T16:40:12.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f36b29a1640 1 Processor -- start 2023-05-15T16:40:12.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f36b29a1640 1 -- start start 2023-05-15T16:40:12.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f36b29a1640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36a403f7e0 0x7f36a4033920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f36b29a1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36a40cfbe0 0x7f36a4038140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f36b29a1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36a40d0030 0x7f36a4027950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f36b29a1640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a4033e60 con 0x7f36a40d0030 2023-05-15T16:40:12.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f36b29a1640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a4038680 con 0x7f36a40cfbe0 2023-05-15T16:40:12.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f36b29a1640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a40371d0 con 0x7f36a403f7e0 2023-05-15T16:40:12.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7fbd99ffb640 1 --2- 172.21.15.62:0/740373109 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbd88065380 0x7fbd88067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f36b0f3e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36a40d0030 0x7f36a4027950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f36b0f3e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36a40d0030 0x7f36a4027950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43018/0 (socket says 172.21.15.62:43018) 2023-05-15T16:40:12.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f36b0f3e640 1 -- 172.21.15.62:0/1616448253 learned_addr learned my addr 172.21.15.62:0/1616448253 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:12.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7fbd99ffb640 1 -- 172.21.15.62:0/740373109 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbda40fb5f0 con 0x7fbd9c0cee10 2023-05-15T16:40:12.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f36ab7fe640 1 --2- 172.21.15.62:0/1616448253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36a40cfbe0 0x7f36a4038140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f36abfff640 1 --2- 172.21.15.62:0/1616448253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36a403f7e0 0x7f36a4033920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f49f6ffd640 1 -- 172.21.15.62:0/561255512 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc0b5810 con 0x7f4a000b4310 2023-05-15T16:40:12.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7faa404ad640 1 -- 172.21.15.62:0/1662128803 shutdown_connections 2023-05-15T16:40:12.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7faa404ad640 1 -- 172.21.15.62:0/1662128803 wait complete. 2023-05-15T16:40:12.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f49f6ffd640 1 -- 172.21.15.62:0/561255512 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49fc0b5970 con 0x7f4a000b4310 2023-05-15T16:40:12.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f49f6ffd640 1 -- 172.21.15.62:0/561255512 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49fc0b5d20 con 0x7f4a000b4310 2023-05-15T16:40:12.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f4a07111640 1 -- 172.21.15.62:0/561255512 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a000b9230 con 0x7f4a000b4310 2023-05-15T16:40:12.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f4a07111640 1 -- 172.21.15.62:0/561255512 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a0015bff0 con 0x7f4a000b4310 2023-05-15T16:40:12.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f36abfff640 1 -- 172.21.15.62:0/1616448253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36a40cfbe0 msgr2=0x7f36a4038140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f36abfff640 1 --2- 172.21.15.62:0/1616448253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36a40cfbe0 0x7f36a4038140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f36abfff640 1 -- 172.21.15.62:0/1616448253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36a40d0030 msgr2=0x7f36a4027950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f36abfff640 1 --2- 172.21.15.62:0/1616448253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36a40d0030 0x7f36a4027950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7f36abfff640 1 -- 172.21.15.62:0/1616448253 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ac061440 con 0x7f36a403f7e0 2023-05-15T16:40:12.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7fcbe1238640 1 -- 172.21.15.62:0/4012217544 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbdc14de90 msgr2=0x7fcbdc159720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7fcbe1238640 1 --2- 172.21.15.62:0/4012217544 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbdc14de90 0x7fcbdc159720 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0098a0 tx=0x7fcbcc01c4f0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7fcbe1238640 1 -- 172.21.15.62:0/4012217544 shutdown_connections 2023-05-15T16:40:12.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7fcbe1238640 1 --2- 172.21.15.62:0/4012217544 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbdc14de90 0x7fcbdc159720 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7fcbe1238640 1 -- 172.21.15.62:0/4012217544 >> 172.21.15.62:0/4012217544 conn(0x7fcbdc0bc5d0 msgr2=0x7fcbdc0b8420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:12.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7fcbe1238640 1 -- 172.21.15.62:0/4012217544 shutdown_connections 2023-05-15T16:40:12.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7fcbe1238640 1 -- 172.21.15.62:0/4012217544 wait complete. 2023-05-15T16:40:12.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7fabfa7fc640 1 --2- 172.21.15.62:0/3084676417 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabfc0b90a0 0x7fabfc14d1a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fabec0097c0 tx=0x7fabec01c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1c8c2883f972a93 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7fbda9693640 1 --2- 172.21.15.62:0/740373109 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbd88065380 0x7fbd88067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7faa404ad640 1 Processor -- start 2023-05-15T16:40:12.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.779+0000 7faa404ad640 1 -- start start 2023-05-15T16:40:12.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f4a07111640 1 -- 172.21.15.62:0/561255512 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a000b7f20 con 0x7f4a000b4310 2023-05-15T16:40:12.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fbda9693640 1 --2- 172.21.15.62:0/740373109 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbd88065380 0x7fbd88067830 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbd940ad000 tx=0x7fbd94004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fcbe1238640 1 Processor -- start 2023-05-15T16:40:12.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f36abfff640 1 --2- 172.21.15.62:0/1616448253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36a403f7e0 0x7f36a4033920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f36ac0691a0 tx=0x7f36ac09b6f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f89d108b640 1 Processor -- start 2023-05-15T16:40:12.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f89d108b640 1 -- start start 2023-05-15T16:40:12.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7faa404ad640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa30007480 0x7faa30170d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fabf9ffb640 1 -- 172.21.15.62:0/3084676417 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec0ab600 con 0x7fabfc0b90a0 2023-05-15T16:40:12.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fabf9ffb640 1 -- 172.21.15.62:0/3084676417 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabec0a7050 con 0x7fabfc0b90a0 2023-05-15T16:40:12.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fabf9ffb640 1 -- 172.21.15.62:0/3084676417 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabec0ab980 con 0x7fabfc0b90a0 2023-05-15T16:40:12.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7faa3e249640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa30007480 0x7faa30170d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7faa3e249640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa30007480 0x7faa30170d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43028/0 (socket says 172.21.15.62:43028) 2023-05-15T16:40:12.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7faa3e249640 1 -- 172.21.15.62:0/860930967 learned_addr learned my addr 172.21.15.62:0/860930967 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:12.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7faa404ad640 1 --2- 172.21.15.62:0/860930967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa300ce8b0 0x7faa300d64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f89d108b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f89c403ec40 0x7f89c403b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f89d108b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f89c40cff30 0x7f89c4007c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f89d108b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89c403d170 con 0x7f89c40c6d60 2023-05-15T16:40:12.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f89d108b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c403c740 con 0x7f89c403ec40 2023-05-15T16:40:12.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f36a8ff9640 1 -- 172.21.15.62:0/1616448253 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac12f970 con 0x7f36a403f7e0 2023-05-15T16:40:12.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f89d108b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89c403f690 con 0x7f89c40cff30 2023-05-15T16:40:12.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f89cb7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f89c403ec40 0x7f89c403b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f36a8ff9640 1 -- 172.21.15.62:0/1616448253 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ac08e070 con 0x7f36a403f7e0 2023-05-15T16:40:12.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f36a8ff9640 1 -- 172.21.15.62:0/1616448253 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ac12fcd0 con 0x7f36a403f7e0 2023-05-15T16:40:12.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f89cb7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f89c403ec40 0x7f89c403b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43040/0 (socket says 172.21.15.62:43040) 2023-05-15T16:40:12.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f89cb7fe640 1 -- 172.21.15.62:0/3479232560 learned_addr learned my addr 172.21.15.62:0/3479232560 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:12.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fabfbfff640 1 -- 172.21.15.62:0/3084676417 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabfc0b90a0 msgr2=0x7fabfc14d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fabfbfff640 1 --2- 172.21.15.62:0/3084676417 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabfc0b90a0 0x7fabfc14d1a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fabec0097c0 tx=0x7fabec01c3c0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fabfbfff640 1 -- 172.21.15.62:0/3084676417 shutdown_connections 2023-05-15T16:40:12.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fabfbfff640 1 --2- 172.21.15.62:0/3084676417 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabfc0b90a0 0x7fabfc14d1a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fabfbfff640 1 --2- 172.21.15.62:0/3084676417 >> v2:172.21.15.62:3300/0 conn(0x7fabfc143d90 0x7fabfc0bd170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fabfbfff640 1 -- 172.21.15.62:0/3084676417 >> 172.21.15.62:0/3084676417 conn(0x7fabfc06b550 msgr2=0x7fabfc0bca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:12.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fabfbfff640 1 -- 172.21.15.62:0/3084676417 shutdown_connections 2023-05-15T16:40:12.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fabfbfff640 1 -- 172.21.15.62:0/3084676417 wait complete. 2023-05-15T16:40:12.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f89d088a640 1 --2- 172.21.15.62:0/3479232560 >> v2:172.21.15.161:3300/0 conn(0x7f89c40cff30 0x7f89c4007c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f89cb7fe640 1 -- 172.21.15.62:0/3479232560 >> v2:172.21.15.161:3300/0 conn(0x7f89c40cff30 msgr2=0x7f89c4007c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:12.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f89cb7fe640 1 --2- 172.21.15.62:0/3479232560 >> v2:172.21.15.161:3300/0 conn(0x7f89c40cff30 0x7f89c4007c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f89cb7fe640 1 -- 172.21.15.62:0/3479232560 >> v1:172.21.15.62:6789/0 conn(0x7f89c40c6d60 legacy=0x7f89c403ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:12.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f89cb7fe640 1 -- 172.21.15.62:0/3479232560 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89c40c7130 con 0x7f89c403ec40 2023-05-15T16:40:12.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f36b29a1640 1 -- 172.21.15.62:0/1616448253 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a403fbb0 con 0x7f36a403f7e0 2023-05-15T16:40:12.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f36b29a1640 1 -- 172.21.15.62:0/1616448253 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a4039e50 con 0x7f36a403f7e0 2023-05-15T16:40:12.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7f36967fc640 1 -- 172.21.15.62:0/1616448253 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3684005260 con 0x7f36a403f7e0 2023-05-15T16:40:12.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fcbe1238640 1 -- start start 2023-05-15T16:40:12.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fcbe1238640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbdc071950 0x7fcbdc1505b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fcbe1238640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbdc0b8010 0x7fcbdc146de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fcbe1238640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbdc14de90 0x7fcbdc147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fcbe1238640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc14f6c0 con 0x7fcbdc14de90 2023-05-15T16:40:12.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fcbe1238640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc150af0 con 0x7fcbdc0b8010 2023-05-15T16:40:12.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fcbe1238640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbdc14feb0 con 0x7fcbdc071950 2023-05-15T16:40:12.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fcbda59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbdc0b8010 0x7fcbdc146de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fcbdb59e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbdc14de90 0x7fcbdc147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fcbda59c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbdc0b8010 0x7fcbdc146de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.62:36878/0 (socket says 172.21.15.62:36878) 2023-05-15T16:40:12.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fcbda59c640 1 -- 172.21.15.62:0/3686381329 learned_addr learned my addr 172.21.15.62:0/3686381329 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:12.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fcbdad9d640 1 --2- 172.21.15.62:0/3686381329 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbdc071950 0x7fcbdc1505b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fcbdb59e640 1 -- 172.21.15.62:0/3686381329 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbdc071950 msgr2=0x7fcbdc1505b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fcbdb59e640 1 --2- 172.21.15.62:0/3686381329 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbdc071950 0x7fcbdc1505b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fcbdb59e640 1 -- 172.21.15.62:0/3686381329 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbdc0b8010 msgr2=0x7fcbdc146de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fcbdb59e640 1 --2- 172.21.15.62:0/3686381329 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbdc0b8010 0x7fcbdc146de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fcbdb59e640 1 -- 172.21.15.62:0/3686381329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbcc0094d0 con 0x7fcbdc14de90 2023-05-15T16:40:12.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7fcbdb59e640 1 --2- 172.21.15.62:0/3686381329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbdc14de90 0x7fcbdc147320 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0ab000 tx=0x7fcbcc019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7faa404ad640 1 --2- 172.21.15.62:0/860930967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa300437c0 0x7faa3003a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7faa404ad640 1 -- 172.21.15.62:0/860930967 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa300d8860 con 0x7faa30007480 2023-05-15T16:40:12.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7faa404ad640 1 -- 172.21.15.62:0/860930967 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa30043c60 con 0x7faa300437c0 2023-05-15T16:40:12.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7faa404ad640 1 -- 172.21.15.62:0/860930967 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa30044120 con 0x7faa300ce8b0 2023-05-15T16:40:12.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7faa3ea4a640 1 --2- 172.21.15.62:0/860930967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa300437c0 0x7faa3003a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7faa3e249640 1 -- 172.21.15.62:0/860930967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa300ce8b0 msgr2=0x7faa300d64d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-05-15T16:40:12.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7faa3e249640 1 --2- 172.21.15.62:0/860930967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa300ce8b0 0x7faa300d64d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7faa3e249640 1 -- 172.21.15.62:0/860930967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa300437c0 msgr2=0x7faa3003a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7faa3e249640 1 --2- 172.21.15.62:0/860930967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa300437c0 0x7faa3003a420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7faa3e249640 1 -- 172.21.15.62:0/860930967 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa340094d0 con 0x7faa30007480 2023-05-15T16:40:12.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.783+0000 7faa3e249640 1 --2- 172.21.15.62:0/860930967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa30007480 0x7faa30170d20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faa3804f450 tx=0x7faa38061570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7fabfbfff640 1 Processor -- start 2023-05-15T16:40:12.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7fabfbfff640 1 -- start start 2023-05-15T16:40:12.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7fabfbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabfc070e90 0x7fabfc0b6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7fabfbfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabfc0b90a0 0x7fabfc1dfa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7fabfbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fabfc143d90 0x7fabfc1dff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7fabfbfff640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0b50b0 con 0x7fabfc143d90 2023-05-15T16:40:12.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7fabfbfff640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc1d3240 con 0x7fabfc070e90 2023-05-15T16:40:12.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7fabfbfff640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabfc0b6dc0 con 0x7fabfc0b90a0 2023-05-15T16:40:12.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7fabfb7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fabfc143d90 0x7fabfc1dff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7fabfb7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fabfc143d90 0x7fabfc1dff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43052/0 (socket says 172.21.15.62:43052) 2023-05-15T16:40:12.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7f89cb7fe640 1 --2- 172.21.15.62:0/3479232560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89c403ec40 0x7f89c403b140 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f89c4029260 tx=0x7f89b801ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5cd50edddc69a98 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7fabfb7fe640 1 -- 172.21.15.62:0/3300289772 learned_addr learned my addr 172.21.15.62:0/3300289772 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:12.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7fabfaffd640 1 --2- 172.21.15.62:0/3300289772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabfc070e90 0x7fabfc0b6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7fabfa7fc640 1 --2- 172.21.15.62:0/3300289772 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabfc0b90a0 0x7fabfc1dfa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7fabfb7fe640 1 -- 172.21.15.62:0/3300289772 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabfc0b90a0 msgr2=0x7fabfc1dfa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7fabfb7fe640 1 --2- 172.21.15.62:0/3300289772 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabfc0b90a0 0x7fabfc1dfa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7fabfb7fe640 1 -- 172.21.15.62:0/3300289772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabfc070e90 msgr2=0x7fabfc0b6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7fabfb7fe640 1 --2- 172.21.15.62:0/3300289772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabfc070e90 0x7fabfc0b6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7fabfb7fe640 1 -- 172.21.15.62:0/3300289772 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabec009420 con 0x7fabfc143d90 2023-05-15T16:40:12.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7f36a8ff9640 1 -- 172.21.15.62:0/1616448253 <== mon.2 v2:172.21.15.161:3301/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f36ac130400 con 0x7f36a403f7e0 2023-05-15T16:40:12.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7fabfb7fe640 1 --2- 172.21.15.62:0/3300289772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fabfc143d90 0x7fabfc1dff60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fabf400e4a0 tx=0x7fabf400e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7f36a8ff9640 1 --2- 172.21.15.62:0/1616448253 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f36900653d0 0x7f3690067880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7f36a8ff9640 1 -- 172.21.15.62:0/1616448253 <== mon.2 v2:172.21.15.161:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f36ac1999c0 con 0x7f36a403f7e0 2023-05-15T16:40:12.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7f36ab7fe640 1 --2- 172.21.15.62:0/1616448253 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f36900653d0 0x7f3690067880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.838 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7f36ab7fe640 1 --2- 172.21.15.62:0/1616448253 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f36900653d0 0x7f3690067880 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f36a416b130 tx=0x7f3698009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.787+0000 7fbd99ffb640 1 -- 172.21.15.62:0/740373109 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fbda40ccd30 con 0x7fbd9c0cee10 2023-05-15T16:40:12.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7faa2effd640 1 -- 172.21.15.62:0/860930967 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa380a3670 con 0x7faa30007480 2023-05-15T16:40:12.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7faa404ad640 1 -- 172.21.15.62:0/860930967 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa300d55a0 con 0x7faa30007480 2023-05-15T16:40:12.839 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7faa404ad640 1 -- 172.21.15.62:0/860930967 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa300d52c0 con 0x7faa30007480 2023-05-15T16:40:12.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7fcbc37fe640 1 -- 172.21.15.62:0/3686381329 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc0b4810 con 0x7fcbdc14de90 2023-05-15T16:40:12.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7fcbe1238640 1 -- 172.21.15.62:0/3686381329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbdc071eb0 con 0x7fcbdc14de90 2023-05-15T16:40:12.840 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7fcbe1238640 1 -- 172.21.15.62:0/3686381329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbdc071d20 con 0x7fcbdc14de90 2023-05-15T16:40:12.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7fabe3fff640 1 -- 172.21.15.62:0/3300289772 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf4009280 con 0x7fabfc143d90 2023-05-15T16:40:12.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7fabfbfff640 1 -- 172.21.15.62:0/3300289772 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabfc071cf0 con 0x7fabfc143d90 2023-05-15T16:40:12.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7fabfbfff640 1 -- 172.21.15.62:0/3300289772 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabfc071a10 con 0x7fabfc143d90 2023-05-15T16:40:12.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7faa404ad640 1 -- 172.21.15.62:0/860930967 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa30007850 con 0x7faa30007480 2023-05-15T16:40:12.841 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7faa2effd640 1 -- 172.21.15.62:0/860930967 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa380a37d0 con 0x7faa30007480 2023-05-15T16:40:12.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7fcbe1238640 1 -- 172.21.15.62:0/3686381329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbdc06caf0 con 0x7fcbdc14de90 2023-05-15T16:40:12.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7faa2effd640 1 -- 172.21.15.62:0/860930967 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa380a3b80 con 0x7faa30007480 2023-05-15T16:40:12.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7fcbc37fe640 1 -- 172.21.15.62:0/3686381329 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc0b8070 con 0x7fcbdc14de90 2023-05-15T16:40:12.842 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7fcbc37fe640 1 -- 172.21.15.62:0/3686381329 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc0b4b70 con 0x7fcbdc14de90 2023-05-15T16:40:12.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7fabe3fff640 1 -- 172.21.15.62:0/3300289772 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabf400c2c0 con 0x7fabfc143d90 2023-05-15T16:40:12.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7fabe3fff640 1 -- 172.21.15.62:0/3300289772 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabf40095e0 con 0x7fabfc143d90 2023-05-15T16:40:12.843 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7f49f6ffd640 1 -- 172.21.15.62:0/561255512 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f49fc0b3040 con 0x7f4a000b4310 2023-05-15T16:40:12.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7f49f6ffd640 1 --2- 172.21.15.62:0/561255512 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f49e4065400 0x7f49e40678b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7f49f6ffd640 1 -- 172.21.15.62:0/561255512 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f49fc11cd00 con 0x7f4a000b4310 2023-05-15T16:40:12.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7f4a0590e640 1 --2- 172.21.15.62:0/561255512 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f49e4065400 0x7f49e40678b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7f4a0590e640 1 --2- 172.21.15.62:0/561255512 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f49e4065400 0x7f49e40678b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4a000bd4c0 tx=0x7f49f0007a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.844 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7f89caffd640 1 -- 172.21.15.62:0/3479232560 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b80a8c60 con 0x7f89c403ec40 2023-05-15T16:40:12.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7fabfbfff640 1 -- 172.21.15.62:0/3300289772 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabdc005260 con 0x7fabfc143d90 2023-05-15T16:40:12.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7f89caffd640 1 -- 172.21.15.62:0/3479232560 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b80a8dc0 con 0x7f89c403ec40 2023-05-15T16:40:12.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.791+0000 7f89caffd640 1 -- 172.21.15.62:0/3479232560 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b8004230 con 0x7f89c403ec40 2023-05-15T16:40:12.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.795+0000 7f89d108b640 1 -- 172.21.15.62:0/3479232560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89c403ec40 msgr2=0x7f89c403b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.795+0000 7f89d108b640 1 --2- 172.21.15.62:0/3479232560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89c403ec40 0x7f89c403b140 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f89c4029260 tx=0x7f89b801ef50 comp rx=0 tx=0).stop 2023-05-15T16:40:12.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.795+0000 7f89d108b640 1 -- 172.21.15.62:0/3479232560 shutdown_connections 2023-05-15T16:40:12.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.795+0000 7f89d108b640 1 --2- 172.21.15.62:0/3479232560 >> v2:172.21.15.161:3300/0 conn(0x7f89c40cff30 0x7f89c4007c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.795+0000 7f89d108b640 1 --2- 172.21.15.62:0/3479232560 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89c403ec40 0x7f89c403b140 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.795+0000 7f89d108b640 1 -- 172.21.15.62:0/3479232560 >> 172.21.15.62:0/3479232560 conn(0x7f89c4043a20 msgr2=0x7f89c403f810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:12.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.795+0000 7f89d108b640 1 -- 172.21.15.62:0/3479232560 shutdown_connections 2023-05-15T16:40:12.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.795+0000 7f89d108b640 1 -- 172.21.15.62:0/3479232560 wait complete. 2023-05-15T16:40:12.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.795+0000 7f49f6ffd640 1 -- 172.21.15.62:0/561255512 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f49fc0eaa90 con 0x7f4a000b4310 2023-05-15T16:40:12.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f36a8ff9640 1 -- 172.21.15.62:0/1616448253 <== mon.2 v2:172.21.15.161:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f36ac167770 con 0x7f36a403f7e0 2023-05-15T16:40:12.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89d108b640 1 Processor -- start 2023-05-15T16:40:12.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89d108b640 1 -- start start 2023-05-15T16:40:12.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89d108b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89c403ec40 0x7f89c4157130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89d108b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89c40c6d60 0x7f89c41654b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89d108b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89c40cff30 0x7f89c4161c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89d108b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c4157670 con 0x7f89c40c6d60 2023-05-15T16:40:12.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89d108b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89c40c83e0 con 0x7f89c403ec40 2023-05-15T16:40:12.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89d108b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89c4164d40 con 0x7f89c40cff30 2023-05-15T16:40:12.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89cbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89c403ec40 0x7f89c4157130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89cbfff640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89c403ec40 0x7f89c4157130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.62:36920/0 (socket says 172.21.15.62:36920) 2023-05-15T16:40:12.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89cbfff640 1 -- 172.21.15.62:0/674655046 learned_addr learned my addr 172.21.15.62:0/674655046 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:12.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7faa2effd640 1 -- 172.21.15.62:0/860930967 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7faa380a0070 con 0x7faa30007480 2023-05-15T16:40:12.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7faa2effd640 1 --2- 172.21.15.62:0/860930967 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7faa1c065380 0x7faa1c067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.803+0000 7faa2effd640 1 -- 172.21.15.62:0/860930967 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7faa3810ce50 con 0x7faa30007480 2023-05-15T16:40:12.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.803+0000 7fcbc37fe640 1 -- 172.21.15.62:0/3686381329 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fcbcc0b4cd0 con 0x7fcbdc14de90 2023-05-15T16:40:12.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.803+0000 7fcbc37fe640 1 --2- 172.21.15.62:0/3686381329 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcbc8065380 0x7fcbc8067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.803+0000 7fcbc37fe640 1 -- 172.21.15.62:0/3686381329 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcbcc0ba070 con 0x7fcbdc14de90 2023-05-15T16:40:12.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.803+0000 7faa3da48640 1 --2- 172.21.15.62:0/860930967 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7faa1c065380 0x7faa1c067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.803+0000 7fcbdad9d640 1 --2- 172.21.15.62:0/3686381329 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcbc8065380 0x7fcbc8067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89cbfff640 1 -- 172.21.15.62:0/674655046 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89c40cff30 msgr2=0x7f89c4161c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89cbfff640 1 --2- 172.21.15.62:0/674655046 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89c40cff30 0x7f89c4161c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89cbfff640 1 -- 172.21.15.62:0/674655046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89c40c6d60 msgr2=0x7f89c41654b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:12.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89cbfff640 1 --2- 172.21.15.62:0/674655046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89c40c6d60 0x7f89c41654b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:12.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89cbfff640 1 -- 172.21.15.62:0/674655046 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b800a580 con 0x7f89c403ec40 2023-05-15T16:40:12.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89cbfff640 1 --2- 172.21.15.62:0/674655046 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89c403ec40 0x7f89c4157130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f89c0001eb0 tx=0x7f89c000c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89c8ff9640 1 -- 172.21.15.62:0/674655046 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c0011680 con 0x7f89c403ec40 2023-05-15T16:40:12.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89c8ff9640 1 -- 172.21.15.62:0/674655046 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89c0011800 con 0x7f89c403ec40 2023-05-15T16:40:12.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89d108b640 1 -- 172.21.15.62:0/674655046 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89c40d0300 con 0x7f89c403ec40 2023-05-15T16:40:12.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89c8ff9640 1 -- 172.21.15.62:0/674655046 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89c0011bf0 con 0x7f89c403ec40 2023-05-15T16:40:12.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.799+0000 7f89d108b640 1 -- 172.21.15.62:0/674655046 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89c403ac60 con 0x7f89c403ec40 2023-05-15T16:40:12.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.803+0000 7f89d108b640 1 -- 172.21.15.62:0/674655046 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89c403f0d0 con 0x7f89c403ec40 2023-05-15T16:40:12.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.803+0000 7f89c8ff9640 1 -- 172.21.15.62:0/674655046 <== mon.1 v2:172.21.15.161:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f89c0017020 con 0x7f89c403ec40 2023-05-15T16:40:12.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.803+0000 7f89c8ff9640 1 --2- 172.21.15.62:0/674655046 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f89b0065380 0x7f89b0067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.803+0000 7f89c8ff9640 1 -- 172.21.15.62:0/674655046 <== mon.1 v2:172.21.15.161:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f89c0082a40 con 0x7f89c403ec40 2023-05-15T16:40:12.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.803+0000 7f89cb7fe640 1 --2- 172.21.15.62:0/674655046 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f89b0065380 0x7f89b0067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.803+0000 7fabe3fff640 1 -- 172.21.15.62:0/3300289772 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fabf4009740 con 0x7fabfc143d90 2023-05-15T16:40:12.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.807+0000 7fabe3fff640 1 --2- 172.21.15.62:0/3300289772 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fabe8065380 0x7fabe8067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:12.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.807+0000 7f89cb7fe640 1 --2- 172.21.15.62:0/674655046 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f89b0065380 0x7f89b0067830 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f89b80b1000 tx=0x7f89b8004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.807+0000 7fabe3fff640 1 -- 172.21.15.62:0/3300289772 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fabf4086150 con 0x7fabfc143d90 2023-05-15T16:40:12.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.803+0000 7fcbdad9d640 1 --2- 172.21.15.62:0/3686381329 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcbc8065380 0x7fcbc8067830 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc1ea6c0 tx=0x7fcbd4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.803+0000 7faa3da48640 1 --2- 172.21.15.62:0/860930967 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7faa1c065380 0x7faa1c067830 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faa340ae000 tx=0x7faa340a6040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.807+0000 7fabfaffd640 1 --2- 172.21.15.62:0/3300289772 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fabe8065380 0x7fabe8067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:12.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.807+0000 7faa2effd640 1 -- 172.21.15.62:0/860930967 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7faa380de4d0 con 0x7faa30007480 2023-05-15T16:40:12.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.807+0000 7fabfaffd640 1 --2- 172.21.15.62:0/3300289772 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fabe8065380 0x7fabe8067830 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fabf0006fd0 tx=0x7fabf0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:12.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.811+0000 7fcbc37fe640 1 -- 172.21.15.62:0/3686381329 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fcbcc0eb980 con 0x7fcbdc14de90 2023-05-15T16:40:12.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.815+0000 7fabe3fff640 1 -- 172.21.15.62:0/3300289772 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fabf4057870 con 0x7fabfc143d90 2023-05-15T16:40:12.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:12.819+0000 7f89c8ff9640 1 -- 172.21.15.62:0/674655046 <== mon.1 v2:172.21.15.161:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f89c0050830 con 0x7f89c403ec40 2023-05-15T16:40:13.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.035+0000 7fbe1ccff640 1 -- 172.21.15.62:0/3965465179 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbe18073a90 con 0x7fbe1813f7a0 2023-05-15T16:40:13.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.035+0000 7fbe06ffd640 1 -- 172.21.15.62:0/3965465179 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbe10054230 con 0x7fbe1813f7a0 2023-05-15T16:40:13.044 INFO:teuthology.orchestra.run.smithi062.stdout:55834574857 2023-05-15T16:40:13.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.039+0000 7fbe04ff9640 1 -- 172.21.15.62:0/3965465179 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbe00065540 msgr2=0x7fbe000679f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.039+0000 7fbe04ff9640 1 --2- 172.21.15.62:0/3965465179 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbe00065540 0x7fbe000679f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbe0c0b1000 tx=0x7fbe0c0aa070 comp rx=0 tx=0).stop 2023-05-15T16:40:13.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.039+0000 7fbe04ff9640 1 -- 172.21.15.62:0/3965465179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe1813f7a0 msgr2=0x7fbe181e04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.039+0000 7fbe04ff9640 1 --2- 172.21.15.62:0/3965465179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe1813f7a0 0x7fbe181e04f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbe1000fae0 tx=0x7fbe1000e160 comp rx=0 tx=0).stop 2023-05-15T16:40:13.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.039+0000 7fbe04ff9640 1 -- 172.21.15.62:0/3965465179 shutdown_connections 2023-05-15T16:40:13.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.039+0000 7fbe04ff9640 1 --2- 172.21.15.62:0/3965465179 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbe00065540 0x7fbe000679f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.039+0000 7fbe04ff9640 1 --2- 172.21.15.62:0/3965465179 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbe1813f7a0 0x7fbe181e04f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.039+0000 7fbe04ff9640 1 --2- 172.21.15.62:0/3965465179 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbe180b7f80 0x7fbe1806f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.039+0000 7fbe04ff9640 1 --2- 172.21.15.62:0/3965465179 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbe180b4470 0x7fbe18070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.039+0000 7fbe04ff9640 1 -- 172.21.15.62:0/3965465179 >> 172.21.15.62:0/3965465179 conn(0x7fbe180bc5d0 msgr2=0x7fbe18144070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:13.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.043+0000 7fbe04ff9640 1 -- 172.21.15.62:0/3965465179 shutdown_connections 2023-05-15T16:40:13.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.043+0000 7fbe04ff9640 1 -- 172.21.15.62:0/3965465179 wait complete. 2023-05-15T16:40:13.068 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.1 2023-05-15T16:40:13.069 DEBUG:teuthology.parallel:result is None 2023-05-15T16:40:13.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.083+0000 7fbdaa695640 1 -- 172.21.15.62:0/740373109 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fbd9c0058f0 con 0x7fbd9c0cee10 2023-05-15T16:40:13.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.083+0000 7fbd99ffb640 1 -- 172.21.15.62:0/740373109 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbda40cc8c0 con 0x7fbd9c0cee10 2023-05-15T16:40:13.090 INFO:teuthology.orchestra.run.smithi062.stdout:55834574857 2023-05-15T16:40:13.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.087+0000 7fbdaa695640 1 -- 172.21.15.62:0/740373109 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbd88065380 msgr2=0x7fbd88067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.087+0000 7fbdaa695640 1 --2- 172.21.15.62:0/740373109 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbd88065380 0x7fbd88067830 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbd940ad000 tx=0x7fbd94004740 comp rx=0 tx=0).stop 2023-05-15T16:40:13.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.087+0000 7fbdaa695640 1 -- 172.21.15.62:0/740373109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd9c0cee10 msgr2=0x7fbd9c0c5b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.092 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.087+0000 7fbdaa695640 1 --2- 172.21.15.62:0/740373109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd9c0cee10 0x7fbd9c0c5b50 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbda4078db0 tx=0x7fbda404de90 comp rx=0 tx=0).stop 2023-05-15T16:40:13.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.087+0000 7fbdaa695640 1 -- 172.21.15.62:0/740373109 shutdown_connections 2023-05-15T16:40:13.093 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.087+0000 7fbdaa695640 1 --2- 172.21.15.62:0/740373109 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbd88065380 0x7fbd88067830 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.087+0000 7fbdaa695640 1 --2- 172.21.15.62:0/740373109 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbd9c0cee10 0x7fbd9c0c5b50 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.087+0000 7fbdaa695640 1 --2- 172.21.15.62:0/740373109 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbd9c0091a0 0x7fbd9c0cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.087+0000 7fbdaa695640 1 --2- 172.21.15.62:0/740373109 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbd9c008d50 0x7fbd9c0c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.087+0000 7fbdaa695640 1 -- 172.21.15.62:0/740373109 >> 172.21.15.62:0/740373109 conn(0x7fbd9c0442a0 msgr2=0x7fbd9c03bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:13.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.087+0000 7fbdaa695640 1 -- 172.21.15.62:0/740373109 shutdown_connections 2023-05-15T16:40:13.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.087+0000 7fbdaa695640 1 -- 172.21.15.62:0/740373109 wait complete. 2023-05-15T16:40:13.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.095+0000 7faa404ad640 1 -- 172.21.15.62:0/860930967 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7faa300057a0 con 0x7faa30007480 2023-05-15T16:40:13.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.095+0000 7faa2effd640 1 -- 172.21.15.62:0/860930967 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faa380de0c0 con 0x7faa30007480 2023-05-15T16:40:13.099 INFO:teuthology.orchestra.run.smithi062.stdout:55834574855 2023-05-15T16:40:13.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.095+0000 7faa404ad640 1 -- 172.21.15.62:0/860930967 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7faa1c065380 msgr2=0x7faa1c067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.095+0000 7faa404ad640 1 --2- 172.21.15.62:0/860930967 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7faa1c065380 0x7faa1c067830 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7faa340ae000 tx=0x7faa340a6040 comp rx=0 tx=0).stop 2023-05-15T16:40:13.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.099+0000 7faa404ad640 1 -- 172.21.15.62:0/860930967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa30007480 msgr2=0x7faa30170d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.099+0000 7faa404ad640 1 --2- 172.21.15.62:0/860930967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa30007480 0x7faa30170d20 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faa3804f450 tx=0x7faa38061570 comp rx=0 tx=0).stop 2023-05-15T16:40:13.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.099+0000 7faa404ad640 1 -- 172.21.15.62:0/860930967 shutdown_connections 2023-05-15T16:40:13.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.099+0000 7faa404ad640 1 --2- 172.21.15.62:0/860930967 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7faa300437c0 0x7faa3003a420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.099+0000 7faa404ad640 1 --2- 172.21.15.62:0/860930967 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7faa300ce8b0 0x7faa300d64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.099+0000 7faa404ad640 1 --2- 172.21.15.62:0/860930967 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7faa1c065380 0x7faa1c067830 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.099+0000 7faa404ad640 1 --2- 172.21.15.62:0/860930967 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7faa30007480 0x7faa30170d20 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.099+0000 7faa404ad640 1 -- 172.21.15.62:0/860930967 >> 172.21.15.62:0/860930967 conn(0x7faa30045290 msgr2=0x7faa300cd470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:13.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.099+0000 7faa404ad640 1 -- 172.21.15.62:0/860930967 shutdown_connections 2023-05-15T16:40:13.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.099+0000 7faa404ad640 1 -- 172.21.15.62:0/860930967 wait complete. 2023-05-15T16:40:13.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.111+0000 7f36967fc640 1 -- 172.21.15.62:0/1616448253 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f36840057e0 con 0x7f36a403f7e0 2023-05-15T16:40:13.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.111+0000 7f36a8ff9640 1 -- 172.21.15.62:0/1616448253 <== mon.2 v2:172.21.15.161:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f36ac12c020 con 0x7f36a403f7e0 2023-05-15T16:40:13.117 INFO:teuthology.orchestra.run.smithi062.stdout:55834574856 2023-05-15T16:40:13.119 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-05-15T16:40:13.119 DEBUG:teuthology.parallel:result is None 2023-05-15T16:40:13.120 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2023-05-15T16:40:13.121 DEBUG:teuthology.parallel:result is None 2023-05-15T16:40:13.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.115+0000 7f36967fc640 1 -- 172.21.15.62:0/1616448253 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f36900653d0 msgr2=0x7f3690067880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.115+0000 7f36967fc640 1 --2- 172.21.15.62:0/1616448253 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f36900653d0 0x7f3690067880 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f36a416b130 tx=0x7f3698009040 comp rx=0 tx=0).stop 2023-05-15T16:40:13.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.115+0000 7f36967fc640 1 -- 172.21.15.62:0/1616448253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36a403f7e0 msgr2=0x7f36a4033920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.115+0000 7f36967fc640 1 --2- 172.21.15.62:0/1616448253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36a403f7e0 0x7f36a4033920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f36ac0691a0 tx=0x7f36ac09b6f0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.115+0000 7f36967fc640 1 -- 172.21.15.62:0/1616448253 shutdown_connections 2023-05-15T16:40:13.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.115+0000 7f36967fc640 1 --2- 172.21.15.62:0/1616448253 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f36900653d0 0x7f3690067880 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.115+0000 7f36967fc640 1 --2- 172.21.15.62:0/1616448253 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f36a40d0030 0x7f36a4027950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.115+0000 7f36967fc640 1 --2- 172.21.15.62:0/1616448253 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f36a40cfbe0 0x7f36a4038140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.115+0000 7f36967fc640 1 --2- 172.21.15.62:0/1616448253 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f36a403f7e0 0x7f36a4033920 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f36ac0691a0 tx=0x7f36ac09b6f0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.115+0000 7f36967fc640 1 -- 172.21.15.62:0/1616448253 >> 172.21.15.62:0/1616448253 conn(0x7f36a4043080 msgr2=0x7f36a4031360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:13.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.115+0000 7f36967fc640 1 -- 172.21.15.62:0/1616448253 shutdown_connections 2023-05-15T16:40:13.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.115+0000 7f36967fc640 1 -- 172.21.15.62:0/1616448253 wait complete. 2023-05-15T16:40:13.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.119+0000 7fcbe1238640 1 -- 172.21.15.62:0/3686381329 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcbdc073a90 con 0x7fcbdc14de90 2023-05-15T16:40:13.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.119+0000 7fcbc37fe640 1 -- 172.21.15.62:0/3686381329 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcbcc0eefa0 con 0x7fcbdc14de90 2023-05-15T16:40:13.124 INFO:teuthology.orchestra.run.smithi062.stdout:55834574857 2023-05-15T16:40:13.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7f4a07111640 1 -- 172.21.15.62:0/561255512 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f4a000b93c0 con 0x7f4a000b4310 2023-05-15T16:40:13.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7f49f6ffd640 1 -- 172.21.15.62:0/561255512 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f49fc0ba020 con 0x7f4a000b4310 2023-05-15T16:40:13.126 INFO:teuthology.orchestra.run.smithi062.stdout:55834574856 2023-05-15T16:40:13.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fabfbfff640 1 -- 172.21.15.62:0/3300289772 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fabdc0057e0 con 0x7fabfc143d90 2023-05-15T16:40:13.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fabe3fff640 1 -- 172.21.15.62:0/3300289772 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fabf4057400 con 0x7fabfc143d90 2023-05-15T16:40:13.127 INFO:teuthology.orchestra.run.smithi062.stdout:55834574855 2023-05-15T16:40:13.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fcbe1238640 1 -- 172.21.15.62:0/3686381329 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcbc8065380 msgr2=0x7fcbc8067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fcbe1238640 1 --2- 172.21.15.62:0/3686381329 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcbc8065380 0x7fcbc8067830 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc1ea6c0 tx=0x7fcbd4009040 comp rx=0 tx=0).stop 2023-05-15T16:40:13.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fcbe1238640 1 -- 172.21.15.62:0/3686381329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbdc14de90 msgr2=0x7fcbdc147320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fcbe1238640 1 --2- 172.21.15.62:0/3686381329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbdc14de90 0x7fcbdc147320 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc0ab000 tx=0x7fcbcc019290 comp rx=0 tx=0).stop 2023-05-15T16:40:13.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fcbe1238640 1 -- 172.21.15.62:0/3686381329 shutdown_connections 2023-05-15T16:40:13.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fcbe1238640 1 --2- 172.21.15.62:0/3686381329 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcbc8065380 0x7fcbc8067830 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fcbe1238640 1 --2- 172.21.15.62:0/3686381329 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcbdc14de90 0x7fcbdc147320 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fcbe1238640 1 --2- 172.21.15.62:0/3686381329 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcbdc0b8010 0x7fcbdc146de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fcbe1238640 1 --2- 172.21.15.62:0/3686381329 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcbdc071950 0x7fcbdc1505b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fcbe1238640 1 -- 172.21.15.62:0/3686381329 >> 172.21.15.62:0/3686381329 conn(0x7fcbdc0bc5d0 msgr2=0x7fcbdc0b83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:13.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fcbe1238640 1 -- 172.21.15.62:0/3686381329 shutdown_connections 2023-05-15T16:40:13.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fcbe1238640 1 -- 172.21.15.62:0/3686381329 wait complete. 2023-05-15T16:40:13.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fabfbfff640 1 -- 172.21.15.62:0/3300289772 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fabe8065380 msgr2=0x7fabe8067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fabfbfff640 1 --2- 172.21.15.62:0/3300289772 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fabe8065380 0x7fabe8067830 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fabf0006fd0 tx=0x7fabf0008040 comp rx=0 tx=0).stop 2023-05-15T16:40:13.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fabfbfff640 1 -- 172.21.15.62:0/3300289772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fabfc143d90 msgr2=0x7fabfc1dff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fabfbfff640 1 --2- 172.21.15.62:0/3300289772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fabfc143d90 0x7fabfc1dff60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fabf400e4a0 tx=0x7fabf400e960 comp rx=0 tx=0).stop 2023-05-15T16:40:13.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fabfbfff640 1 -- 172.21.15.62:0/3300289772 shutdown_connections 2023-05-15T16:40:13.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fabfbfff640 1 --2- 172.21.15.62:0/3300289772 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fabe8065380 0x7fabe8067830 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fabfbfff640 1 --2- 172.21.15.62:0/3300289772 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fabfc143d90 0x7fabfc1dff60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fabfbfff640 1 --2- 172.21.15.62:0/3300289772 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fabfc0b90a0 0x7fabfc1dfa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fabfbfff640 1 --2- 172.21.15.62:0/3300289772 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fabfc070e90 0x7fabfc0b6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fabfbfff640 1 -- 172.21.15.62:0/3300289772 >> 172.21.15.62:0/3300289772 conn(0x7fabfc06b550 msgr2=0x7fabfc0bb160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:13.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fabfbfff640 1 -- 172.21.15.62:0/3300289772 shutdown_connections 2023-05-15T16:40:13.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7fabfbfff640 1 -- 172.21.15.62:0/3300289772 wait complete. 2023-05-15T16:40:13.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7f4a07111640 1 -- 172.21.15.62:0/561255512 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f49e4065400 msgr2=0x7f49e40678b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7f4a07111640 1 --2- 172.21.15.62:0/561255512 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f49e4065400 0x7f49e40678b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4a000bd4c0 tx=0x7f49f0007a50 comp rx=0 tx=0).stop 2023-05-15T16:40:13.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7f4a07111640 1 -- 172.21.15.62:0/561255512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a000b4310 msgr2=0x7f4a001e6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7f4a07111640 1 --2- 172.21.15.62:0/561255512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a000b4310 0x7f4a001e6420 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f49fc0190d0 tx=0x7f49fc019260 comp rx=0 tx=0).stop 2023-05-15T16:40:13.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7f4a07111640 1 -- 172.21.15.62:0/561255512 shutdown_connections 2023-05-15T16:40:13.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7f4a07111640 1 --2- 172.21.15.62:0/561255512 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4a000ba730 0x7f4a00135e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7f4a07111640 1 --2- 172.21.15.62:0/561255512 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4a000b8e60 0x7f4a000b6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7f4a07111640 1 --2- 172.21.15.62:0/561255512 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f49e4065400 0x7f49e40678b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7f4a07111640 1 --2- 172.21.15.62:0/561255512 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4a000b4310 0x7f4a001e6420 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.123+0000 7f4a07111640 1 -- 172.21.15.62:0/561255512 >> 172.21.15.62:0/561255512 conn(0x7f4a0006def0 msgr2=0x7f4a0006abc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:13.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.127+0000 7f4a07111640 1 -- 172.21.15.62:0/561255512 shutdown_connections 2023-05-15T16:40:13.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.127+0000 7f4a07111640 1 -- 172.21.15.62:0/561255512 wait complete. 2023-05-15T16:40:13.136 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.131+0000 7f89d108b640 1 -- 172.21.15.62:0/674655046 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f89c40c9360 con 0x7f89c403ec40 2023-05-15T16:40:13.137 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.131+0000 7f89c8ff9640 1 -- 172.21.15.62:0/674655046 <== mon.1 v2:172.21.15.161:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f89c0053e50 con 0x7f89c403ec40 2023-05-15T16:40:13.137 INFO:teuthology.orchestra.run.smithi062.stdout:55834574857 2023-05-15T16:40:13.140 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.135+0000 7f89d108b640 1 -- 172.21.15.62:0/674655046 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f89b0065380 msgr2=0x7f89b0067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.135+0000 7f89d108b640 1 --2- 172.21.15.62:0/674655046 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f89b0065380 0x7f89b0067830 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f89b80b1000 tx=0x7f89b8004740 comp rx=0 tx=0).stop 2023-05-15T16:40:13.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.135+0000 7f89d108b640 1 -- 172.21.15.62:0/674655046 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89c403ec40 msgr2=0x7f89c4157130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.135+0000 7f89d108b640 1 --2- 172.21.15.62:0/674655046 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89c403ec40 0x7f89c4157130 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f89c0001eb0 tx=0x7f89c000c8f0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.135+0000 7f89d108b640 1 -- 172.21.15.62:0/674655046 shutdown_connections 2023-05-15T16:40:13.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.135+0000 7f89d108b640 1 --2- 172.21.15.62:0/674655046 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f89c40cff30 0x7f89c4161c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.135+0000 7f89d108b640 1 --2- 172.21.15.62:0/674655046 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f89b0065380 0x7f89b0067830 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.142 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.135+0000 7f89d108b640 1 --2- 172.21.15.62:0/674655046 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f89c40c6d60 0x7f89c41654b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.135+0000 7f89d108b640 1 --2- 172.21.15.62:0/674655046 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f89c403ec40 0x7f89c4157130 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.135+0000 7f89d108b640 1 -- 172.21.15.62:0/674655046 >> 172.21.15.62:0/674655046 conn(0x7f89c4043a20 msgr2=0x7f89c40cdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:13.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.135+0000 7f89d108b640 1 -- 172.21.15.62:0/674655046 shutdown_connections 2023-05-15T16:40:13.144 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.135+0000 7f89d108b640 1 -- 172.21.15.62:0/674655046 wait complete. 2023-05-15T16:40:13.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.6 2023-05-15T16:40:13.146 DEBUG:teuthology.parallel:result is None 2023-05-15T16:40:13.151 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-05-15T16:40:13.152 DEBUG:teuthology.parallel:result is None 2023-05-15T16:40:13.154 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.2 2023-05-15T16:40:13.155 DEBUG:teuthology.parallel:result is None 2023-05-15T16:40:13.159 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.4 2023-05-15T16:40:13.160 DEBUG:teuthology.parallel:result is None 2023-05-15T16:40:13.165 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.3 2023-05-15T16:40:13.165 DEBUG:teuthology.parallel:result is None 2023-05-15T16:40:13.165 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-05-15T16:40:13.166 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-15T16:40:13.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.307+0000 7f74f063a640 1 Processor -- start 2023-05-15T16:40:13.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.307+0000 7f74f063a640 1 -- start start 2023-05-15T16:40:13.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74f063a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f74e8140d70 0x7f74e81468d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:13.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74f063a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74e80b8e60 0x7f74e814a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:13.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74f063a640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74e8147790 con 0x7f74e81409a0 2023-05-15T16:40:13.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74f063a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74e80ba440 con 0x7f74e8140d70 2023-05-15T16:40:13.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74f063a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e8146ef0 con 0x7f74e80b8e60 2023-05-15T16:40:13.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ee3d6640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f74e81409a0 0x7f74e80b9d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37936/0 (socket says 172.21.15.62:37936) 2023-05-15T16:40:13.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ee3d6640 1 -- 172.21.15.62:0/4130478813 learned_addr learned my addr 172.21.15.62:0/4130478813 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:13.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ed3d4640 1 -- 172.21.15.62:0/4130478813 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3023148983 0 0) 0x7f74e8147790 con 0x7f74e81409a0 2023-05-15T16:40:13.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74edbd5640 1 --2- 172.21.15.62:0/4130478813 >> v2:172.21.15.161:3300/0 conn(0x7f74e8140d70 0x7f74e81468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:13.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74eebd7640 1 --2- 172.21.15.62:0/4130478813 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74e80b8e60 0x7f74e814a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:13.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ed3d4640 1 -- 172.21.15.62:0/4130478813 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74d4003530 con 0x7f74e81409a0 2023-05-15T16:40:13.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ed3d4640 1 -- 172.21.15.62:0/4130478813 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3544290292 0 0) 0x7f74d4003530 con 0x7f74e81409a0 2023-05-15T16:40:13.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ed3d4640 1 -- 172.21.15.62:0/4130478813 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74e80b8e60 msgr2=0x7f74e814a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:13.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ed3d4640 1 --2- 172.21.15.62:0/4130478813 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74e80b8e60 0x7f74e814a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ed3d4640 1 -- 172.21.15.62:0/4130478813 >> v2:172.21.15.161:3300/0 conn(0x7f74e8140d70 msgr2=0x7f74e81468d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:13.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ed3d4640 1 --2- 172.21.15.62:0/4130478813 >> v2:172.21.15.161:3300/0 conn(0x7f74e8140d70 0x7f74e81468d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ed3d4640 1 -- 172.21.15.62:0/4130478813 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e81471d0 con 0x7f74e81409a0 2023-05-15T16:40:13.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ed3d4640 1 -- 172.21.15.62:0/4130478813 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7f74e4001680 con 0x7f74e81409a0 2023-05-15T16:40:13.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ed3d4640 1 -- 172.21.15.62:0/4130478813 >> v1:172.21.15.62:6789/0 conn(0x7f74e81409a0 legacy=0x7f74e80b9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ed3d4640 1 --2- 172.21.15.62:0/4130478813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74d4003980 0x7f74d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:13.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ed3d4640 1 --2- 172.21.15.62:0/4130478813 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74e80b8e60 0x7f74d40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:13.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ed3d4640 1 --2- 172.21.15.62:0/4130478813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74d4004d10 0x7f74d4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:13.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ed3d4640 1 -- 172.21.15.62:0/4130478813 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e80ba440 con 0x7f74d4003980 2023-05-15T16:40:13.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ed3d4640 1 -- 172.21.15.62:0/4130478813 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e8146ef0 con 0x7f74d4004d10 2023-05-15T16:40:13.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ed3d4640 1 -- 172.21.15.62:0/4130478813 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d400dc30 con 0x7f74e80b8e60 2023-05-15T16:40:13.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ee3d6640 1 --2- 172.21.15.62:0/4130478813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74d4003980 0x7f74d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:13.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74edbd5640 1 --2- 172.21.15.62:0/4130478813 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74e80b8e60 0x7f74d40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:13.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ee3d6640 1 -- 172.21.15.62:0/4130478813 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74e80b8e60 msgr2=0x7f74d40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:13.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74eebd7640 1 --2- 172.21.15.62:0/4130478813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74d4004d10 0x7f74d4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:13.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ee3d6640 1 --2- 172.21.15.62:0/4130478813 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74e80b8e60 0x7f74d40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ee3d6640 1 -- 172.21.15.62:0/4130478813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74d4004d10 msgr2=0x7f74d4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:13.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ee3d6640 1 --2- 172.21.15.62:0/4130478813 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74d4004d10 0x7f74d4005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74ee3d6640 1 -- 172.21.15.62:0/4130478813 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d4003530 con 0x7f74d4003980 2023-05-15T16:40:13.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.311+0000 7f74edbd5640 1 --2- 172.21.15.62:0/4130478813 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74e80b8e60 0x7f74d40047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:13.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74ee3d6640 1 --2- 172.21.15.62:0/4130478813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74d4003980 0x7f74d4003d90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f74e400c210 tx=0x7f74e401f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e48090c0d74015aa server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:13.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74ed3d4640 1 -- 172.21.15.62:0/4130478813 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4005ae0 con 0x7f74d4003980 2023-05-15T16:40:13.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74ed3d4640 1 -- 172.21.15.62:0/4130478813 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e40ab070 con 0x7f74d4003980 2023-05-15T16:40:13.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74ed3d4640 1 -- 172.21.15.62:0/4130478813 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e4005ea0 con 0x7f74d4003980 2023-05-15T16:40:13.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74f063a640 1 -- 172.21.15.62:0/4130478813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74d4003980 msgr2=0x7f74d4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74f063a640 1 --2- 172.21.15.62:0/4130478813 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74d4003980 0x7f74d4003d90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f74e400c210 tx=0x7f74e401f3b0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74eebd7640 1 -- 172.21.15.62:0/4130478813 reap_dead start 2023-05-15T16:40:13.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74f063a640 1 -- 172.21.15.62:0/4130478813 shutdown_connections 2023-05-15T16:40:13.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74f063a640 1 -- 172.21.15.62:0/4130478813 >> 172.21.15.62:0/4130478813 conn(0x7f74e80bd830 msgr2=0x7f74e80b9620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:13.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74f063a640 1 -- 172.21.15.62:0/4130478813 shutdown_connections 2023-05-15T16:40:13.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74f063a640 1 -- 172.21.15.62:0/4130478813 wait complete. 2023-05-15T16:40:13.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74f063a640 1 Processor -- start 2023-05-15T16:40:13.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74f063a640 1 -- start start 2023-05-15T16:40:13.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74f063a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74d4003980 0x7f74e813c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:13.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74f063a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74e81ddaa0 0x7f74e8144930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:13.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74f063a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74e80bbcb0 0x7f74e8136e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:13.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74f063a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e813bd50 con 0x7f74e80bbcb0 2023-05-15T16:40:13.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74f063a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74e8144e70 con 0x7f74d4003980 2023-05-15T16:40:13.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74f063a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74e813c300 con 0x7f74e81ddaa0 2023-05-15T16:40:13.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74eebd7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74e80bbcb0 0x7f74e8136e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:13.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74eebd7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74e80bbcb0 0x7f74e8136e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43076/0 (socket says 172.21.15.62:43076) 2023-05-15T16:40:13.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74eebd7640 1 -- 172.21.15.62:0/2109996254 learned_addr learned my addr 172.21.15.62:0/2109996254 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:13.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74ee3d6640 1 --2- 172.21.15.62:0/2109996254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74d4003980 0x7f74e813c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:13.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74edbd5640 1 --2- 172.21.15.62:0/2109996254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74e81ddaa0 0x7f74e8144930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:13.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74eebd7640 1 -- 172.21.15.62:0/2109996254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74e81ddaa0 msgr2=0x7f74e8144930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74eebd7640 1 --2- 172.21.15.62:0/2109996254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74e81ddaa0 0x7f74e8144930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74eebd7640 1 -- 172.21.15.62:0/2109996254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74d4003980 msgr2=0x7f74e813c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74eebd7640 1 --2- 172.21.15.62:0/2109996254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74d4003980 0x7f74e813c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74eebd7640 1 -- 172.21.15.62:0/2109996254 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74e80b92e0 con 0x7f74e80bbcb0 2023-05-15T16:40:13.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.315+0000 7f74eebd7640 1 --2- 172.21.15.62:0/2109996254 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74e80bbcb0 0x7f74e8136e50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f74e8144490 tx=0x7f74e0009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:13.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.319+0000 7f74deffd640 1 -- 172.21.15.62:0/2109996254 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e0014600 con 0x7f74e80bbcb0 2023-05-15T16:40:13.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.319+0000 7f74deffd640 1 -- 172.21.15.62:0/2109996254 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74e0014780 con 0x7f74e80bbcb0 2023-05-15T16:40:13.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.319+0000 7f74f063a640 1 -- 172.21.15.62:0/2109996254 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74e81474b0 con 0x7f74e80bbcb0 2023-05-15T16:40:13.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.319+0000 7f74deffd640 1 -- 172.21.15.62:0/2109996254 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74e0014b30 con 0x7f74e80bbcb0 2023-05-15T16:40:13.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.319+0000 7f74f063a640 1 -- 172.21.15.62:0/2109996254 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74e814a0b0 con 0x7f74e80bbcb0 2023-05-15T16:40:13.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.319+0000 7f74f063a640 1 -- 172.21.15.62:0/2109996254 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74e8067960 con 0x7f74e80bbcb0 2023-05-15T16:40:13.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.319+0000 7f74deffd640 1 -- 172.21.15.62:0/2109996254 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f74e001d3b0 con 0x7f74e80bbcb0 2023-05-15T16:40:13.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.319+0000 7f74deffd640 1 --2- 172.21.15.62:0/2109996254 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f74cc0653b0 0x7f74cc067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:13.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.319+0000 7f74deffd640 1 -- 172.21.15.62:0/2109996254 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f74e0082000 con 0x7f74e80bbcb0 2023-05-15T16:40:13.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.319+0000 7f74ee3d6640 1 --2- 172.21.15.62:0/2109996254 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f74cc0653b0 0x7f74cc067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:13.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.319+0000 7f74ee3d6640 1 --2- 172.21.15.62:0/2109996254 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f74cc0653b0 0x7f74cc067860 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f74e40ae000 tx=0x7f74e4001a10 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:13.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.323+0000 7f74deffd640 1 -- 172.21.15.62:0/2109996254 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f74e004fc20 con 0x7f74e80bbcb0 2023-05-15T16:40:13.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.467+0000 7f74f063a640 1 -- 172.21.15.62:0/2109996254 --> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f74e80b7e90 con 0x7f74cc0653b0 2023-05-15T16:40:13.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.487+0000 7f74deffd640 1 -- 172.21.15.62:0/2109996254 <== mgr.4105 v2:172.21.15.161:6832/37541 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286475 (secure 0 0 0) 0x7f74e80b7e90 con 0x7f74cc0653b0 2023-05-15T16:40:13.494 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:13.495 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-05-15T16:40:13.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.491+0000 7f74f063a640 1 -- 172.21.15.62:0/2109996254 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f74cc0653b0 msgr2=0x7f74cc067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.491+0000 7f74f063a640 1 --2- 172.21.15.62:0/2109996254 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f74cc0653b0 0x7f74cc067860 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f74e40ae000 tx=0x7f74e4001a10 comp rx=0 tx=0).stop 2023-05-15T16:40:13.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.491+0000 7f74f063a640 1 -- 172.21.15.62:0/2109996254 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74e80bbcb0 msgr2=0x7f74e8136e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.491+0000 7f74f063a640 1 --2- 172.21.15.62:0/2109996254 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74e80bbcb0 0x7f74e8136e50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f74e8144490 tx=0x7f74e0009900 comp rx=0 tx=0).stop 2023-05-15T16:40:13.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.491+0000 7f74f063a640 1 -- 172.21.15.62:0/2109996254 shutdown_connections 2023-05-15T16:40:13.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.491+0000 7f74f063a640 1 --2- 172.21.15.62:0/2109996254 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f74cc0653b0 0x7f74cc067860 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.491+0000 7f74f063a640 1 --2- 172.21.15.62:0/2109996254 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f74e80bbcb0 0x7f74e8136e50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.491+0000 7f74f063a640 1 --2- 172.21.15.62:0/2109996254 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f74e81ddaa0 0x7f74e8144930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.491+0000 7f74f063a640 1 --2- 172.21.15.62:0/2109996254 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f74d4003980 0x7f74e813c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.491+0000 7f74f063a640 1 -- 172.21.15.62:0/2109996254 >> 172.21.15.62:0/2109996254 conn(0x7f74e80bd830 msgr2=0x7f74e813fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:13.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.491+0000 7f74f063a640 1 -- 172.21.15.62:0/2109996254 shutdown_connections 2023-05-15T16:40:13.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.491+0000 7f74f063a640 1 -- 172.21.15.62:0/2109996254 wait complete. 2023-05-15T16:40:13.510 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-05-15T16:40:13.320252+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66280,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908440,"statfs":{"total":773094113280,"available":773026242560,"internally_reserved":0,"allocated":3186688,"data_stored":1902188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.224702"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278001+0000","last_change":"2023-05-15T16:40:01.108030+0000","last_active":"2023-05-15T16:40:02.278001+0000","last_peered":"2023-05-15T16:40:02.278001+0000","last_clean":"2023-05-15T16:40:02.278001+0000","last_became_active":"2023-05-15T16:40:01.107701+0000","last_became_peered":"2023-05-15T16:40:01.107701+0000","last_unstale":"2023-05-15T16:40:02.278001+0000","last_undegraded":"2023-05-15T16:40:02.278001+0000","last_fullsized":"2023-05-15T16:40:02.278001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:06.423119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282608+0000","last_change":"2023-05-15T16:40:01.162454+0000","last_active":"2023-05-15T16:40:02.282608+0000","last_peered":"2023-05-15T16:40:02.282608+0000","last_clean":"2023-05-15T16:40:02.282608+0000","last_became_active":"2023-05-15T16:40:01.161325+0000","last_became_peered":"2023-05-15T16:40:01.161325+0000","last_unstale":"2023-05-15T16:40:02.282608+0000","last_undegraded":"2023-05-15T16:40:02.282608+0000","last_fullsized":"2023-05-15T16:40:02.282608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:13:33.110131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100574+0000","last_change":"2023-05-15T16:40:01.140999+0000","last_active":"2023-05-15T16:40:02.100574+0000","last_peered":"2023-05-15T16:40:02.100574+0000","last_clean":"2023-05-15T16:40:02.100574+0000","last_became_active":"2023-05-15T16:40:01.138081+0000","last_became_peered":"2023-05-15T16:40:01.138081+0000","last_unstale":"2023-05-15T16:40:02.100574+0000","last_undegraded":"2023-05-15T16:40:02.100574+0000","last_fullsized":"2023-05-15T16:40:02.100574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:43:45.244861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280478+0000","last_change":"2023-05-15T16:40:01.125926+0000","last_active":"2023-05-15T16:40:02.280478+0000","last_peered":"2023-05-15T16:40:02.280478+0000","last_clean":"2023-05-15T16:40:02.280478+0000","last_became_active":"2023-05-15T16:40:01.121506+0000","last_became_peered":"2023-05-15T16:40:01.121506+0000","last_unstale":"2023-05-15T16:40:02.280478+0000","last_undegraded":"2023-05-15T16:40:02.280478+0000","last_fullsized":"2023-05-15T16:40:02.280478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:56:14.814256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097671+0000","last_change":"2023-05-15T16:40:01.113655+0000","last_active":"2023-05-15T16:40:02.097671+0000","last_peered":"2023-05-15T16:40:02.097671+0000","last_clean":"2023-05-15T16:40:02.097671+0000","last_became_active":"2023-05-15T16:40:01.113359+0000","last_became_peered":"2023-05-15T16:40:01.113359+0000","last_unstale":"2023-05-15T16:40:02.097671+0000","last_undegraded":"2023-05-15T16:40:02.097671+0000","last_fullsized":"2023-05-15T16:40:02.097671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099373+0000","last_change":"2023-05-15T16:40:01.138514+0000","last_active":"2023-05-15T16:40:02.099373+0000","last_peered":"2023-05-15T16:40:02.099373+0000","last_clean":"2023-05-15T16:40:02.099373+0000","last_became_active":"2023-05-15T16:40:01.137610+0000","last_became_peered":"2023-05-15T16:40:01.137610+0000","last_unstale":"2023-05-15T16:40:02.099373+0000","last_undegraded":"2023-05-15T16:40:02.099373+0000","last_fullsized":"2023-05-15T16:40:02.099373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:41:16.912612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280784+0000","last_change":"2023-05-15T16:40:01.149263+0000","last_active":"2023-05-15T16:40:02.280784+0000","last_peered":"2023-05-15T16:40:02.280784+0000","last_clean":"2023-05-15T16:40:02.280784+0000","last_became_active":"2023-05-15T16:40:01.148591+0000","last_became_peered":"2023-05-15T16:40:01.148591+0000","last_unstale":"2023-05-15T16:40:02.280784+0000","last_undegraded":"2023-05-15T16:40:02.280784+0000","last_fullsized":"2023-05-15T16:40:02.280784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:13:33.110131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282009+0000","last_change":"2023-05-15T16:40:01.160969+0000","last_active":"2023-05-15T16:40:02.282009+0000","last_peered":"2023-05-15T16:40:02.282009+0000","last_clean":"2023-05-15T16:40:02.282009+0000","last_became_active":"2023-05-15T16:40:01.160118+0000","last_became_peered":"2023-05-15T16:40:01.160118+0000","last_unstale":"2023-05-15T16:40:02.282009+0000","last_undegraded":"2023-05-15T16:40:02.282009+0000","last_fullsized":"2023-05-15T16:40:02.282009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098107+0000","last_change":"2023-05-15T16:40:01.114095+0000","last_active":"2023-05-15T16:40:02.098107+0000","last_peered":"2023-05-15T16:40:02.098107+0000","last_clean":"2023-05-15T16:40:02.098107+0000","last_became_active":"2023-05-15T16:40:01.113367+0000","last_became_peered":"2023-05-15T16:40:01.113367+0000","last_unstale":"2023-05-15T16:40:02.098107+0000","last_undegraded":"2023-05-15T16:40:02.098107+0000","last_fullsized":"2023-05-15T16:40:02.098107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:22:08.631817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282722+0000","last_change":"2023-05-15T16:40:01.161203+0000","last_active":"2023-05-15T16:40:02.282722+0000","last_peered":"2023-05-15T16:40:02.282722+0000","last_clean":"2023-05-15T16:40:02.282722+0000","last_became_active":"2023-05-15T16:40:01.160163+0000","last_became_peered":"2023-05-15T16:40:01.160163+0000","last_unstale":"2023-05-15T16:40:02.282722+0000","last_undegraded":"2023-05-15T16:40:02.282722+0000","last_fullsized":"2023-05-15T16:40:02.282722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:31:14.621756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100644+0000","last_change":"2023-05-15T16:40:01.140439+0000","last_active":"2023-05-15T16:40:02.100644+0000","last_peered":"2023-05-15T16:40:02.100644+0000","last_clean":"2023-05-15T16:40:02.100644+0000","last_became_active":"2023-05-15T16:40:01.136958+0000","last_became_peered":"2023-05-15T16:40:01.136958+0000","last_unstale":"2023-05-15T16:40:02.100644+0000","last_undegraded":"2023-05-15T16:40:02.100644+0000","last_fullsized":"2023-05-15T16:40:02.100644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:48:42.521388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278138+0000","last_change":"2023-05-15T16:40:01.140940+0000","last_active":"2023-05-15T16:40:02.278138+0000","last_peered":"2023-05-15T16:40:02.278138+0000","last_clean":"2023-05-15T16:40:02.278138+0000","last_became_active":"2023-05-15T16:40:01.140666+0000","last_became_peered":"2023-05-15T16:40:01.140666+0000","last_unstale":"2023-05-15T16:40:02.278138+0000","last_undegraded":"2023-05-15T16:40:02.278138+0000","last_fullsized":"2023-05-15T16:40:02.278138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:56:14.814256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278109+0000","last_change":"2023-05-15T16:40:01.104796+0000","last_active":"2023-05-15T16:40:02.278109+0000","last_peered":"2023-05-15T16:40:02.278109+0000","last_clean":"2023-05-15T16:40:02.278109+0000","last_became_active":"2023-05-15T16:40:01.104505+0000","last_became_peered":"2023-05-15T16:40:01.104505+0000","last_unstale":"2023-05-15T16:40:02.278109+0000","last_undegraded":"2023-05-15T16:40:02.278109+0000","last_fullsized":"2023-05-15T16:40:02.278109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:34.510844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.283018+0000","last_change":"2023-05-15T16:40:01.146028+0000","last_active":"2023-05-15T16:40:02.283018+0000","last_peered":"2023-05-15T16:40:02.283018+0000","last_clean":"2023-05-15T16:40:02.283018+0000","last_became_active":"2023-05-15T16:40:01.145321+0000","last_became_peered":"2023-05-15T16:40:01.145321+0000","last_unstale":"2023-05-15T16:40:02.283018+0000","last_undegraded":"2023-05-15T16:40:02.283018+0000","last_fullsized":"2023-05-15T16:40:02.283018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:02:23.376990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281189+0000","last_change":"2023-05-15T16:40:01.157628+0000","last_active":"2023-05-15T16:40:02.281189+0000","last_peered":"2023-05-15T16:40:02.281189+0000","last_clean":"2023-05-15T16:40:02.281189+0000","last_became_active":"2023-05-15T16:40:01.157096+0000","last_became_peered":"2023-05-15T16:40:01.157096+0000","last_unstale":"2023-05-15T16:40:02.281189+0000","last_undegraded":"2023-05-15T16:40:02.281189+0000","last_fullsized":"2023-05-15T16:40:02.281189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098971+0000","last_change":"2023-05-15T16:40:01.136171+0000","last_active":"2023-05-15T16:40:02.098971+0000","last_peered":"2023-05-15T16:40:02.098971+0000","last_clean":"2023-05-15T16:40:02.098971+0000","last_became_active":"2023-05-15T16:40:01.135400+0000","last_became_peered":"2023-05-15T16:40:01.135400+0000","last_unstale":"2023-05-15T16:40:02.098971+0000","last_undegraded":"2023-05-15T16:40:02.098971+0000","last_fullsized":"2023-05-15T16:40:02.098971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:15:00.512988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098127+0000","last_change":"2023-05-15T16:40:01.113893+0000","last_active":"2023-05-15T16:40:02.098127+0000","last_peered":"2023-05-15T16:40:02.098127+0000","last_clean":"2023-05-15T16:40:02.098127+0000","last_became_active":"2023-05-15T16:40:01.113415+0000","last_became_peered":"2023-05-15T16:40:01.113415+0000","last_unstale":"2023-05-15T16:40:02.098127+0000","last_undegraded":"2023-05-15T16:40:02.098127+0000","last_fullsized":"2023-05-15T16:40:02.098127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100417+0000","last_change":"2023-05-15T16:40:01.139891+0000","last_active":"2023-05-15T16:40:02.100417+0000","last_peered":"2023-05-15T16:40:02.100417+0000","last_clean":"2023-05-15T16:40:02.100417+0000","last_became_active":"2023-05-15T16:40:01.138421+0000","last_became_peered":"2023-05-15T16:40:01.138421+0000","last_unstale":"2023-05-15T16:40:02.100417+0000","last_undegraded":"2023-05-15T16:40:02.100417+0000","last_fullsized":"2023-05-15T16:40:02.100417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T03:57:26.700942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278992+0000","last_change":"2023-05-15T16:40:01.129321+0000","last_active":"2023-05-15T16:40:02.278992+0000","last_peered":"2023-05-15T16:40:02.278992+0000","last_clean":"2023-05-15T16:40:02.278992+0000","last_became_active":"2023-05-15T16:40:01.129026+0000","last_became_peered":"2023-05-15T16:40:01.129026+0000","last_unstale":"2023-05-15T16:40:02.278992+0000","last_undegraded":"2023-05-15T16:40:02.278992+0000","last_fullsized":"2023-05-15T16:40:02.278992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:51:42.949566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100354+0000","last_change":"2023-05-15T16:40:01.141251+0000","last_active":"2023-05-15T16:40:02.100354+0000","last_peered":"2023-05-15T16:40:02.100354+0000","last_clean":"2023-05-15T16:40:02.100354+0000","last_became_active":"2023-05-15T16:40:01.140102+0000","last_became_peered":"2023-05-15T16:40:01.140102+0000","last_unstale":"2023-05-15T16:40:02.100354+0000","last_undegraded":"2023-05-15T16:40:02.100354+0000","last_fullsized":"2023-05-15T16:40:02.100354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:14:42.054526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281668+0000","last_change":"2023-05-15T16:40:01.157690+0000","last_active":"2023-05-15T16:40:02.281668+0000","last_peered":"2023-05-15T16:40:02.281668+0000","last_clean":"2023-05-15T16:40:02.281668+0000","last_became_active":"2023-05-15T16:40:01.157028+0000","last_became_peered":"2023-05-15T16:40:01.157028+0000","last_unstale":"2023-05-15T16:40:02.281668+0000","last_undegraded":"2023-05-15T16:40:02.281668+0000","last_fullsized":"2023-05-15T16:40:02.281668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097365+0000","last_change":"2023-05-15T16:40:01.111473+0000","last_active":"2023-05-15T16:40:02.097365+0000","last_peered":"2023-05-15T16:40:02.097365+0000","last_clean":"2023-05-15T16:40:02.097365+0000","last_became_active":"2023-05-15T16:40:01.109519+0000","last_became_peered":"2023-05-15T16:40:01.109519+0000","last_unstale":"2023-05-15T16:40:02.097365+0000","last_undegraded":"2023-05-15T16:40:02.097365+0000","last_fullsized":"2023-05-15T16:40:02.097365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:39:15.813849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095154+0000","last_change":"2023-05-15T16:40:01.109311+0000","last_active":"2023-05-15T16:40:02.095154+0000","last_peered":"2023-05-15T16:40:02.095154+0000","last_clean":"2023-05-15T16:40:02.095154+0000","last_became_active":"2023-05-15T16:40:01.109001+0000","last_became_peered":"2023-05-15T16:40:01.109001+0000","last_unstale":"2023-05-15T16:40:02.095154+0000","last_undegraded":"2023-05-15T16:40:02.095154+0000","last_fullsized":"2023-05-15T16:40:02.095154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:22:08.631817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280862+0000","last_change":"2023-05-15T16:40:01.151544+0000","last_active":"2023-05-15T16:40:02.280862+0000","last_peered":"2023-05-15T16:40:02.280862+0000","last_clean":"2023-05-15T16:40:02.280862+0000","last_became_active":"2023-05-15T16:40:01.150292+0000","last_became_peered":"2023-05-15T16:40:01.150292+0000","last_unstale":"2023-05-15T16:40:02.280862+0000","last_undegraded":"2023-05-15T16:40:02.280862+0000","last_fullsized":"2023-05-15T16:40:02.280862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279251+0000","last_change":"2023-05-15T16:40:01.119067+0000","last_active":"2023-05-15T16:40:02.279251+0000","last_peered":"2023-05-15T16:40:02.279251+0000","last_clean":"2023-05-15T16:40:02.279251+0000","last_became_active":"2023-05-15T16:40:01.118808+0000","last_became_peered":"2023-05-15T16:40:01.118808+0000","last_unstale":"2023-05-15T16:40:02.279251+0000","last_undegraded":"2023-05-15T16:40:02.279251+0000","last_fullsized":"2023-05-15T16:40:02.279251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:02:23.376990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279750+0000","last_change":"2023-05-15T16:40:01.108611+0000","last_active":"2023-05-15T16:40:02.279750+0000","last_peered":"2023-05-15T16:40:02.279750+0000","last_clean":"2023-05-15T16:40:02.279750+0000","last_became_active":"2023-05-15T16:40:01.107595+0000","last_became_peered":"2023-05-15T16:40:01.107595+0000","last_unstale":"2023-05-15T16:40:02.279750+0000","last_undegraded":"2023-05-15T16:40:02.279750+0000","last_fullsized":"2023-05-15T16:40:02.279750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:45:33.580738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282768+0000","last_change":"2023-05-15T16:40:01.161786+0000","last_active":"2023-05-15T16:40:02.282768+0000","last_peered":"2023-05-15T16:40:02.282768+0000","last_clean":"2023-05-15T16:40:02.282768+0000","last_became_active":"2023-05-15T16:40:01.160406+0000","last_became_peered":"2023-05-15T16:40:01.160406+0000","last_unstale":"2023-05-15T16:40:02.282768+0000","last_undegraded":"2023-05-15T16:40:02.282768+0000","last_fullsized":"2023-05-15T16:40:02.282768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279900+0000","last_change":"2023-05-15T16:40:01.147235+0000","last_active":"2023-05-15T16:40:02.279900+0000","last_peered":"2023-05-15T16:40:02.279900+0000","last_clean":"2023-05-15T16:40:02.279900+0000","last_became_active":"2023-05-15T16:40:01.146964+0000","last_became_peered":"2023-05-15T16:40:01.146964+0000","last_unstale":"2023-05-15T16:40:02.279900+0000","last_undegraded":"2023-05-15T16:40:02.279900+0000","last_fullsized":"2023-05-15T16:40:02.279900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:07:25.649507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095330+0000","last_change":"2023-05-15T16:40:01.125493+0000","last_active":"2023-05-15T16:40:02.095330+0000","last_peered":"2023-05-15T16:40:02.095330+0000","last_clean":"2023-05-15T16:40:02.095330+0000","last_became_active":"2023-05-15T16:40:01.125172+0000","last_became_peered":"2023-05-15T16:40:01.125172+0000","last_unstale":"2023-05-15T16:40:02.095330+0000","last_undegraded":"2023-05-15T16:40:02.095330+0000","last_fullsized":"2023-05-15T16:40:02.095330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099957+0000","last_change":"2023-05-15T16:40:01.138349+0000","last_active":"2023-05-15T16:40:02.099957+0000","last_peered":"2023-05-15T16:40:02.099957+0000","last_clean":"2023-05-15T16:40:02.099957+0000","last_became_active":"2023-05-15T16:40:01.137255+0000","last_became_peered":"2023-05-15T16:40:01.137255+0000","last_unstale":"2023-05-15T16:40:02.099957+0000","last_undegraded":"2023-05-15T16:40:02.099957+0000","last_fullsized":"2023-05-15T16:40:02.099957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:22:31.889776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095427+0000","last_change":"2023-05-15T16:40:01.105121+0000","last_active":"2023-05-15T16:40:02.095427+0000","last_peered":"2023-05-15T16:40:02.095427+0000","last_clean":"2023-05-15T16:40:02.095427+0000","last_became_active":"2023-05-15T16:40:01.104061+0000","last_became_peered":"2023-05-15T16:40:01.104061+0000","last_unstale":"2023-05-15T16:40:02.095427+0000","last_undegraded":"2023-05-15T16:40:02.095427+0000","last_fullsized":"2023-05-15T16:40:02.095427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279918+0000","last_change":"2023-05-15T16:40:01.132449+0000","last_active":"2023-05-15T16:40:02.279918+0000","last_peered":"2023-05-15T16:40:02.279918+0000","last_clean":"2023-05-15T16:40:02.279918+0000","last_became_active":"2023-05-15T16:40:01.131460+0000","last_became_peered":"2023-05-15T16:40:01.131460+0000","last_unstale":"2023-05-15T16:40:02.279918+0000","last_undegraded":"2023-05-15T16:40:02.279918+0000","last_fullsized":"2023-05-15T16:40:02.279918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:19:49.435267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.096152+0000","last_change":"2023-05-15T16:40:01.109245+0000","last_active":"2023-05-15T16:40:02.096152+0000","last_peered":"2023-05-15T16:40:02.096152+0000","last_clean":"2023-05-15T16:40:02.096152+0000","last_became_active":"2023-05-15T16:40:01.108858+0000","last_became_peered":"2023-05-15T16:40:01.108858+0000","last_unstale":"2023-05-15T16:40:02.096152+0000","last_undegraded":"2023-05-15T16:40:02.096152+0000","last_fullsized":"2023-05-15T16:40:02.096152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:45:33.580738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281902+0000","last_change":"2023-05-15T16:40:00.763235+0000","last_active":"2023-05-15T16:40:02.281902+0000","last_peered":"2023-05-15T16:40:02.281902+0000","last_clean":"2023-05-15T16:40:02.281902+0000","last_became_active":"2023-05-15T16:40:00.762235+0000","last_became_peered":"2023-05-15T16:40:00.762235+0000","last_unstale":"2023-05-15T16:40:02.281902+0000","last_undegraded":"2023-05-15T16:40:02.281902+0000","last_fullsized":"2023-05-15T16:40:02.281902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:51:11.783628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282911+0000","last_change":"2023-05-15T16:40:01.160372+0000","last_active":"2023-05-15T16:40:02.282911+0000","last_peered":"2023-05-15T16:40:02.282911+0000","last_clean":"2023-05-15T16:40:02.282911+0000","last_became_active":"2023-05-15T16:40:01.159573+0000","last_became_peered":"2023-05-15T16:40:01.159573+0000","last_unstale":"2023-05-15T16:40:02.282911+0000","last_undegraded":"2023-05-15T16:40:02.282911+0000","last_fullsized":"2023-05-15T16:40:02.282911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097310+0000","last_change":"2023-05-15T16:40:00.739620+0000","last_active":"2023-05-15T16:40:02.097310+0000","last_peered":"2023-05-15T16:40:02.097310+0000","last_clean":"2023-05-15T16:40:02.097310+0000","last_became_active":"2023-05-15T16:40:00.739275+0000","last_became_peered":"2023-05-15T16:40:00.739275+0000","last_unstale":"2023-05-15T16:40:02.097310+0000","last_undegraded":"2023-05-15T16:40:02.097310+0000","last_fullsized":"2023-05-15T16:40:02.097310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:05.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098022+0000","last_change":"2023-05-15T16:40:01.113172+0000","last_active":"2023-05-15T16:40:02.098022+0000","last_peered":"2023-05-15T16:40:02.098022+0000","last_clean":"2023-05-15T16:40:02.098022+0000","last_became_active":"2023-05-15T16:40:01.112870+0000","last_became_peered":"2023-05-15T16:40:01.112870+0000","last_unstale":"2023-05-15T16:40:02.098022+0000","last_undegraded":"2023-05-15T16:40:02.098022+0000","last_fullsized":"2023-05-15T16:40:02.098022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281420+0000","last_change":"2023-05-15T16:40:00.762606+0000","last_active":"2023-05-15T16:40:02.281420+0000","last_peered":"2023-05-15T16:40:02.281420+0000","last_clean":"2023-05-15T16:40:02.281420+0000","last_became_active":"2023-05-15T16:40:00.761988+0000","last_became_peered":"2023-05-15T16:40:00.761988+0000","last_unstale":"2023-05-15T16:40:02.281420+0000","last_undegraded":"2023-05-15T16:40:02.281420+0000","last_fullsized":"2023-05-15T16:40:02.281420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:45:32.571235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095959+0000","last_change":"2023-05-15T16:40:01.147086+0000","last_active":"2023-05-15T16:40:02.095959+0000","last_peered":"2023-05-15T16:40:02.095959+0000","last_clean":"2023-05-15T16:40:02.095959+0000","last_became_active":"2023-05-15T16:40:01.146808+0000","last_became_peered":"2023-05-15T16:40:01.146808+0000","last_unstale":"2023-05-15T16:40:02.095959+0000","last_undegraded":"2023-05-15T16:40:02.095959+0000","last_fullsized":"2023-05-15T16:40:02.095959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280054+0000","last_change":"2023-05-15T16:40:00.730676+0000","last_active":"2023-05-15T16:40:02.280054+0000","last_peered":"2023-05-15T16:40:02.280054+0000","last_clean":"2023-05-15T16:40:02.280054+0000","last_became_active":"2023-05-15T16:40:00.729878+0000","last_became_peered":"2023-05-15T16:40:00.729878+0000","last_unstale":"2023-05-15T16:40:02.280054+0000","last_undegraded":"2023-05-15T16:40:02.280054+0000","last_fullsized":"2023-05-15T16:40:02.280054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:11:08.088281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282241+0000","last_change":"2023-05-15T16:40:00.758036+0000","last_active":"2023-05-15T16:40:02.282241+0000","last_peered":"2023-05-15T16:40:02.282241+0000","last_clean":"2023-05-15T16:40:02.282241+0000","last_became_active":"2023-05-15T16:40:00.757440+0000","last_became_peered":"2023-05-15T16:40:00.757440+0000","last_unstale":"2023-05-15T16:40:02.282241+0000","last_undegraded":"2023-05-15T16:40:02.282241+0000","last_fullsized":"2023-05-15T16:40:02.282241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:39:14.804346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282268+0000","last_change":"2023-05-15T16:40:01.160001+0000","last_active":"2023-05-15T16:40:02.282268+0000","last_peered":"2023-05-15T16:40:02.282268+0000","last_clean":"2023-05-15T16:40:02.282268+0000","last_became_active":"2023-05-15T16:40:01.159447+0000","last_became_peered":"2023-05-15T16:40:01.159447+0000","last_unstale":"2023-05-15T16:40:02.282268+0000","last_undegraded":"2023-05-15T16:40:02.282268+0000","last_fullsized":"2023-05-15T16:40:02.282268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:26:45.774263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282224+0000","last_change":"2023-05-15T16:40:00.762701+0000","last_active":"2023-05-15T16:40:02.282224+0000","last_peered":"2023-05-15T16:40:02.282224+0000","last_clean":"2023-05-15T16:40:02.282224+0000","last_became_active":"2023-05-15T16:40:00.762050+0000","last_became_peered":"2023-05-15T16:40:00.762050+0000","last_unstale":"2023-05-15T16:40:02.282224+0000","last_undegraded":"2023-05-15T16:40:02.282224+0000","last_fullsized":"2023-05-15T16:40:02.282224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:00:39.077549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099635+0000","last_change":"2023-05-15T16:40:01.141928+0000","last_active":"2023-05-15T16:40:02.099635+0000","last_peered":"2023-05-15T16:40:02.099635+0000","last_clean":"2023-05-15T16:40:02.099635+0000","last_became_active":"2023-05-15T16:40:01.135581+0000","last_became_peered":"2023-05-15T16:40:01.135581+0000","last_unstale":"2023-05-15T16:40:02.099635+0000","last_undegraded":"2023-05-15T16:40:02.099635+0000","last_fullsized":"2023-05-15T16:40:02.099635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:50:32.789209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281732+0000","last_change":"2023-05-15T16:40:00.760061+0000","last_active":"2023-05-15T16:40:02.281732+0000","last_peered":"2023-05-15T16:40:02.281732+0000","last_clean":"2023-05-15T16:40:02.281732+0000","last_became_active":"2023-05-15T16:40:00.759394+0000","last_became_peered":"2023-05-15T16:40:00.759394+0000","last_unstale":"2023-05-15T16:40:02.281732+0000","last_undegraded":"2023-05-15T16:40:02.281732+0000","last_fullsized":"2023-05-15T16:40:02.281732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:51:42.381804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280016+0000","last_change":"2023-05-15T16:40:01.124789+0000","last_active":"2023-05-15T16:40:02.280016+0000","last_peered":"2023-05-15T16:40:02.280016+0000","last_clean":"2023-05-15T16:40:02.280016+0000","last_became_active":"2023-05-15T16:40:01.123158+0000","last_became_peered":"2023-05-15T16:40:01.123158+0000","last_unstale":"2023-05-15T16:40:02.280016+0000","last_undegraded":"2023-05-15T16:40:02.280016+0000","last_fullsized":"2023-05-15T16:40:02.280016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:00:40.087052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282519+0000","last_change":"2023-05-15T16:40:00.754578+0000","last_active":"2023-05-15T16:40:02.282519+0000","last_peered":"2023-05-15T16:40:02.282519+0000","last_clean":"2023-05-15T16:40:02.282519+0000","last_became_active":"2023-05-15T16:40:00.753829+0000","last_became_peered":"2023-05-15T16:40:00.753829+0000","last_unstale":"2023-05-15T16:40:02.282519+0000","last_undegraded":"2023-05-15T16:40:02.282519+0000","last_fullsized":"2023-05-15T16:40:02.282519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097589+0000","last_change":"2023-05-15T16:40:01.111444+0000","last_active":"2023-05-15T16:40:02.097589+0000","last_peered":"2023-05-15T16:40:02.097589+0000","last_clean":"2023-05-15T16:40:02.097589+0000","last_became_active":"2023-05-15T16:40:01.108848+0000","last_became_peered":"2023-05-15T16:40:01.108848+0000","last_unstale":"2023-05-15T16:40:02.097589+0000","last_undegraded":"2023-05-15T16:40:02.097589+0000","last_fullsized":"2023-05-15T16:40:02.097589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:26:45.774263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095431+0000","last_change":"2023-05-15T16:40:00.740949+0000","last_active":"2023-05-15T16:40:02.095431+0000","last_peered":"2023-05-15T16:40:02.095431+0000","last_clean":"2023-05-15T16:40:02.095431+0000","last_became_active":"2023-05-15T16:40:00.739009+0000","last_became_peered":"2023-05-15T16:40:00.739009+0000","last_unstale":"2023-05-15T16:40:02.095431+0000","last_undegraded":"2023-05-15T16:40:02.095431+0000","last_fullsized":"2023-05-15T16:40:02.095431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:14:54.500421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100640+0000","last_change":"2023-05-15T16:40:01.140770+0000","last_active":"2023-05-15T16:40:02.100640+0000","last_peered":"2023-05-15T16:40:02.100640+0000","last_clean":"2023-05-15T16:40:02.100640+0000","last_became_active":"2023-05-15T16:40:01.138754+0000","last_became_peered":"2023-05-15T16:40:01.138754+0000","last_unstale":"2023-05-15T16:40:02.100640+0000","last_undegraded":"2023-05-15T16:40:02.100640+0000","last_fullsized":"2023-05-15T16:40:02.100640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:02:15.760757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280274+0000","last_change":"2023-05-15T16:40:00.749907+0000","last_active":"2023-05-15T16:40:02.280274+0000","last_peered":"2023-05-15T16:40:02.280274+0000","last_clean":"2023-05-15T16:40:02.280274+0000","last_became_active":"2023-05-15T16:40:00.749282+0000","last_became_peered":"2023-05-15T16:40:00.749282+0000","last_unstale":"2023-05-15T16:40:02.280274+0000","last_undegraded":"2023-05-15T16:40:02.280274+0000","last_fullsized":"2023-05-15T16:40:02.280274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:14:54.500421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100813+0000","last_change":"2023-05-15T16:40:01.139858+0000","last_active":"2023-05-15T16:40:02.100813+0000","last_peered":"2023-05-15T16:40:02.100813+0000","last_clean":"2023-05-15T16:40:02.100813+0000","last_became_active":"2023-05-15T16:40:01.136069+0000","last_became_peered":"2023-05-15T16:40:01.136069+0000","last_unstale":"2023-05-15T16:40:02.100813+0000","last_undegraded":"2023-05-15T16:40:02.100813+0000","last_fullsized":"2023-05-15T16:40:02.100813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:05:11.188290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099660+0000","last_change":"2023-05-15T16:40:00.749474+0000","last_active":"2023-05-15T16:40:02.099660+0000","last_peered":"2023-05-15T16:40:02.099660+0000","last_clean":"2023-05-15T16:40:02.099660+0000","last_became_active":"2023-05-15T16:40:00.748842+0000","last_became_peered":"2023-05-15T16:40:00.748842+0000","last_unstale":"2023-05-15T16:40:02.099660+0000","last_undegraded":"2023-05-15T16:40:02.099660+0000","last_fullsized":"2023-05-15T16:40:02.099660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:56:52.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100423+0000","last_change":"2023-05-15T16:40:01.138792+0000","last_active":"2023-05-15T16:40:02.100423+0000","last_peered":"2023-05-15T16:40:02.100423+0000","last_clean":"2023-05-15T16:40:02.100423+0000","last_became_active":"2023-05-15T16:40:01.137792+0000","last_became_peered":"2023-05-15T16:40:01.137792+0000","last_unstale":"2023-05-15T16:40:02.100423+0000","last_undegraded":"2023-05-15T16:40:02.100423+0000","last_fullsized":"2023-05-15T16:40:02.100423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095575+0000","last_change":"2023-05-15T16:40:00.735846+0000","last_active":"2023-05-15T16:40:02.095575+0000","last_peered":"2023-05-15T16:40:02.095575+0000","last_clean":"2023-05-15T16:40:02.095575+0000","last_became_active":"2023-05-15T16:40:00.734223+0000","last_became_peered":"2023-05-15T16:40:00.734223+0000","last_unstale":"2023-05-15T16:40:02.095575+0000","last_undegraded":"2023-05-15T16:40:02.095575+0000","last_fullsized":"2023-05-15T16:40:02.095575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:05.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279676+0000","last_change":"2023-05-15T16:40:01.106280+0000","last_active":"2023-05-15T16:40:02.279676+0000","last_peered":"2023-05-15T16:40:02.279676+0000","last_clean":"2023-05-15T16:40:02.279676+0000","last_became_active":"2023-05-15T16:40:01.105962+0000","last_became_peered":"2023-05-15T16:40:01.105962+0000","last_unstale":"2023-05-15T16:40:02.279676+0000","last_undegraded":"2023-05-15T16:40:02.279676+0000","last_fullsized":"2023-05-15T16:40:02.279676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:24:01.307491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.125777+0000","last_change":"2023-05-15T16:39:50.637320+0000","last_active":"2023-05-15T16:40:01.125777+0000","last_peered":"2023-05-15T16:40:01.125777+0000","last_clean":"2023-05-15T16:40:01.125777+0000","last_became_active":"2023-05-15T16:39:50.636541+0000","last_became_peered":"2023-05-15T16:39:50.636541+0000","last_unstale":"2023-05-15T16:40:01.125777+0000","last_undegraded":"2023-05-15T16:40:01.125777+0000","last_fullsized":"2023-05-15T16:40:01.125777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:49.601783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:49.601783+0000","last_clean_scrub_stamp":"2023-05-15T16:39:49.601783+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:18:01.941203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.156165+0000","last_change":"2023-05-15T16:39:56.699270+0000","last_active":"2023-05-15T16:40:01.156165+0000","last_peered":"2023-05-15T16:40:01.156165+0000","last_clean":"2023-05-15T16:40:01.156165+0000","last_became_active":"2023-05-15T16:39:56.698429+0000","last_became_peered":"2023-05-15T16:39:56.698429+0000","last_unstale":"2023-05-15T16:40:01.156165+0000","last_undegraded":"2023-05-15T16:40:01.156165+0000","last_fullsized":"2023-05-15T16:40:01.156165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:31.428692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095161+0000","last_change":"2023-05-15T16:40:00.753212+0000","last_active":"2023-05-15T16:40:02.095161+0000","last_peered":"2023-05-15T16:40:02.095161+0000","last_clean":"2023-05-15T16:40:02.095161+0000","last_became_active":"2023-05-15T16:40:00.752900+0000","last_became_peered":"2023-05-15T16:40:00.752900+0000","last_unstale":"2023-05-15T16:40:02.095161+0000","last_undegraded":"2023-05-15T16:40:02.095161+0000","last_fullsized":"2023-05-15T16:40:02.095161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:30:28.823039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280571+0000","last_change":"2023-05-15T16:40:01.148321+0000","last_active":"2023-05-15T16:40:02.280571+0000","last_peered":"2023-05-15T16:40:02.280571+0000","last_clean":"2023-05-15T16:40:02.280571+0000","last_became_active":"2023-05-15T16:40:01.147687+0000","last_became_peered":"2023-05-15T16:40:01.147687+0000","last_unstale":"2023-05-15T16:40:02.280571+0000","last_undegraded":"2023-05-15T16:40:02.280571+0000","last_fullsized":"2023-05-15T16:40:02.280571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:51:43.391307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.125606+0000","last_change":"2023-05-15T16:39:56.700800+0000","last_active":"2023-05-15T16:40:01.125606+0000","last_peered":"2023-05-15T16:40:01.125606+0000","last_clean":"2023-05-15T16:40:01.125606+0000","last_became_active":"2023-05-15T16:39:56.700022+0000","last_became_peered":"2023-05-15T16:39:56.700022+0000","last_unstale":"2023-05-15T16:40:01.125606+0000","last_undegraded":"2023-05-15T16:40:01.125606+0000","last_fullsized":"2023-05-15T16:40:01.125606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:11:54.752932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097131+0000","last_change":"2023-05-15T16:40:00.762802+0000","last_active":"2023-05-15T16:40:02.097131+0000","last_peered":"2023-05-15T16:40:02.097131+0000","last_clean":"2023-05-15T16:40:02.097131+0000","last_became_active":"2023-05-15T16:40:00.762564+0000","last_became_peered":"2023-05-15T16:40:00.762564+0000","last_unstale":"2023-05-15T16:40:02.097131+0000","last_undegraded":"2023-05-15T16:40:02.097131+0000","last_fullsized":"2023-05-15T16:40:02.097131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:21:29.173379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097918+0000","last_change":"2023-05-15T16:40:01.111468+0000","last_active":"2023-05-15T16:40:02.097918+0000","last_peered":"2023-05-15T16:40:02.097918+0000","last_clean":"2023-05-15T16:40:02.097918+0000","last_became_active":"2023-05-15T16:40:01.108705+0000","last_became_peered":"2023-05-15T16:40:01.108705+0000","last_unstale":"2023-05-15T16:40:02.097918+0000","last_undegraded":"2023-05-15T16:40:02.097918+0000","last_fullsized":"2023-05-15T16:40:02.097918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:24:01.307491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.091019+0000","last_change":"2023-05-15T16:39:57.018815+0000","last_active":"2023-05-15T16:40:01.091019+0000","last_peered":"2023-05-15T16:40:01.091019+0000","last_clean":"2023-05-15T16:40:01.091019+0000","last_became_active":"2023-05-15T16:39:57.018404+0000","last_became_peered":"2023-05-15T16:39:57.018404+0000","last_unstale":"2023-05-15T16:40:01.091019+0000","last_undegraded":"2023-05-15T16:40:01.091019+0000","last_fullsized":"2023-05-15T16:40:01.091019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278644+0000","last_change":"2023-05-15T16:40:00.732605+0000","last_active":"2023-05-15T16:40:02.278644+0000","last_peered":"2023-05-15T16:40:02.278644+0000","last_clean":"2023-05-15T16:40:02.278644+0000","last_became_active":"2023-05-15T16:40:00.731996+0000","last_became_peered":"2023-05-15T16:40:00.731996+0000","last_unstale":"2023-05-15T16:40:02.278644+0000","last_undegraded":"2023-05-15T16:40:02.278644+0000","last_fullsized":"2023-05-15T16:40:02.278644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:30:28.823039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280039+0000","last_change":"2023-05-15T16:40:01.158076+0000","last_active":"2023-05-15T16:40:02.280039+0000","last_peered":"2023-05-15T16:40:02.280039+0000","last_clean":"2023-05-15T16:40:02.280039+0000","last_became_active":"2023-05-15T16:40:01.157836+0000","last_became_peered":"2023-05-15T16:40:01.157836+0000","last_unstale":"2023-05-15T16:40:02.280039+0000","last_undegraded":"2023-05-15T16:40:02.280039+0000","last_fullsized":"2023-05-15T16:40:02.280039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:26:45.774263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.156363+0000","last_change":"2023-05-15T16:39:56.701269+0000","last_active":"2023-05-15T16:40:01.156363+0000","last_peered":"2023-05-15T16:40:01.156363+0000","last_clean":"2023-05-15T16:40:01.156363+0000","last_became_active":"2023-05-15T16:39:56.700221+0000","last_became_peered":"2023-05-15T16:39:56.700221+0000","last_unstale":"2023-05-15T16:40:01.156363+0000","last_undegraded":"2023-05-15T16:40:01.156363+0000","last_fullsized":"2023-05-15T16:40:01.156363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099905+0000","last_change":"2023-05-15T16:40:00.749117+0000","last_active":"2023-05-15T16:40:02.099905+0000","last_peered":"2023-05-15T16:40:02.099905+0000","last_clean":"2023-05-15T16:40:02.099905+0000","last_became_active":"2023-05-15T16:40:00.748493+0000","last_became_peered":"2023-05-15T16:40:00.748493+0000","last_unstale":"2023-05-15T16:40:02.099905+0000","last_undegraded":"2023-05-15T16:40:02.099905+0000","last_fullsized":"2023-05-15T16:40:02.099905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279394+0000","last_change":"2023-05-15T16:40:01.108032+0000","last_active":"2023-05-15T16:40:02.279394+0000","last_peered":"2023-05-15T16:40:02.279394+0000","last_clean":"2023-05-15T16:40:02.279394+0000","last_became_active":"2023-05-15T16:40:01.107664+0000","last_became_peered":"2023-05-15T16:40:01.107664+0000","last_unstale":"2023-05-15T16:40:02.279394+0000","last_undegraded":"2023-05-15T16:40:02.279394+0000","last_fullsized":"2023-05-15T16:40:02.279394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:31:14.621756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.283078+0000","last_change":"2023-05-15T16:40:00.756830+0000","last_active":"2023-05-15T16:40:02.283078+0000","last_peered":"2023-05-15T16:40:02.283078+0000","last_clean":"2023-05-15T16:40:02.283078+0000","last_became_active":"2023-05-15T16:40:00.755791+0000","last_became_peered":"2023-05-15T16:40:00.755791+0000","last_unstale":"2023-05-15T16:40:02.283078+0000","last_undegraded":"2023-05-15T16:40:02.283078+0000","last_fullsized":"2023-05-15T16:40:02.283078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:21:29.173379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.101846+0000","last_change":"2023-05-15T16:39:56.692931+0000","last_active":"2023-05-15T16:40:01.101846+0000","last_peered":"2023-05-15T16:40:01.101846+0000","last_clean":"2023-05-15T16:40:01.101846+0000","last_became_active":"2023-05-15T16:39:56.692557+0000","last_became_peered":"2023-05-15T16:39:56.692557+0000","last_unstale":"2023-05-15T16:40:01.101846+0000","last_undegraded":"2023-05-15T16:40:01.101846+0000","last_fullsized":"2023-05-15T16:40:01.101846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279898+0000","last_change":"2023-05-15T16:40:01.143115+0000","last_active":"2023-05-15T16:40:02.279898+0000","last_peered":"2023-05-15T16:40:02.279898+0000","last_clean":"2023-05-15T16:40:02.279898+0000","last_became_active":"2023-05-15T16:40:01.142777+0000","last_became_peered":"2023-05-15T16:40:01.142777+0000","last_unstale":"2023-05-15T16:40:02.279898+0000","last_undegraded":"2023-05-15T16:40:02.279898+0000","last_fullsized":"2023-05-15T16:40:02.279898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279615+0000","last_change":"2023-05-15T16:40:00.732385+0000","last_active":"2023-05-15T16:40:02.279615+0000","last_peered":"2023-05-15T16:40:02.279615+0000","last_clean":"2023-05-15T16:40:02.279615+0000","last_became_active":"2023-05-15T16:40:00.731887+0000","last_became_peered":"2023-05-15T16:40:00.731887+0000","last_unstale":"2023-05-15T16:40:02.279615+0000","last_undegraded":"2023-05-15T16:40:02.279615+0000","last_fullsized":"2023-05-15T16:40:02.279615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.129045+0000","last_change":"2023-05-15T16:39:56.698079+0000","last_active":"2023-05-15T16:40:01.129045+0000","last_peered":"2023-05-15T16:40:01.129045+0000","last_clean":"2023-05-15T16:40:01.129045+0000","last_became_active":"2023-05-15T16:39:56.697298+0000","last_became_peered":"2023-05-15T16:39:56.697298+0000","last_unstale":"2023-05-15T16:40:01.129045+0000","last_undegraded":"2023-05-15T16:40:01.129045+0000","last_fullsized":"2023-05-15T16:40:01.129045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:32:01.734351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097558+0000","last_change":"2023-05-15T16:40:01.144386+0000","last_active":"2023-05-15T16:40:02.097558+0000","last_peered":"2023-05-15T16:40:02.097558+0000","last_clean":"2023-05-15T16:40:02.097558+0000","last_became_active":"2023-05-15T16:40:01.144046+0000","last_became_peered":"2023-05-15T16:40:01.144046+0000","last_unstale":"2023-05-15T16:40:02.097558+0000","last_undegraded":"2023-05-15T16:40:02.097558+0000","last_fullsized":"2023-05-15T16:40:02.097558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:50:32.789209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.096140+0000","last_change":"2023-05-15T16:40:00.740983+0000","last_active":"2023-05-15T16:40:02.096140+0000","last_peered":"2023-05-15T16:40:02.096140+0000","last_clean":"2023-05-15T16:40:02.096140+0000","last_became_active":"2023-05-15T16:40:00.739828+0000","last_became_peered":"2023-05-15T16:40:00.739828+0000","last_unstale":"2023-05-15T16:40:02.096140+0000","last_undegraded":"2023-05-15T16:40:02.096140+0000","last_fullsized":"2023-05-15T16:40:02.096140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.101796+0000","last_change":"2023-05-15T16:39:56.694298+0000","last_active":"2023-05-15T16:40:01.101796+0000","last_peered":"2023-05-15T16:40:01.101796+0000","last_clean":"2023-05-15T16:40:01.101796+0000","last_became_active":"2023-05-15T16:39:56.693723+0000","last_became_peered":"2023-05-15T16:39:56.693723+0000","last_unstale":"2023-05-15T16:40:01.101796+0000","last_undegraded":"2023-05-15T16:40:01.101796+0000","last_fullsized":"2023-05-15T16:40:01.101796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:31.428692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095317+0000","last_change":"2023-05-15T16:40:01.125833+0000","last_active":"2023-05-15T16:40:02.095317+0000","last_peered":"2023-05-15T16:40:02.095317+0000","last_clean":"2023-05-15T16:40:02.095317+0000","last_became_active":"2023-05-15T16:40:01.125641+0000","last_became_peered":"2023-05-15T16:40:01.125641+0000","last_unstale":"2023-05-15T16:40:02.095317+0000","last_undegraded":"2023-05-15T16:40:02.095317+0000","last_fullsized":"2023-05-15T16:40:02.095317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:48:42.521388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098109+0000","last_change":"2023-05-15T16:40:00.729163+0000","last_active":"2023-05-15T16:40:02.098109+0000","last_peered":"2023-05-15T16:40:02.098109+0000","last_clean":"2023-05-15T16:40:02.098109+0000","last_became_active":"2023-05-15T16:40:00.725627+0000","last_became_peered":"2023-05-15T16:40:00.725627+0000","last_unstale":"2023-05-15T16:40:02.098109+0000","last_undegraded":"2023-05-15T16:40:02.098109+0000","last_fullsized":"2023-05-15T16:40:02.098109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.115241+0000","last_change":"2023-05-15T16:39:56.697003+0000","last_active":"2023-05-15T16:40:01.115241+0000","last_peered":"2023-05-15T16:40:01.115241+0000","last_clean":"2023-05-15T16:40:01.115241+0000","last_became_active":"2023-05-15T16:39:56.696210+0000","last_became_peered":"2023-05-15T16:39:56.696210+0000","last_unstale":"2023-05-15T16:40:01.115241+0000","last_undegraded":"2023-05-15T16:40:01.115241+0000","last_fullsized":"2023-05-15T16:40:01.115241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:29:27.454964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099418+0000","last_change":"2023-05-15T16:40:01.146590+0000","last_active":"2023-05-15T16:40:02.099418+0000","last_peered":"2023-05-15T16:40:02.099418+0000","last_clean":"2023-05-15T16:40:02.099418+0000","last_became_active":"2023-05-15T16:40:01.145902+0000","last_became_peered":"2023-05-15T16:40:01.145902+0000","last_unstale":"2023-05-15T16:40:02.099418+0000","last_undegraded":"2023-05-15T16:40:02.099418+0000","last_fullsized":"2023-05-15T16:40:02.099418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:26:42.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099663+0000","last_change":"2023-05-15T16:40:01.137328+0000","last_active":"2023-05-15T16:40:02.099663+0000","last_peered":"2023-05-15T16:40:02.099663+0000","last_clean":"2023-05-15T16:40:02.099663+0000","last_became_active":"2023-05-15T16:40:01.135859+0000","last_became_peered":"2023-05-15T16:40:01.135859+0000","last_unstale":"2023-05-15T16:40:02.099663+0000","last_undegraded":"2023-05-15T16:40:02.099663+0000","last_fullsized":"2023-05-15T16:40:02.099663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:22:08.631817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100701+0000","last_change":"2023-05-15T16:40:00.741443+0000","last_active":"2023-05-15T16:40:02.100701+0000","last_peered":"2023-05-15T16:40:02.100701+0000","last_clean":"2023-05-15T16:40:02.100701+0000","last_became_active":"2023-05-15T16:40:00.737218+0000","last_became_peered":"2023-05-15T16:40:00.737218+0000","last_unstale":"2023-05-15T16:40:02.100701+0000","last_undegraded":"2023-05-15T16:40:02.100701+0000","last_fullsized":"2023-05-15T16:40:02.100701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:05.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279727+0000","last_change":"2023-05-15T16:40:01.119384+0000","last_active":"2023-05-15T16:40:02.279727+0000","last_peered":"2023-05-15T16:40:02.279727+0000","last_clean":"2023-05-15T16:40:02.279727+0000","last_became_active":"2023-05-15T16:40:01.119075+0000","last_became_peered":"2023-05-15T16:40:01.119075+0000","last_unstale":"2023-05-15T16:40:02.279727+0000","last_undegraded":"2023-05-15T16:40:02.279727+0000","last_fullsized":"2023-05-15T16:40:02.279727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:29:25.132530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281736+0000","last_change":"2023-05-15T16:40:00.744828+0000","last_active":"2023-05-15T16:40:02.281736+0000","last_peered":"2023-05-15T16:40:02.281736+0000","last_clean":"2023-05-15T16:40:02.281736+0000","last_became_active":"2023-05-15T16:40:00.744103+0000","last_became_peered":"2023-05-15T16:40:00.744103+0000","last_unstale":"2023-05-15T16:40:02.281736+0000","last_undegraded":"2023-05-15T16:40:02.281736+0000","last_fullsized":"2023-05-15T16:40:02.281736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:19:48.425765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282856+0000","last_change":"2023-05-15T16:40:00.754697+0000","last_active":"2023-05-15T16:40:02.282856+0000","last_peered":"2023-05-15T16:40:02.282856+0000","last_clean":"2023-05-15T16:40:02.282856+0000","last_became_active":"2023-05-15T16:40:00.754117+0000","last_became_peered":"2023-05-15T16:40:00.754117+0000","last_unstale":"2023-05-15T16:40:02.282856+0000","last_undegraded":"2023-05-15T16:40:02.282856+0000","last_fullsized":"2023-05-15T16:40:02.282856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:05.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095638+0000","last_change":"2023-05-15T16:40:01.148027+0000","last_active":"2023-05-15T16:40:02.095638+0000","last_peered":"2023-05-15T16:40:02.095638+0000","last_clean":"2023-05-15T16:40:02.095638+0000","last_became_active":"2023-05-15T16:40:01.147699+0000","last_became_peered":"2023-05-15T16:40:01.147699+0000","last_unstale":"2023-05-15T16:40:02.095638+0000","last_undegraded":"2023-05-15T16:40:02.095638+0000","last_fullsized":"2023-05-15T16:40:02.095638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:50:32.789209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098446+0000","last_change":"2023-05-15T16:40:00.753008+0000","last_active":"2023-05-15T16:40:02.098446+0000","last_peered":"2023-05-15T16:40:02.098446+0000","last_clean":"2023-05-15T16:40:02.098446+0000","last_became_active":"2023-05-15T16:40:00.752696+0000","last_became_peered":"2023-05-15T16:40:00.752696+0000","last_unstale":"2023-05-15T16:40:02.098446+0000","last_undegraded":"2023-05-15T16:40:02.098446+0000","last_fullsized":"2023-05-15T16:40:02.098446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:30:28.823039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095101+0000","last_change":"2023-05-15T16:40:01.102001+0000","last_active":"2023-05-15T16:40:02.095101+0000","last_peered":"2023-05-15T16:40:02.095101+0000","last_clean":"2023-05-15T16:40:02.095101+0000","last_became_active":"2023-05-15T16:40:01.101708+0000","last_became_peered":"2023-05-15T16:40:01.101708+0000","last_unstale":"2023-05-15T16:40:02.095101+0000","last_undegraded":"2023-05-15T16:40:02.095101+0000","last_fullsized":"2023-05-15T16:40:02.095101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:13:33.110131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280831+0000","last_change":"2023-05-15T16:40:01.161461+0000","last_active":"2023-05-15T16:40:02.280831+0000","last_peered":"2023-05-15T16:40:02.280831+0000","last_clean":"2023-05-15T16:40:02.280831+0000","last_became_active":"2023-05-15T16:40:01.160945+0000","last_became_peered":"2023-05-15T16:40:01.160945+0000","last_unstale":"2023-05-15T16:40:02.280831+0000","last_undegraded":"2023-05-15T16:40:02.280831+0000","last_fullsized":"2023-05-15T16:40:02.280831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:39:15.813849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095333+0000","last_change":"2023-05-15T16:40:00.740953+0000","last_active":"2023-05-15T16:40:02.095333+0000","last_peered":"2023-05-15T16:40:02.095333+0000","last_clean":"2023-05-15T16:40:02.095333+0000","last_became_active":"2023-05-15T16:40:00.739500+0000","last_became_peered":"2023-05-15T16:40:00.739500+0000","last_unstale":"2023-05-15T16:40:02.095333+0000","last_undegraded":"2023-05-15T16:40:02.095333+0000","last_fullsized":"2023-05-15T16:40:02.095333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:56:52.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097941+0000","last_change":"2023-05-15T16:40:01.147295+0000","last_active":"2023-05-15T16:40:02.097941+0000","last_peered":"2023-05-15T16:40:02.097941+0000","last_clean":"2023-05-15T16:40:02.097941+0000","last_became_active":"2023-05-15T16:40:01.146994+0000","last_became_peered":"2023-05-15T16:40:01.146994+0000","last_unstale":"2023-05-15T16:40:02.097941+0000","last_undegraded":"2023-05-15T16:40:02.097941+0000","last_fullsized":"2023-05-15T16:40:02.097941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:13:33.110131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279178+0000","last_change":"2023-05-15T16:40:00.733783+0000","last_active":"2023-05-15T16:40:02.279178+0000","last_peered":"2023-05-15T16:40:02.279178+0000","last_clean":"2023-05-15T16:40:02.279178+0000","last_became_active":"2023-05-15T16:40:00.733442+0000","last_became_peered":"2023-05-15T16:40:00.733442+0000","last_unstale":"2023-05-15T16:40:02.279178+0000","last_undegraded":"2023-05-15T16:40:02.279178+0000","last_fullsized":"2023-05-15T16:40:02.279178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:56:52.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095487+0000","last_change":"2023-05-15T16:40:01.108561+0000","last_active":"2023-05-15T16:40:02.095487+0000","last_peered":"2023-05-15T16:40:02.095487+0000","last_clean":"2023-05-15T16:40:02.095487+0000","last_became_active":"2023-05-15T16:40:01.108286+0000","last_became_peered":"2023-05-15T16:40:01.108286+0000","last_unstale":"2023-05-15T16:40:02.095487+0000","last_undegraded":"2023-05-15T16:40:02.095487+0000","last_fullsized":"2023-05-15T16:40:02.095487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:07:25.649507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099944+0000","last_change":"2023-05-15T16:40:00.748959+0000","last_active":"2023-05-15T16:40:02.099944+0000","last_peered":"2023-05-15T16:40:02.099944+0000","last_clean":"2023-05-15T16:40:02.099944+0000","last_became_active":"2023-05-15T16:40:00.744181+0000","last_became_peered":"2023-05-15T16:40:00.744181+0000","last_unstale":"2023-05-15T16:40:02.099944+0000","last_undegraded":"2023-05-15T16:40:02.099944+0000","last_fullsized":"2023-05-15T16:40:02.099944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:30:28.823039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278386+0000","last_change":"2023-05-15T16:40:01.111006+0000","last_active":"2023-05-15T16:40:02.278386+0000","last_peered":"2023-05-15T16:40:02.278386+0000","last_clean":"2023-05-15T16:40:02.278386+0000","last_became_active":"2023-05-15T16:40:01.110731+0000","last_became_peered":"2023-05-15T16:40:01.110731+0000","last_unstale":"2023-05-15T16:40:02.278386+0000","last_undegraded":"2023-05-15T16:40:02.278386+0000","last_fullsized":"2023-05-15T16:40:02.278386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:21:30.182882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097788+0000","last_change":"2023-05-15T16:40:00.760933+0000","last_active":"2023-05-15T16:40:02.097788+0000","last_peered":"2023-05-15T16:40:02.097788+0000","last_clean":"2023-05-15T16:40:02.097788+0000","last_became_active":"2023-05-15T16:40:00.760570+0000","last_became_peered":"2023-05-15T16:40:00.760570+0000","last_unstale":"2023-05-15T16:40:02.097788+0000","last_undegraded":"2023-05-15T16:40:02.097788+0000","last_fullsized":"2023-05-15T16:40:02.097788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:51:41.940063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099449+0000","last_change":"2023-05-15T16:40:01.137937+0000","last_active":"2023-05-15T16:40:02.099449+0000","last_peered":"2023-05-15T16:40:02.099449+0000","last_clean":"2023-05-15T16:40:02.099449+0000","last_became_active":"2023-05-15T16:40:01.136661+0000","last_became_peered":"2023-05-15T16:40:01.136661+0000","last_unstale":"2023-05-15T16:40:02.099449+0000","last_undegraded":"2023-05-15T16:40:02.099449+0000","last_fullsized":"2023-05-15T16:40:02.099449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:45:23.112789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282296+0000","last_change":"2023-05-15T16:40:00.765428+0000","last_active":"2023-05-15T16:40:02.282296+0000","last_peered":"2023-05-15T16:40:02.282296+0000","last_clean":"2023-05-15T16:40:02.282296+0000","last_became_active":"2023-05-15T16:40:00.764846+0000","last_became_peered":"2023-05-15T16:40:00.764846+0000","last_unstale":"2023-05-15T16:40:02.282296+0000","last_undegraded":"2023-05-15T16:40:02.282296+0000","last_fullsized":"2023-05-15T16:40:02.282296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:56:13.804754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099659+0000","last_change":"2023-05-15T16:40:01.138011+0000","last_active":"2023-05-15T16:40:02.099659+0000","last_peered":"2023-05-15T16:40:02.099659+0000","last_clean":"2023-05-15T16:40:02.099659+0000","last_became_active":"2023-05-15T16:40:01.136847+0000","last_became_peered":"2023-05-15T16:40:01.136847+0000","last_unstale":"2023-05-15T16:40:02.099659+0000","last_undegraded":"2023-05-15T16:40:02.099659+0000","last_fullsized":"2023-05-15T16:40:02.099659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:14:14.713803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282986+0000","last_change":"2023-05-15T16:40:00.765361+0000","last_active":"2023-05-15T16:40:02.282986+0000","last_peered":"2023-05-15T16:40:02.282986+0000","last_clean":"2023-05-15T16:40:02.282986+0000","last_became_active":"2023-05-15T16:40:00.764881+0000","last_became_peered":"2023-05-15T16:40:00.764881+0000","last_unstale":"2023-05-15T16:40:02.282986+0000","last_undegraded":"2023-05-15T16:40:02.282986+0000","last_fullsized":"2023-05-15T16:40:02.282986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:51:41.940063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095732+0000","last_change":"2023-05-15T16:40:01.102202+0000","last_active":"2023-05-15T16:40:02.095732+0000","last_peered":"2023-05-15T16:40:02.095732+0000","last_clean":"2023-05-15T16:40:02.095732+0000","last_became_active":"2023-05-15T16:40:01.101916+0000","last_became_peered":"2023-05-15T16:40:01.101916+0000","last_unstale":"2023-05-15T16:40:02.095732+0000","last_undegraded":"2023-05-15T16:40:02.095732+0000","last_fullsized":"2023-05-15T16:40:02.095732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:26:45.774263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095575+0000","last_change":"2023-05-15T16:40:00.736792+0000","last_active":"2023-05-15T16:40:02.095575+0000","last_peered":"2023-05-15T16:40:02.095575+0000","last_clean":"2023-05-15T16:40:02.095575+0000","last_became_active":"2023-05-15T16:40:00.736507+0000","last_became_peered":"2023-05-15T16:40:00.736507+0000","last_unstale":"2023-05-15T16:40:02.095575+0000","last_undegraded":"2023-05-15T16:40:02.095575+0000","last_fullsized":"2023-05-15T16:40:02.095575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:21:29.173379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099100+0000","last_change":"2023-05-15T16:40:01.134199+0000","last_active":"2023-05-15T16:40:02.099100+0000","last_peered":"2023-05-15T16:40:02.099100+0000","last_clean":"2023-05-15T16:40:02.099100+0000","last_became_active":"2023-05-15T16:40:01.133481+0000","last_became_peered":"2023-05-15T16:40:01.133481+0000","last_unstale":"2023-05-15T16:40:02.099100+0000","last_undegraded":"2023-05-15T16:40:02.099100+0000","last_fullsized":"2023-05-15T16:40:02.099100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098440+0000","last_change":"2023-05-15T16:40:00.753734+0000","last_active":"2023-05-15T16:40:02.098440+0000","last_peered":"2023-05-15T16:40:02.098440+0000","last_clean":"2023-05-15T16:40:02.098440+0000","last_became_active":"2023-05-15T16:40:00.753401+0000","last_became_peered":"2023-05-15T16:40:00.753401+0000","last_unstale":"2023-05-15T16:40:02.098440+0000","last_undegraded":"2023-05-15T16:40:02.098440+0000","last_fullsized":"2023-05-15T16:40:02.098440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:56:52.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9108,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362732,"statfs":{"total":96636764160,"available":96627437568,"internally_reserved":0,"allocated":864256,"data_stored":681731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":90235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":91203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8056,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363784,"statfs":{"total":96636764160,"available":96628514816,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7924,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363916,"statfs":{"total":96636764160,"available":96628649984,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8052,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363788,"statfs":{"total":96636764160,"available":96628518912,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9084,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362756,"statfs":{"total":96636764160,"available":96627462144,"internally_reserved":0,"allocated":839680,"data_stored":680533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-15T16:40:13.517 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-15T16:40:13.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.667+0000 7f3f5f4d5640 1 Processor -- start 2023-05-15T16:40:13.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.667+0000 7f3f5f4d5640 1 -- start start 2023-05-15T16:40:13.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.667+0000 7f3f5f4d5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3f580b8780 0x7f3f580b2ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:13.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.667+0000 7f3f5f4d5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f580b3a10 0x7f3f580b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:13.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.667+0000 7f3f5f4d5640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f580b3400 con 0x7f3f58146e60 2023-05-15T16:40:13.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.667+0000 7f3f5f4d5640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f580b5450 con 0x7f3f580b8780 2023-05-15T16:40:13.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.667+0000 7f3f5f4d5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f580b5ae0 con 0x7f3f580b3a10 2023-05-15T16:40:13.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.667+0000 7f3f5d271640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3f580b8780 0x7f3f580b2ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:13.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.667+0000 7f3f5d271640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3f580b8780 0x7f3f580b2ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43088/0 (socket says 172.21.15.62:43088) 2023-05-15T16:40:13.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.667+0000 7f3f5d271640 1 -- 172.21.15.62:0/4142992749 learned_addr learned my addr 172.21.15.62:0/4142992749 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:13.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.667+0000 7f3f5da72640 1 --1- 172.21.15.62:0/4142992749 >> v1:172.21.15.62:6789/0 conn(0x7f3f58146e60 0x7f3f580b6440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37946/0 (socket says 172.21.15.62:37946) 2023-05-15T16:40:13.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.667+0000 7f3f5d271640 1 -- 172.21.15.62:0/4142992749 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f580b3a10 msgr2=0x7f3f580b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:13.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.667+0000 7f3f5ca70640 1 --2- 172.21.15.62:0/4142992749 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f580b3a10 0x7f3f580b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:13.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.667+0000 7f3f5d271640 1 --2- 172.21.15.62:0/4142992749 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f580b3a10 0x7f3f580b3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.667+0000 7f3f4ffff640 1 -- 172.21.15.62:0/4142992749 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4249692652 0 0) 0x7f3f580b3400 con 0x7f3f58146e60 2023-05-15T16:40:13.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.667+0000 7f3f5d271640 1 -- 172.21.15.62:0/4142992749 >> v1:172.21.15.62:6789/0 conn(0x7f3f58146e60 legacy=0x7f3f580b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.667+0000 7f3f5d271640 1 -- 172.21.15.62:0/4142992749 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f580b5dc0 con 0x7f3f580b8780 2023-05-15T16:40:13.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.667+0000 7f3f5d271640 1 --2- 172.21.15.62:0/4142992749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f580b8780 0x7f3f580b2ec0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009870 tx=0x7f3f4801ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55a1c5d208ff0323 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:13.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.667+0000 7f3f4ffff640 1 -- 172.21.15.62:0/4142992749 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f480a8a30 con 0x7f3f580b8780 2023-05-15T16:40:13.674 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.667+0000 7f3f4ffff640 1 -- 172.21.15.62:0/4142992749 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f480a8b90 con 0x7f3f580b8780 2023-05-15T16:40:13.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.667+0000 7f3f4ffff640 1 -- 172.21.15.62:0/4142992749 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f480b0440 con 0x7f3f580b8780 2023-05-15T16:40:13.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5f4d5640 1 -- 172.21.15.62:0/4142992749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f580b8780 msgr2=0x7f3f580b2ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5f4d5640 1 --2- 172.21.15.62:0/4142992749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f580b8780 0x7f3f580b2ec0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009870 tx=0x7f3f4801ed30 comp rx=0 tx=0).stop 2023-05-15T16:40:13.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5f4d5640 1 -- 172.21.15.62:0/4142992749 shutdown_connections 2023-05-15T16:40:13.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5f4d5640 1 --2- 172.21.15.62:0/4142992749 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f580b3a10 0x7f3f580b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.675 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5f4d5640 1 --2- 172.21.15.62:0/4142992749 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f580b8780 0x7f3f580b2ec0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5f4d5640 1 -- 172.21.15.62:0/4142992749 >> 172.21.15.62:0/4142992749 conn(0x7f3f580653f0 msgr2=0x7f3f580697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:13.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5f4d5640 1 -- 172.21.15.62:0/4142992749 shutdown_connections 2023-05-15T16:40:13.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5f4d5640 1 -- 172.21.15.62:0/4142992749 wait complete. 2023-05-15T16:40:13.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5f4d5640 1 Processor -- start 2023-05-15T16:40:13.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5f4d5640 1 -- start start 2023-05-15T16:40:13.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5f4d5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f580b3a10 0x7f3f580bb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:13.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5f4d5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f580b8780 0x7f3f580af9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:13.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5f4d5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f58146e60 0x7f3f580adba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:13.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5f4d5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f580ae0e0 con 0x7f3f580b3a10 2023-05-15T16:40:13.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5f4d5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5814a560 con 0x7f3f580b8780 2023-05-15T16:40:13.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5f4d5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f580b2910 con 0x7f3f58146e60 2023-05-15T16:40:13.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5d271640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f580b3a10 0x7f3f580bb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:13.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5d271640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f580b3a10 0x7f3f580bb050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43098/0 (socket says 172.21.15.62:43098) 2023-05-15T16:40:13.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5d271640 1 -- 172.21.15.62:0/4016108546 learned_addr learned my addr 172.21.15.62:0/4016108546 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:13.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5da72640 1 --2- 172.21.15.62:0/4016108546 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f58146e60 0x7f3f580adba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:13.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5d271640 1 -- 172.21.15.62:0/4016108546 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f58146e60 msgr2=0x7f3f580adba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5d271640 1 --2- 172.21.15.62:0/4016108546 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f58146e60 0x7f3f580adba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5ca70640 1 --2- 172.21.15.62:0/4016108546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f580b8780 0x7f3f580af9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:13.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5d271640 1 -- 172.21.15.62:0/4016108546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f580b8780 msgr2=0x7f3f580af9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5d271640 1 --2- 172.21.15.62:0/4016108546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f580b8780 0x7f3f580af9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5d271640 1 -- 172.21.15.62:0/4016108546 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f480094d0 con 0x7f3f580b3a10 2023-05-15T16:40:13.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5d271640 1 --2- 172.21.15.62:0/4016108546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f580b3a10 0x7f3f580bb050 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009960 tx=0x7f3f4801d570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:13.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f4dffb640 1 -- 172.21.15.62:0/4016108546 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f480a8a30 con 0x7f3f580b3a10 2023-05-15T16:40:13.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f4dffb640 1 -- 172.21.15.62:0/4016108546 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f48004020 con 0x7f3f580b3a10 2023-05-15T16:40:13.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5f4d5640 1 -- 172.21.15.62:0/4016108546 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f58071ab0 con 0x7f3f580b3a10 2023-05-15T16:40:13.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f4dffb640 1 -- 172.21.15.62:0/4016108546 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f48004390 con 0x7f3f580b3a10 2023-05-15T16:40:13.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5f4d5640 1 -- 172.21.15.62:0/4016108546 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f580717d0 con 0x7f3f580b3a10 2023-05-15T16:40:13.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.671+0000 7f3f5f4d5640 1 -- 172.21.15.62:0/4016108546 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f58067960 con 0x7f3f580b3a10 2023-05-15T16:40:13.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.675+0000 7f3f4dffb640 1 -- 172.21.15.62:0/4016108546 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f3f480b7040 con 0x7f3f580b3a10 2023-05-15T16:40:13.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.675+0000 7f3f4dffb640 1 --2- 172.21.15.62:0/4016108546 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3f3c0653b0 0x7f3f3c067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:13.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.675+0000 7f3f4dffb640 1 -- 172.21.15.62:0/4016108546 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3f48120290 con 0x7f3f580b3a10 2023-05-15T16:40:13.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.675+0000 7f3f5ca70640 1 --2- 172.21.15.62:0/4016108546 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3f3c0653b0 0x7f3f3c067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:13.683 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.675+0000 7f3f5ca70640 1 --2- 172.21.15.62:0/4016108546 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3f3c0653b0 0x7f3f3c067860 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3f581e3800 tx=0x7f3f54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:13.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.675+0000 7f3f4dffb640 1 -- 172.21.15.62:0/4016108546 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f3f480edf80 con 0x7f3f580b3a10 2023-05-15T16:40:13.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.819+0000 7f3f5f4d5640 1 -- 172.21.15.62:0/4016108546 --> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3f5804dbe0 con 0x7f3f3c0653b0 2023-05-15T16:40:13.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.843+0000 7f3f4dffb640 1 -- 172.21.15.62:0/4016108546 <== mgr.4105 v2:172.21.15.161:6832/37541 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286475 (secure 0 0 0) 0x7f3f5804dbe0 con 0x7f3f3c0653b0 2023-05-15T16:40:13.849 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:13.850 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-05-15T16:40:13.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.847+0000 7f3f5f4d5640 1 -- 172.21.15.62:0/4016108546 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3f3c0653b0 msgr2=0x7f3f3c067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.847+0000 7f3f5f4d5640 1 --2- 172.21.15.62:0/4016108546 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3f3c0653b0 0x7f3f3c067860 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3f581e3800 tx=0x7f3f54008040 comp rx=0 tx=0).stop 2023-05-15T16:40:13.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.847+0000 7f3f5f4d5640 1 -- 172.21.15.62:0/4016108546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f580b3a10 msgr2=0x7f3f580bb050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:13.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.847+0000 7f3f5f4d5640 1 --2- 172.21.15.62:0/4016108546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f580b3a10 0x7f3f580bb050 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009960 tx=0x7f3f4801d570 comp rx=0 tx=0).stop 2023-05-15T16:40:13.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.847+0000 7f3f5f4d5640 1 -- 172.21.15.62:0/4016108546 shutdown_connections 2023-05-15T16:40:13.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.847+0000 7f3f5f4d5640 1 --2- 172.21.15.62:0/4016108546 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3f58146e60 0x7f3f580adba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.847+0000 7f3f5f4d5640 1 --2- 172.21.15.62:0/4016108546 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3f580b8780 0x7f3f580af9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.847+0000 7f3f5f4d5640 1 --2- 172.21.15.62:0/4016108546 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3f3c0653b0 0x7f3f3c067860 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.847+0000 7f3f5f4d5640 1 --2- 172.21.15.62:0/4016108546 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3f580b3a10 0x7f3f580bb050 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:13.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.847+0000 7f3f5f4d5640 1 -- 172.21.15.62:0/4016108546 >> 172.21.15.62:0/4016108546 conn(0x7f3f580653f0 msgr2=0x7f3f58070b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:13.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.847+0000 7f3f5f4d5640 1 -- 172.21.15.62:0/4016108546 shutdown_connections 2023-05-15T16:40:13.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:13.847+0000 7f3f5f4d5640 1 -- 172.21.15.62:0/4016108546 wait complete. 2023-05-15T16:40:13.866 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-05-15T16:40:13.320252+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":66280,"kb_used_data":3112,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":754908440,"statfs":{"total":773094113280,"available":773026242560,"internally_reserved":0,"allocated":3186688,"data_stored":1902188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.224702"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278001+0000","last_change":"2023-05-15T16:40:01.108030+0000","last_active":"2023-05-15T16:40:02.278001+0000","last_peered":"2023-05-15T16:40:02.278001+0000","last_clean":"2023-05-15T16:40:02.278001+0000","last_became_active":"2023-05-15T16:40:01.107701+0000","last_became_peered":"2023-05-15T16:40:01.107701+0000","last_unstale":"2023-05-15T16:40:02.278001+0000","last_undegraded":"2023-05-15T16:40:02.278001+0000","last_fullsized":"2023-05-15T16:40:02.278001+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:06.423119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282608+0000","last_change":"2023-05-15T16:40:01.162454+0000","last_active":"2023-05-15T16:40:02.282608+0000","last_peered":"2023-05-15T16:40:02.282608+0000","last_clean":"2023-05-15T16:40:02.282608+0000","last_became_active":"2023-05-15T16:40:01.161325+0000","last_became_peered":"2023-05-15T16:40:01.161325+0000","last_unstale":"2023-05-15T16:40:02.282608+0000","last_undegraded":"2023-05-15T16:40:02.282608+0000","last_fullsized":"2023-05-15T16:40:02.282608+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:13:33.110131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100574+0000","last_change":"2023-05-15T16:40:01.140999+0000","last_active":"2023-05-15T16:40:02.100574+0000","last_peered":"2023-05-15T16:40:02.100574+0000","last_clean":"2023-05-15T16:40:02.100574+0000","last_became_active":"2023-05-15T16:40:01.138081+0000","last_became_peered":"2023-05-15T16:40:01.138081+0000","last_unstale":"2023-05-15T16:40:02.100574+0000","last_undegraded":"2023-05-15T16:40:02.100574+0000","last_fullsized":"2023-05-15T16:40:02.100574+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:43:45.244861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280478+0000","last_change":"2023-05-15T16:40:01.125926+0000","last_active":"2023-05-15T16:40:02.280478+0000","last_peered":"2023-05-15T16:40:02.280478+0000","last_clean":"2023-05-15T16:40:02.280478+0000","last_became_active":"2023-05-15T16:40:01.121506+0000","last_became_peered":"2023-05-15T16:40:01.121506+0000","last_unstale":"2023-05-15T16:40:02.280478+0000","last_undegraded":"2023-05-15T16:40:02.280478+0000","last_fullsized":"2023-05-15T16:40:02.280478+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:56:14.814256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097671+0000","last_change":"2023-05-15T16:40:01.113655+0000","last_active":"2023-05-15T16:40:02.097671+0000","last_peered":"2023-05-15T16:40:02.097671+0000","last_clean":"2023-05-15T16:40:02.097671+0000","last_became_active":"2023-05-15T16:40:01.113359+0000","last_became_peered":"2023-05-15T16:40:01.113359+0000","last_unstale":"2023-05-15T16:40:02.097671+0000","last_undegraded":"2023-05-15T16:40:02.097671+0000","last_fullsized":"2023-05-15T16:40:02.097671+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099373+0000","last_change":"2023-05-15T16:40:01.138514+0000","last_active":"2023-05-15T16:40:02.099373+0000","last_peered":"2023-05-15T16:40:02.099373+0000","last_clean":"2023-05-15T16:40:02.099373+0000","last_became_active":"2023-05-15T16:40:01.137610+0000","last_became_peered":"2023-05-15T16:40:01.137610+0000","last_unstale":"2023-05-15T16:40:02.099373+0000","last_undegraded":"2023-05-15T16:40:02.099373+0000","last_fullsized":"2023-05-15T16:40:02.099373+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:41:16.912612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280784+0000","last_change":"2023-05-15T16:40:01.149263+0000","last_active":"2023-05-15T16:40:02.280784+0000","last_peered":"2023-05-15T16:40:02.280784+0000","last_clean":"2023-05-15T16:40:02.280784+0000","last_became_active":"2023-05-15T16:40:01.148591+0000","last_became_peered":"2023-05-15T16:40:01.148591+0000","last_unstale":"2023-05-15T16:40:02.280784+0000","last_undegraded":"2023-05-15T16:40:02.280784+0000","last_fullsized":"2023-05-15T16:40:02.280784+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:13:33.110131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282009+0000","last_change":"2023-05-15T16:40:01.160969+0000","last_active":"2023-05-15T16:40:02.282009+0000","last_peered":"2023-05-15T16:40:02.282009+0000","last_clean":"2023-05-15T16:40:02.282009+0000","last_became_active":"2023-05-15T16:40:01.160118+0000","last_became_peered":"2023-05-15T16:40:01.160118+0000","last_unstale":"2023-05-15T16:40:02.282009+0000","last_undegraded":"2023-05-15T16:40:02.282009+0000","last_fullsized":"2023-05-15T16:40:02.282009+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098107+0000","last_change":"2023-05-15T16:40:01.114095+0000","last_active":"2023-05-15T16:40:02.098107+0000","last_peered":"2023-05-15T16:40:02.098107+0000","last_clean":"2023-05-15T16:40:02.098107+0000","last_became_active":"2023-05-15T16:40:01.113367+0000","last_became_peered":"2023-05-15T16:40:01.113367+0000","last_unstale":"2023-05-15T16:40:02.098107+0000","last_undegraded":"2023-05-15T16:40:02.098107+0000","last_fullsized":"2023-05-15T16:40:02.098107+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:22:08.631817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282722+0000","last_change":"2023-05-15T16:40:01.161203+0000","last_active":"2023-05-15T16:40:02.282722+0000","last_peered":"2023-05-15T16:40:02.282722+0000","last_clean":"2023-05-15T16:40:02.282722+0000","last_became_active":"2023-05-15T16:40:01.160163+0000","last_became_peered":"2023-05-15T16:40:01.160163+0000","last_unstale":"2023-05-15T16:40:02.282722+0000","last_undegraded":"2023-05-15T16:40:02.282722+0000","last_fullsized":"2023-05-15T16:40:02.282722+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:31:14.621756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100644+0000","last_change":"2023-05-15T16:40:01.140439+0000","last_active":"2023-05-15T16:40:02.100644+0000","last_peered":"2023-05-15T16:40:02.100644+0000","last_clean":"2023-05-15T16:40:02.100644+0000","last_became_active":"2023-05-15T16:40:01.136958+0000","last_became_peered":"2023-05-15T16:40:01.136958+0000","last_unstale":"2023-05-15T16:40:02.100644+0000","last_undegraded":"2023-05-15T16:40:02.100644+0000","last_fullsized":"2023-05-15T16:40:02.100644+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:48:42.521388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278138+0000","last_change":"2023-05-15T16:40:01.140940+0000","last_active":"2023-05-15T16:40:02.278138+0000","last_peered":"2023-05-15T16:40:02.278138+0000","last_clean":"2023-05-15T16:40:02.278138+0000","last_became_active":"2023-05-15T16:40:01.140666+0000","last_became_peered":"2023-05-15T16:40:01.140666+0000","last_unstale":"2023-05-15T16:40:02.278138+0000","last_undegraded":"2023-05-15T16:40:02.278138+0000","last_fullsized":"2023-05-15T16:40:02.278138+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:56:14.814256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278109+0000","last_change":"2023-05-15T16:40:01.104796+0000","last_active":"2023-05-15T16:40:02.278109+0000","last_peered":"2023-05-15T16:40:02.278109+0000","last_clean":"2023-05-15T16:40:02.278109+0000","last_became_active":"2023-05-15T16:40:01.104505+0000","last_became_peered":"2023-05-15T16:40:01.104505+0000","last_unstale":"2023-05-15T16:40:02.278109+0000","last_undegraded":"2023-05-15T16:40:02.278109+0000","last_fullsized":"2023-05-15T16:40:02.278109+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:34.510844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.283018+0000","last_change":"2023-05-15T16:40:01.146028+0000","last_active":"2023-05-15T16:40:02.283018+0000","last_peered":"2023-05-15T16:40:02.283018+0000","last_clean":"2023-05-15T16:40:02.283018+0000","last_became_active":"2023-05-15T16:40:01.145321+0000","last_became_peered":"2023-05-15T16:40:01.145321+0000","last_unstale":"2023-05-15T16:40:02.283018+0000","last_undegraded":"2023-05-15T16:40:02.283018+0000","last_fullsized":"2023-05-15T16:40:02.283018+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:02:23.376990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281189+0000","last_change":"2023-05-15T16:40:01.157628+0000","last_active":"2023-05-15T16:40:02.281189+0000","last_peered":"2023-05-15T16:40:02.281189+0000","last_clean":"2023-05-15T16:40:02.281189+0000","last_became_active":"2023-05-15T16:40:01.157096+0000","last_became_peered":"2023-05-15T16:40:01.157096+0000","last_unstale":"2023-05-15T16:40:02.281189+0000","last_undegraded":"2023-05-15T16:40:02.281189+0000","last_fullsized":"2023-05-15T16:40:02.281189+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098971+0000","last_change":"2023-05-15T16:40:01.136171+0000","last_active":"2023-05-15T16:40:02.098971+0000","last_peered":"2023-05-15T16:40:02.098971+0000","last_clean":"2023-05-15T16:40:02.098971+0000","last_became_active":"2023-05-15T16:40:01.135400+0000","last_became_peered":"2023-05-15T16:40:01.135400+0000","last_unstale":"2023-05-15T16:40:02.098971+0000","last_undegraded":"2023-05-15T16:40:02.098971+0000","last_fullsized":"2023-05-15T16:40:02.098971+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:15:00.512988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098127+0000","last_change":"2023-05-15T16:40:01.113893+0000","last_active":"2023-05-15T16:40:02.098127+0000","last_peered":"2023-05-15T16:40:02.098127+0000","last_clean":"2023-05-15T16:40:02.098127+0000","last_became_active":"2023-05-15T16:40:01.113415+0000","last_became_peered":"2023-05-15T16:40:01.113415+0000","last_unstale":"2023-05-15T16:40:02.098127+0000","last_undegraded":"2023-05-15T16:40:02.098127+0000","last_fullsized":"2023-05-15T16:40:02.098127+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100417+0000","last_change":"2023-05-15T16:40:01.139891+0000","last_active":"2023-05-15T16:40:02.100417+0000","last_peered":"2023-05-15T16:40:02.100417+0000","last_clean":"2023-05-15T16:40:02.100417+0000","last_became_active":"2023-05-15T16:40:01.138421+0000","last_became_peered":"2023-05-15T16:40:01.138421+0000","last_unstale":"2023-05-15T16:40:02.100417+0000","last_undegraded":"2023-05-15T16:40:02.100417+0000","last_fullsized":"2023-05-15T16:40:02.100417+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T03:57:26.700942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278992+0000","last_change":"2023-05-15T16:40:01.129321+0000","last_active":"2023-05-15T16:40:02.278992+0000","last_peered":"2023-05-15T16:40:02.278992+0000","last_clean":"2023-05-15T16:40:02.278992+0000","last_became_active":"2023-05-15T16:40:01.129026+0000","last_became_peered":"2023-05-15T16:40:01.129026+0000","last_unstale":"2023-05-15T16:40:02.278992+0000","last_undegraded":"2023-05-15T16:40:02.278992+0000","last_fullsized":"2023-05-15T16:40:02.278992+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:51:42.949566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100354+0000","last_change":"2023-05-15T16:40:01.141251+0000","last_active":"2023-05-15T16:40:02.100354+0000","last_peered":"2023-05-15T16:40:02.100354+0000","last_clean":"2023-05-15T16:40:02.100354+0000","last_became_active":"2023-05-15T16:40:01.140102+0000","last_became_peered":"2023-05-15T16:40:01.140102+0000","last_unstale":"2023-05-15T16:40:02.100354+0000","last_undegraded":"2023-05-15T16:40:02.100354+0000","last_fullsized":"2023-05-15T16:40:02.100354+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:14:42.054526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281668+0000","last_change":"2023-05-15T16:40:01.157690+0000","last_active":"2023-05-15T16:40:02.281668+0000","last_peered":"2023-05-15T16:40:02.281668+0000","last_clean":"2023-05-15T16:40:02.281668+0000","last_became_active":"2023-05-15T16:40:01.157028+0000","last_became_peered":"2023-05-15T16:40:01.157028+0000","last_unstale":"2023-05-15T16:40:02.281668+0000","last_undegraded":"2023-05-15T16:40:02.281668+0000","last_fullsized":"2023-05-15T16:40:02.281668+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097365+0000","last_change":"2023-05-15T16:40:01.111473+0000","last_active":"2023-05-15T16:40:02.097365+0000","last_peered":"2023-05-15T16:40:02.097365+0000","last_clean":"2023-05-15T16:40:02.097365+0000","last_became_active":"2023-05-15T16:40:01.109519+0000","last_became_peered":"2023-05-15T16:40:01.109519+0000","last_unstale":"2023-05-15T16:40:02.097365+0000","last_undegraded":"2023-05-15T16:40:02.097365+0000","last_fullsized":"2023-05-15T16:40:02.097365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:39:15.813849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095154+0000","last_change":"2023-05-15T16:40:01.109311+0000","last_active":"2023-05-15T16:40:02.095154+0000","last_peered":"2023-05-15T16:40:02.095154+0000","last_clean":"2023-05-15T16:40:02.095154+0000","last_became_active":"2023-05-15T16:40:01.109001+0000","last_became_peered":"2023-05-15T16:40:01.109001+0000","last_unstale":"2023-05-15T16:40:02.095154+0000","last_undegraded":"2023-05-15T16:40:02.095154+0000","last_fullsized":"2023-05-15T16:40:02.095154+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:22:08.631817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280862+0000","last_change":"2023-05-15T16:40:01.151544+0000","last_active":"2023-05-15T16:40:02.280862+0000","last_peered":"2023-05-15T16:40:02.280862+0000","last_clean":"2023-05-15T16:40:02.280862+0000","last_became_active":"2023-05-15T16:40:01.150292+0000","last_became_peered":"2023-05-15T16:40:01.150292+0000","last_unstale":"2023-05-15T16:40:02.280862+0000","last_undegraded":"2023-05-15T16:40:02.280862+0000","last_fullsized":"2023-05-15T16:40:02.280862+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279251+0000","last_change":"2023-05-15T16:40:01.119067+0000","last_active":"2023-05-15T16:40:02.279251+0000","last_peered":"2023-05-15T16:40:02.279251+0000","last_clean":"2023-05-15T16:40:02.279251+0000","last_became_active":"2023-05-15T16:40:01.118808+0000","last_became_peered":"2023-05-15T16:40:01.118808+0000","last_unstale":"2023-05-15T16:40:02.279251+0000","last_undegraded":"2023-05-15T16:40:02.279251+0000","last_fullsized":"2023-05-15T16:40:02.279251+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:02:23.376990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279750+0000","last_change":"2023-05-15T16:40:01.108611+0000","last_active":"2023-05-15T16:40:02.279750+0000","last_peered":"2023-05-15T16:40:02.279750+0000","last_clean":"2023-05-15T16:40:02.279750+0000","last_became_active":"2023-05-15T16:40:01.107595+0000","last_became_peered":"2023-05-15T16:40:01.107595+0000","last_unstale":"2023-05-15T16:40:02.279750+0000","last_undegraded":"2023-05-15T16:40:02.279750+0000","last_fullsized":"2023-05-15T16:40:02.279750+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:45:33.580738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282768+0000","last_change":"2023-05-15T16:40:01.161786+0000","last_active":"2023-05-15T16:40:02.282768+0000","last_peered":"2023-05-15T16:40:02.282768+0000","last_clean":"2023-05-15T16:40:02.282768+0000","last_became_active":"2023-05-15T16:40:01.160406+0000","last_became_peered":"2023-05-15T16:40:01.160406+0000","last_unstale":"2023-05-15T16:40:02.282768+0000","last_undegraded":"2023-05-15T16:40:02.282768+0000","last_fullsized":"2023-05-15T16:40:02.282768+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279900+0000","last_change":"2023-05-15T16:40:01.147235+0000","last_active":"2023-05-15T16:40:02.279900+0000","last_peered":"2023-05-15T16:40:02.279900+0000","last_clean":"2023-05-15T16:40:02.279900+0000","last_became_active":"2023-05-15T16:40:01.146964+0000","last_became_peered":"2023-05-15T16:40:01.146964+0000","last_unstale":"2023-05-15T16:40:02.279900+0000","last_undegraded":"2023-05-15T16:40:02.279900+0000","last_fullsized":"2023-05-15T16:40:02.279900+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:07:25.649507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095330+0000","last_change":"2023-05-15T16:40:01.125493+0000","last_active":"2023-05-15T16:40:02.095330+0000","last_peered":"2023-05-15T16:40:02.095330+0000","last_clean":"2023-05-15T16:40:02.095330+0000","last_became_active":"2023-05-15T16:40:01.125172+0000","last_became_peered":"2023-05-15T16:40:01.125172+0000","last_unstale":"2023-05-15T16:40:02.095330+0000","last_undegraded":"2023-05-15T16:40:02.095330+0000","last_fullsized":"2023-05-15T16:40:02.095330+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099957+0000","last_change":"2023-05-15T16:40:01.138349+0000","last_active":"2023-05-15T16:40:02.099957+0000","last_peered":"2023-05-15T16:40:02.099957+0000","last_clean":"2023-05-15T16:40:02.099957+0000","last_became_active":"2023-05-15T16:40:01.137255+0000","last_became_peered":"2023-05-15T16:40:01.137255+0000","last_unstale":"2023-05-15T16:40:02.099957+0000","last_undegraded":"2023-05-15T16:40:02.099957+0000","last_fullsized":"2023-05-15T16:40:02.099957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:22:31.889776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095427+0000","last_change":"2023-05-15T16:40:01.105121+0000","last_active":"2023-05-15T16:40:02.095427+0000","last_peered":"2023-05-15T16:40:02.095427+0000","last_clean":"2023-05-15T16:40:02.095427+0000","last_became_active":"2023-05-15T16:40:01.104061+0000","last_became_peered":"2023-05-15T16:40:01.104061+0000","last_unstale":"2023-05-15T16:40:02.095427+0000","last_undegraded":"2023-05-15T16:40:02.095427+0000","last_fullsized":"2023-05-15T16:40:02.095427+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279918+0000","last_change":"2023-05-15T16:40:01.132449+0000","last_active":"2023-05-15T16:40:02.279918+0000","last_peered":"2023-05-15T16:40:02.279918+0000","last_clean":"2023-05-15T16:40:02.279918+0000","last_became_active":"2023-05-15T16:40:01.131460+0000","last_became_peered":"2023-05-15T16:40:01.131460+0000","last_unstale":"2023-05-15T16:40:02.279918+0000","last_undegraded":"2023-05-15T16:40:02.279918+0000","last_fullsized":"2023-05-15T16:40:02.279918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:19:49.435267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.096152+0000","last_change":"2023-05-15T16:40:01.109245+0000","last_active":"2023-05-15T16:40:02.096152+0000","last_peered":"2023-05-15T16:40:02.096152+0000","last_clean":"2023-05-15T16:40:02.096152+0000","last_became_active":"2023-05-15T16:40:01.108858+0000","last_became_peered":"2023-05-15T16:40:01.108858+0000","last_unstale":"2023-05-15T16:40:02.096152+0000","last_undegraded":"2023-05-15T16:40:02.096152+0000","last_fullsized":"2023-05-15T16:40:02.096152+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:45:33.580738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281902+0000","last_change":"2023-05-15T16:40:00.763235+0000","last_active":"2023-05-15T16:40:02.281902+0000","last_peered":"2023-05-15T16:40:02.281902+0000","last_clean":"2023-05-15T16:40:02.281902+0000","last_became_active":"2023-05-15T16:40:00.762235+0000","last_became_peered":"2023-05-15T16:40:00.762235+0000","last_unstale":"2023-05-15T16:40:02.281902+0000","last_undegraded":"2023-05-15T16:40:02.281902+0000","last_fullsized":"2023-05-15T16:40:02.281902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:51:11.783628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282911+0000","last_change":"2023-05-15T16:40:01.160372+0000","last_active":"2023-05-15T16:40:02.282911+0000","last_peered":"2023-05-15T16:40:02.282911+0000","last_clean":"2023-05-15T16:40:02.282911+0000","last_became_active":"2023-05-15T16:40:01.159573+0000","last_became_peered":"2023-05-15T16:40:01.159573+0000","last_unstale":"2023-05-15T16:40:02.282911+0000","last_undegraded":"2023-05-15T16:40:02.282911+0000","last_fullsized":"2023-05-15T16:40:02.282911+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097310+0000","last_change":"2023-05-15T16:40:00.739620+0000","last_active":"2023-05-15T16:40:02.097310+0000","last_peered":"2023-05-15T16:40:02.097310+0000","last_clean":"2023-05-15T16:40:02.097310+0000","last_became_active":"2023-05-15T16:40:00.739275+0000","last_became_peered":"2023-05-15T16:40:00.739275+0000","last_unstale":"2023-05-15T16:40:02.097310+0000","last_undegraded":"2023-05-15T16:40:02.097310+0000","last_fullsized":"2023-05-15T16:40:02.097310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:05.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098022+0000","last_change":"2023-05-15T16:40:01.113172+0000","last_active":"2023-05-15T16:40:02.098022+0000","last_peered":"2023-05-15T16:40:02.098022+0000","last_clean":"2023-05-15T16:40:02.098022+0000","last_became_active":"2023-05-15T16:40:01.112870+0000","last_became_peered":"2023-05-15T16:40:01.112870+0000","last_unstale":"2023-05-15T16:40:02.098022+0000","last_undegraded":"2023-05-15T16:40:02.098022+0000","last_fullsized":"2023-05-15T16:40:02.098022+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281420+0000","last_change":"2023-05-15T16:40:00.762606+0000","last_active":"2023-05-15T16:40:02.281420+0000","last_peered":"2023-05-15T16:40:02.281420+0000","last_clean":"2023-05-15T16:40:02.281420+0000","last_became_active":"2023-05-15T16:40:00.761988+0000","last_became_peered":"2023-05-15T16:40:00.761988+0000","last_unstale":"2023-05-15T16:40:02.281420+0000","last_undegraded":"2023-05-15T16:40:02.281420+0000","last_fullsized":"2023-05-15T16:40:02.281420+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:45:32.571235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095959+0000","last_change":"2023-05-15T16:40:01.147086+0000","last_active":"2023-05-15T16:40:02.095959+0000","last_peered":"2023-05-15T16:40:02.095959+0000","last_clean":"2023-05-15T16:40:02.095959+0000","last_became_active":"2023-05-15T16:40:01.146808+0000","last_became_peered":"2023-05-15T16:40:01.146808+0000","last_unstale":"2023-05-15T16:40:02.095959+0000","last_undegraded":"2023-05-15T16:40:02.095959+0000","last_fullsized":"2023-05-15T16:40:02.095959+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"22'8","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280054+0000","last_change":"2023-05-15T16:40:00.730676+0000","last_active":"2023-05-15T16:40:02.280054+0000","last_peered":"2023-05-15T16:40:02.280054+0000","last_clean":"2023-05-15T16:40:02.280054+0000","last_became_active":"2023-05-15T16:40:00.729878+0000","last_became_peered":"2023-05-15T16:40:00.729878+0000","last_unstale":"2023-05-15T16:40:02.280054+0000","last_undegraded":"2023-05-15T16:40:02.280054+0000","last_fullsized":"2023-05-15T16:40:02.280054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:11:08.088281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282241+0000","last_change":"2023-05-15T16:40:00.758036+0000","last_active":"2023-05-15T16:40:02.282241+0000","last_peered":"2023-05-15T16:40:02.282241+0000","last_clean":"2023-05-15T16:40:02.282241+0000","last_became_active":"2023-05-15T16:40:00.757440+0000","last_became_peered":"2023-05-15T16:40:00.757440+0000","last_unstale":"2023-05-15T16:40:02.282241+0000","last_undegraded":"2023-05-15T16:40:02.282241+0000","last_fullsized":"2023-05-15T16:40:02.282241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:39:14.804346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282268+0000","last_change":"2023-05-15T16:40:01.160001+0000","last_active":"2023-05-15T16:40:02.282268+0000","last_peered":"2023-05-15T16:40:02.282268+0000","last_clean":"2023-05-15T16:40:02.282268+0000","last_became_active":"2023-05-15T16:40:01.159447+0000","last_became_peered":"2023-05-15T16:40:01.159447+0000","last_unstale":"2023-05-15T16:40:02.282268+0000","last_undegraded":"2023-05-15T16:40:02.282268+0000","last_fullsized":"2023-05-15T16:40:02.282268+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:26:45.774263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282224+0000","last_change":"2023-05-15T16:40:00.762701+0000","last_active":"2023-05-15T16:40:02.282224+0000","last_peered":"2023-05-15T16:40:02.282224+0000","last_clean":"2023-05-15T16:40:02.282224+0000","last_became_active":"2023-05-15T16:40:00.762050+0000","last_became_peered":"2023-05-15T16:40:00.762050+0000","last_unstale":"2023-05-15T16:40:02.282224+0000","last_undegraded":"2023-05-15T16:40:02.282224+0000","last_fullsized":"2023-05-15T16:40:02.282224+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:00:39.077549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099635+0000","last_change":"2023-05-15T16:40:01.141928+0000","last_active":"2023-05-15T16:40:02.099635+0000","last_peered":"2023-05-15T16:40:02.099635+0000","last_clean":"2023-05-15T16:40:02.099635+0000","last_became_active":"2023-05-15T16:40:01.135581+0000","last_became_peered":"2023-05-15T16:40:01.135581+0000","last_unstale":"2023-05-15T16:40:02.099635+0000","last_undegraded":"2023-05-15T16:40:02.099635+0000","last_fullsized":"2023-05-15T16:40:02.099635+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:50:32.789209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.d","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281732+0000","last_change":"2023-05-15T16:40:00.760061+0000","last_active":"2023-05-15T16:40:02.281732+0000","last_peered":"2023-05-15T16:40:02.281732+0000","last_clean":"2023-05-15T16:40:02.281732+0000","last_became_active":"2023-05-15T16:40:00.759394+0000","last_became_peered":"2023-05-15T16:40:00.759394+0000","last_unstale":"2023-05-15T16:40:02.281732+0000","last_undegraded":"2023-05-15T16:40:02.281732+0000","last_fullsized":"2023-05-15T16:40:02.281732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:51:42.381804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280016+0000","last_change":"2023-05-15T16:40:01.124789+0000","last_active":"2023-05-15T16:40:02.280016+0000","last_peered":"2023-05-15T16:40:02.280016+0000","last_clean":"2023-05-15T16:40:02.280016+0000","last_became_active":"2023-05-15T16:40:01.123158+0000","last_became_peered":"2023-05-15T16:40:01.123158+0000","last_unstale":"2023-05-15T16:40:02.280016+0000","last_undegraded":"2023-05-15T16:40:02.280016+0000","last_fullsized":"2023-05-15T16:40:02.280016+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:00:40.087052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282519+0000","last_change":"2023-05-15T16:40:00.754578+0000","last_active":"2023-05-15T16:40:02.282519+0000","last_peered":"2023-05-15T16:40:02.282519+0000","last_clean":"2023-05-15T16:40:02.282519+0000","last_became_active":"2023-05-15T16:40:00.753829+0000","last_became_peered":"2023-05-15T16:40:00.753829+0000","last_unstale":"2023-05-15T16:40:02.282519+0000","last_undegraded":"2023-05-15T16:40:02.282519+0000","last_fullsized":"2023-05-15T16:40:02.282519+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097589+0000","last_change":"2023-05-15T16:40:01.111444+0000","last_active":"2023-05-15T16:40:02.097589+0000","last_peered":"2023-05-15T16:40:02.097589+0000","last_clean":"2023-05-15T16:40:02.097589+0000","last_became_active":"2023-05-15T16:40:01.108848+0000","last_became_peered":"2023-05-15T16:40:01.108848+0000","last_unstale":"2023-05-15T16:40:02.097589+0000","last_undegraded":"2023-05-15T16:40:02.097589+0000","last_fullsized":"2023-05-15T16:40:02.097589+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:26:45.774263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095431+0000","last_change":"2023-05-15T16:40:00.740949+0000","last_active":"2023-05-15T16:40:02.095431+0000","last_peered":"2023-05-15T16:40:02.095431+0000","last_clean":"2023-05-15T16:40:02.095431+0000","last_became_active":"2023-05-15T16:40:00.739009+0000","last_became_peered":"2023-05-15T16:40:00.739009+0000","last_unstale":"2023-05-15T16:40:02.095431+0000","last_undegraded":"2023-05-15T16:40:02.095431+0000","last_fullsized":"2023-05-15T16:40:02.095431+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:14:54.500421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100640+0000","last_change":"2023-05-15T16:40:01.140770+0000","last_active":"2023-05-15T16:40:02.100640+0000","last_peered":"2023-05-15T16:40:02.100640+0000","last_clean":"2023-05-15T16:40:02.100640+0000","last_became_active":"2023-05-15T16:40:01.138754+0000","last_became_peered":"2023-05-15T16:40:01.138754+0000","last_unstale":"2023-05-15T16:40:02.100640+0000","last_undegraded":"2023-05-15T16:40:02.100640+0000","last_fullsized":"2023-05-15T16:40:02.100640+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:02:15.760757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280274+0000","last_change":"2023-05-15T16:40:00.749907+0000","last_active":"2023-05-15T16:40:02.280274+0000","last_peered":"2023-05-15T16:40:02.280274+0000","last_clean":"2023-05-15T16:40:02.280274+0000","last_became_active":"2023-05-15T16:40:00.749282+0000","last_became_peered":"2023-05-15T16:40:00.749282+0000","last_unstale":"2023-05-15T16:40:02.280274+0000","last_undegraded":"2023-05-15T16:40:02.280274+0000","last_fullsized":"2023-05-15T16:40:02.280274+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:14:54.500421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100813+0000","last_change":"2023-05-15T16:40:01.139858+0000","last_active":"2023-05-15T16:40:02.100813+0000","last_peered":"2023-05-15T16:40:02.100813+0000","last_clean":"2023-05-15T16:40:02.100813+0000","last_became_active":"2023-05-15T16:40:01.136069+0000","last_became_peered":"2023-05-15T16:40:01.136069+0000","last_unstale":"2023-05-15T16:40:02.100813+0000","last_undegraded":"2023-05-15T16:40:02.100813+0000","last_fullsized":"2023-05-15T16:40:02.100813+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:05:11.188290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099660+0000","last_change":"2023-05-15T16:40:00.749474+0000","last_active":"2023-05-15T16:40:02.099660+0000","last_peered":"2023-05-15T16:40:02.099660+0000","last_clean":"2023-05-15T16:40:02.099660+0000","last_became_active":"2023-05-15T16:40:00.748842+0000","last_became_peered":"2023-05-15T16:40:00.748842+0000","last_unstale":"2023-05-15T16:40:02.099660+0000","last_undegraded":"2023-05-15T16:40:02.099660+0000","last_fullsized":"2023-05-15T16:40:02.099660+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:56:52.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100423+0000","last_change":"2023-05-15T16:40:01.138792+0000","last_active":"2023-05-15T16:40:02.100423+0000","last_peered":"2023-05-15T16:40:02.100423+0000","last_clean":"2023-05-15T16:40:02.100423+0000","last_became_active":"2023-05-15T16:40:01.137792+0000","last_became_peered":"2023-05-15T16:40:01.137792+0000","last_unstale":"2023-05-15T16:40:02.100423+0000","last_undegraded":"2023-05-15T16:40:02.100423+0000","last_fullsized":"2023-05-15T16:40:02.100423+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:51:32.960037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095575+0000","last_change":"2023-05-15T16:40:00.735846+0000","last_active":"2023-05-15T16:40:02.095575+0000","last_peered":"2023-05-15T16:40:02.095575+0000","last_clean":"2023-05-15T16:40:02.095575+0000","last_became_active":"2023-05-15T16:40:00.734223+0000","last_became_peered":"2023-05-15T16:40:00.734223+0000","last_unstale":"2023-05-15T16:40:02.095575+0000","last_undegraded":"2023-05-15T16:40:02.095575+0000","last_fullsized":"2023-05-15T16:40:02.095575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:05.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279676+0000","last_change":"2023-05-15T16:40:01.106280+0000","last_active":"2023-05-15T16:40:02.279676+0000","last_peered":"2023-05-15T16:40:02.279676+0000","last_clean":"2023-05-15T16:40:02.279676+0000","last_became_active":"2023-05-15T16:40:01.105962+0000","last_became_peered":"2023-05-15T16:40:01.105962+0000","last_unstale":"2023-05-15T16:40:02.279676+0000","last_undegraded":"2023-05-15T16:40:02.279676+0000","last_fullsized":"2023-05-15T16:40:02.279676+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:24:01.307491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":167,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.125777+0000","last_change":"2023-05-15T16:39:50.637320+0000","last_active":"2023-05-15T16:40:01.125777+0000","last_peered":"2023-05-15T16:40:01.125777+0000","last_clean":"2023-05-15T16:40:01.125777+0000","last_became_active":"2023-05-15T16:39:50.636541+0000","last_became_peered":"2023-05-15T16:39:50.636541+0000","last_unstale":"2023-05-15T16:40:01.125777+0000","last_undegraded":"2023-05-15T16:40:01.125777+0000","last_fullsized":"2023-05-15T16:40:01.125777+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:49.601783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:49.601783+0000","last_clean_scrub_stamp":"2023-05-15T16:39:49.601783+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:18:01.941203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.156165+0000","last_change":"2023-05-15T16:39:56.699270+0000","last_active":"2023-05-15T16:40:01.156165+0000","last_peered":"2023-05-15T16:40:01.156165+0000","last_clean":"2023-05-15T16:40:01.156165+0000","last_became_active":"2023-05-15T16:39:56.698429+0000","last_became_peered":"2023-05-15T16:39:56.698429+0000","last_unstale":"2023-05-15T16:40:01.156165+0000","last_undegraded":"2023-05-15T16:40:01.156165+0000","last_fullsized":"2023-05-15T16:40:01.156165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:31.428692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095161+0000","last_change":"2023-05-15T16:40:00.753212+0000","last_active":"2023-05-15T16:40:02.095161+0000","last_peered":"2023-05-15T16:40:02.095161+0000","last_clean":"2023-05-15T16:40:02.095161+0000","last_became_active":"2023-05-15T16:40:00.752900+0000","last_became_peered":"2023-05-15T16:40:00.752900+0000","last_unstale":"2023-05-15T16:40:02.095161+0000","last_undegraded":"2023-05-15T16:40:02.095161+0000","last_fullsized":"2023-05-15T16:40:02.095161+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:30:28.823039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280571+0000","last_change":"2023-05-15T16:40:01.148321+0000","last_active":"2023-05-15T16:40:02.280571+0000","last_peered":"2023-05-15T16:40:02.280571+0000","last_clean":"2023-05-15T16:40:02.280571+0000","last_became_active":"2023-05-15T16:40:01.147687+0000","last_became_peered":"2023-05-15T16:40:01.147687+0000","last_unstale":"2023-05-15T16:40:02.280571+0000","last_undegraded":"2023-05-15T16:40:02.280571+0000","last_fullsized":"2023-05-15T16:40:02.280571+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:51:43.391307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.125606+0000","last_change":"2023-05-15T16:39:56.700800+0000","last_active":"2023-05-15T16:40:01.125606+0000","last_peered":"2023-05-15T16:40:01.125606+0000","last_clean":"2023-05-15T16:40:01.125606+0000","last_became_active":"2023-05-15T16:39:56.700022+0000","last_became_peered":"2023-05-15T16:39:56.700022+0000","last_unstale":"2023-05-15T16:40:01.125606+0000","last_undegraded":"2023-05-15T16:40:01.125606+0000","last_fullsized":"2023-05-15T16:40:01.125606+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:11:54.752932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097131+0000","last_change":"2023-05-15T16:40:00.762802+0000","last_active":"2023-05-15T16:40:02.097131+0000","last_peered":"2023-05-15T16:40:02.097131+0000","last_clean":"2023-05-15T16:40:02.097131+0000","last_became_active":"2023-05-15T16:40:00.762564+0000","last_became_peered":"2023-05-15T16:40:00.762564+0000","last_unstale":"2023-05-15T16:40:02.097131+0000","last_undegraded":"2023-05-15T16:40:02.097131+0000","last_fullsized":"2023-05-15T16:40:02.097131+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:21:29.173379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097918+0000","last_change":"2023-05-15T16:40:01.111468+0000","last_active":"2023-05-15T16:40:02.097918+0000","last_peered":"2023-05-15T16:40:02.097918+0000","last_clean":"2023-05-15T16:40:02.097918+0000","last_became_active":"2023-05-15T16:40:01.108705+0000","last_became_peered":"2023-05-15T16:40:01.108705+0000","last_unstale":"2023-05-15T16:40:02.097918+0000","last_undegraded":"2023-05-15T16:40:02.097918+0000","last_fullsized":"2023-05-15T16:40:02.097918+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:24:01.307491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.091019+0000","last_change":"2023-05-15T16:39:57.018815+0000","last_active":"2023-05-15T16:40:01.091019+0000","last_peered":"2023-05-15T16:40:01.091019+0000","last_clean":"2023-05-15T16:40:01.091019+0000","last_became_active":"2023-05-15T16:39:57.018404+0000","last_became_peered":"2023-05-15T16:39:57.018404+0000","last_unstale":"2023-05-15T16:40:01.091019+0000","last_undegraded":"2023-05-15T16:40:01.091019+0000","last_fullsized":"2023-05-15T16:40:01.091019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278644+0000","last_change":"2023-05-15T16:40:00.732605+0000","last_active":"2023-05-15T16:40:02.278644+0000","last_peered":"2023-05-15T16:40:02.278644+0000","last_clean":"2023-05-15T16:40:02.278644+0000","last_became_active":"2023-05-15T16:40:00.731996+0000","last_became_peered":"2023-05-15T16:40:00.731996+0000","last_unstale":"2023-05-15T16:40:02.278644+0000","last_undegraded":"2023-05-15T16:40:02.278644+0000","last_fullsized":"2023-05-15T16:40:02.278644+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:30:28.823039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280039+0000","last_change":"2023-05-15T16:40:01.158076+0000","last_active":"2023-05-15T16:40:02.280039+0000","last_peered":"2023-05-15T16:40:02.280039+0000","last_clean":"2023-05-15T16:40:02.280039+0000","last_became_active":"2023-05-15T16:40:01.157836+0000","last_became_peered":"2023-05-15T16:40:01.157836+0000","last_unstale":"2023-05-15T16:40:02.280039+0000","last_undegraded":"2023-05-15T16:40:02.280039+0000","last_fullsized":"2023-05-15T16:40:02.280039+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:26:45.774263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.156363+0000","last_change":"2023-05-15T16:39:56.701269+0000","last_active":"2023-05-15T16:40:01.156363+0000","last_peered":"2023-05-15T16:40:01.156363+0000","last_clean":"2023-05-15T16:40:01.156363+0000","last_became_active":"2023-05-15T16:39:56.700221+0000","last_became_peered":"2023-05-15T16:39:56.700221+0000","last_unstale":"2023-05-15T16:40:01.156363+0000","last_undegraded":"2023-05-15T16:40:01.156363+0000","last_fullsized":"2023-05-15T16:40:01.156363+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099905+0000","last_change":"2023-05-15T16:40:00.749117+0000","last_active":"2023-05-15T16:40:02.099905+0000","last_peered":"2023-05-15T16:40:02.099905+0000","last_clean":"2023-05-15T16:40:02.099905+0000","last_became_active":"2023-05-15T16:40:00.748493+0000","last_became_peered":"2023-05-15T16:40:00.748493+0000","last_unstale":"2023-05-15T16:40:02.099905+0000","last_undegraded":"2023-05-15T16:40:02.099905+0000","last_fullsized":"2023-05-15T16:40:02.099905+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279394+0000","last_change":"2023-05-15T16:40:01.108032+0000","last_active":"2023-05-15T16:40:02.279394+0000","last_peered":"2023-05-15T16:40:02.279394+0000","last_clean":"2023-05-15T16:40:02.279394+0000","last_became_active":"2023-05-15T16:40:01.107664+0000","last_became_peered":"2023-05-15T16:40:01.107664+0000","last_unstale":"2023-05-15T16:40:02.279394+0000","last_undegraded":"2023-05-15T16:40:02.279394+0000","last_fullsized":"2023-05-15T16:40:02.279394+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:31:14.621756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.283078+0000","last_change":"2023-05-15T16:40:00.756830+0000","last_active":"2023-05-15T16:40:02.283078+0000","last_peered":"2023-05-15T16:40:02.283078+0000","last_clean":"2023-05-15T16:40:02.283078+0000","last_became_active":"2023-05-15T16:40:00.755791+0000","last_became_peered":"2023-05-15T16:40:00.755791+0000","last_unstale":"2023-05-15T16:40:02.283078+0000","last_undegraded":"2023-05-15T16:40:02.283078+0000","last_fullsized":"2023-05-15T16:40:02.283078+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:21:29.173379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.101846+0000","last_change":"2023-05-15T16:39:56.692931+0000","last_active":"2023-05-15T16:40:01.101846+0000","last_peered":"2023-05-15T16:40:01.101846+0000","last_clean":"2023-05-15T16:40:01.101846+0000","last_became_active":"2023-05-15T16:39:56.692557+0000","last_became_peered":"2023-05-15T16:39:56.692557+0000","last_unstale":"2023-05-15T16:40:01.101846+0000","last_undegraded":"2023-05-15T16:40:01.101846+0000","last_fullsized":"2023-05-15T16:40:01.101846+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279898+0000","last_change":"2023-05-15T16:40:01.143115+0000","last_active":"2023-05-15T16:40:02.279898+0000","last_peered":"2023-05-15T16:40:02.279898+0000","last_clean":"2023-05-15T16:40:02.279898+0000","last_became_active":"2023-05-15T16:40:01.142777+0000","last_became_peered":"2023-05-15T16:40:01.142777+0000","last_unstale":"2023-05-15T16:40:02.279898+0000","last_undegraded":"2023-05-15T16:40:02.279898+0000","last_fullsized":"2023-05-15T16:40:02.279898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:07:38.716348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279615+0000","last_change":"2023-05-15T16:40:00.732385+0000","last_active":"2023-05-15T16:40:02.279615+0000","last_peered":"2023-05-15T16:40:02.279615+0000","last_clean":"2023-05-15T16:40:02.279615+0000","last_became_active":"2023-05-15T16:40:00.731887+0000","last_became_peered":"2023-05-15T16:40:00.731887+0000","last_unstale":"2023-05-15T16:40:02.279615+0000","last_undegraded":"2023-05-15T16:40:02.279615+0000","last_fullsized":"2023-05-15T16:40:02.279615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.129045+0000","last_change":"2023-05-15T16:39:56.698079+0000","last_active":"2023-05-15T16:40:01.129045+0000","last_peered":"2023-05-15T16:40:01.129045+0000","last_clean":"2023-05-15T16:40:01.129045+0000","last_became_active":"2023-05-15T16:39:56.697298+0000","last_became_peered":"2023-05-15T16:39:56.697298+0000","last_unstale":"2023-05-15T16:40:01.129045+0000","last_undegraded":"2023-05-15T16:40:01.129045+0000","last_fullsized":"2023-05-15T16:40:01.129045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:32:01.734351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097558+0000","last_change":"2023-05-15T16:40:01.144386+0000","last_active":"2023-05-15T16:40:02.097558+0000","last_peered":"2023-05-15T16:40:02.097558+0000","last_clean":"2023-05-15T16:40:02.097558+0000","last_became_active":"2023-05-15T16:40:01.144046+0000","last_became_peered":"2023-05-15T16:40:01.144046+0000","last_unstale":"2023-05-15T16:40:02.097558+0000","last_undegraded":"2023-05-15T16:40:02.097558+0000","last_fullsized":"2023-05-15T16:40:02.097558+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:50:32.789209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.096140+0000","last_change":"2023-05-15T16:40:00.740983+0000","last_active":"2023-05-15T16:40:02.096140+0000","last_peered":"2023-05-15T16:40:02.096140+0000","last_clean":"2023-05-15T16:40:02.096140+0000","last_became_active":"2023-05-15T16:40:00.739828+0000","last_became_peered":"2023-05-15T16:40:00.739828+0000","last_unstale":"2023-05-15T16:40:02.096140+0000","last_undegraded":"2023-05-15T16:40:02.096140+0000","last_fullsized":"2023-05-15T16:40:02.096140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.101796+0000","last_change":"2023-05-15T16:39:56.694298+0000","last_active":"2023-05-15T16:40:01.101796+0000","last_peered":"2023-05-15T16:40:01.101796+0000","last_clean":"2023-05-15T16:40:01.101796+0000","last_became_active":"2023-05-15T16:39:56.693723+0000","last_became_peered":"2023-05-15T16:39:56.693723+0000","last_unstale":"2023-05-15T16:40:01.101796+0000","last_undegraded":"2023-05-15T16:40:01.101796+0000","last_fullsized":"2023-05-15T16:40:01.101796+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:31.428692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095317+0000","last_change":"2023-05-15T16:40:01.125833+0000","last_active":"2023-05-15T16:40:02.095317+0000","last_peered":"2023-05-15T16:40:02.095317+0000","last_clean":"2023-05-15T16:40:02.095317+0000","last_became_active":"2023-05-15T16:40:01.125641+0000","last_became_peered":"2023-05-15T16:40:01.125641+0000","last_unstale":"2023-05-15T16:40:02.095317+0000","last_undegraded":"2023-05-15T16:40:02.095317+0000","last_fullsized":"2023-05-15T16:40:02.095317+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:48:42.521388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098109+0000","last_change":"2023-05-15T16:40:00.729163+0000","last_active":"2023-05-15T16:40:02.098109+0000","last_peered":"2023-05-15T16:40:02.098109+0000","last_clean":"2023-05-15T16:40:02.098109+0000","last_became_active":"2023-05-15T16:40:00.725627+0000","last_became_peered":"2023-05-15T16:40:00.725627+0000","last_unstale":"2023-05-15T16:40:02.098109+0000","last_undegraded":"2023-05-15T16:40:02.098109+0000","last_fullsized":"2023-05-15T16:40:02.098109+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:57:33.501341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2023-05-15T16:40:01.115241+0000","last_change":"2023-05-15T16:39:56.697003+0000","last_active":"2023-05-15T16:40:01.115241+0000","last_peered":"2023-05-15T16:40:01.115241+0000","last_clean":"2023-05-15T16:40:01.115241+0000","last_became_active":"2023-05-15T16:39:56.696210+0000","last_became_peered":"2023-05-15T16:39:56.696210+0000","last_unstale":"2023-05-15T16:40:01.115241+0000","last_undegraded":"2023-05-15T16:40:01.115241+0000","last_fullsized":"2023-05-15T16:40:01.115241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:29:27.454964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099418+0000","last_change":"2023-05-15T16:40:01.146590+0000","last_active":"2023-05-15T16:40:02.099418+0000","last_peered":"2023-05-15T16:40:02.099418+0000","last_clean":"2023-05-15T16:40:02.099418+0000","last_became_active":"2023-05-15T16:40:01.145902+0000","last_became_peered":"2023-05-15T16:40:01.145902+0000","last_unstale":"2023-05-15T16:40:02.099418+0000","last_undegraded":"2023-05-15T16:40:02.099418+0000","last_fullsized":"2023-05-15T16:40:02.099418+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:26:42.763796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099663+0000","last_change":"2023-05-15T16:40:01.137328+0000","last_active":"2023-05-15T16:40:02.099663+0000","last_peered":"2023-05-15T16:40:02.099663+0000","last_clean":"2023-05-15T16:40:02.099663+0000","last_became_active":"2023-05-15T16:40:01.135859+0000","last_became_peered":"2023-05-15T16:40:01.135859+0000","last_unstale":"2023-05-15T16:40:02.099663+0000","last_undegraded":"2023-05-15T16:40:02.099663+0000","last_fullsized":"2023-05-15T16:40:02.099663+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:22:08.631817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"22'6","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.100701+0000","last_change":"2023-05-15T16:40:00.741443+0000","last_active":"2023-05-15T16:40:02.100701+0000","last_peered":"2023-05-15T16:40:02.100701+0000","last_clean":"2023-05-15T16:40:02.100701+0000","last_became_active":"2023-05-15T16:40:00.737218+0000","last_became_peered":"2023-05-15T16:40:00.737218+0000","last_unstale":"2023-05-15T16:40:02.100701+0000","last_undegraded":"2023-05-15T16:40:02.100701+0000","last_fullsized":"2023-05-15T16:40:02.100701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:05.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279727+0000","last_change":"2023-05-15T16:40:01.119384+0000","last_active":"2023-05-15T16:40:02.279727+0000","last_peered":"2023-05-15T16:40:02.279727+0000","last_clean":"2023-05-15T16:40:02.279727+0000","last_became_active":"2023-05-15T16:40:01.119075+0000","last_became_peered":"2023-05-15T16:40:01.119075+0000","last_unstale":"2023-05-15T16:40:02.279727+0000","last_undegraded":"2023-05-15T16:40:02.279727+0000","last_fullsized":"2023-05-15T16:40:02.279727+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:29:25.132530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"22'3","reported_seq":14,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.281736+0000","last_change":"2023-05-15T16:40:00.744828+0000","last_active":"2023-05-15T16:40:02.281736+0000","last_peered":"2023-05-15T16:40:02.281736+0000","last_clean":"2023-05-15T16:40:02.281736+0000","last_became_active":"2023-05-15T16:40:00.744103+0000","last_became_peered":"2023-05-15T16:40:00.744103+0000","last_unstale":"2023-05-15T16:40:02.281736+0000","last_undegraded":"2023-05-15T16:40:02.281736+0000","last_fullsized":"2023-05-15T16:40:02.281736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:19:48.425765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282856+0000","last_change":"2023-05-15T16:40:00.754697+0000","last_active":"2023-05-15T16:40:02.282856+0000","last_peered":"2023-05-15T16:40:02.282856+0000","last_clean":"2023-05-15T16:40:02.282856+0000","last_became_active":"2023-05-15T16:40:00.754117+0000","last_became_peered":"2023-05-15T16:40:00.754117+0000","last_unstale":"2023-05-15T16:40:02.282856+0000","last_undegraded":"2023-05-15T16:40:02.282856+0000","last_fullsized":"2023-05-15T16:40:02.282856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:16:05.413617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095638+0000","last_change":"2023-05-15T16:40:01.148027+0000","last_active":"2023-05-15T16:40:02.095638+0000","last_peered":"2023-05-15T16:40:02.095638+0000","last_clean":"2023-05-15T16:40:02.095638+0000","last_became_active":"2023-05-15T16:40:01.147699+0000","last_became_peered":"2023-05-15T16:40:01.147699+0000","last_unstale":"2023-05-15T16:40:02.095638+0000","last_undegraded":"2023-05-15T16:40:02.095638+0000","last_fullsized":"2023-05-15T16:40:02.095638+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:50:32.789209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098446+0000","last_change":"2023-05-15T16:40:00.753008+0000","last_active":"2023-05-15T16:40:02.098446+0000","last_peered":"2023-05-15T16:40:02.098446+0000","last_clean":"2023-05-15T16:40:02.098446+0000","last_became_active":"2023-05-15T16:40:00.752696+0000","last_became_peered":"2023-05-15T16:40:00.752696+0000","last_unstale":"2023-05-15T16:40:02.098446+0000","last_undegraded":"2023-05-15T16:40:02.098446+0000","last_fullsized":"2023-05-15T16:40:02.098446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:30:28.823039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095101+0000","last_change":"2023-05-15T16:40:01.102001+0000","last_active":"2023-05-15T16:40:02.095101+0000","last_peered":"2023-05-15T16:40:02.095101+0000","last_clean":"2023-05-15T16:40:02.095101+0000","last_became_active":"2023-05-15T16:40:01.101708+0000","last_became_peered":"2023-05-15T16:40:01.101708+0000","last_unstale":"2023-05-15T16:40:02.095101+0000","last_undegraded":"2023-05-15T16:40:02.095101+0000","last_fullsized":"2023-05-15T16:40:02.095101+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:13:33.110131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.280831+0000","last_change":"2023-05-15T16:40:01.161461+0000","last_active":"2023-05-15T16:40:02.280831+0000","last_peered":"2023-05-15T16:40:02.280831+0000","last_clean":"2023-05-15T16:40:02.280831+0000","last_became_active":"2023-05-15T16:40:01.160945+0000","last_became_peered":"2023-05-15T16:40:01.160945+0000","last_unstale":"2023-05-15T16:40:02.280831+0000","last_undegraded":"2023-05-15T16:40:02.280831+0000","last_fullsized":"2023-05-15T16:40:02.280831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:39:15.813849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095333+0000","last_change":"2023-05-15T16:40:00.740953+0000","last_active":"2023-05-15T16:40:02.095333+0000","last_peered":"2023-05-15T16:40:02.095333+0000","last_clean":"2023-05-15T16:40:02.095333+0000","last_became_active":"2023-05-15T16:40:00.739500+0000","last_became_peered":"2023-05-15T16:40:00.739500+0000","last_unstale":"2023-05-15T16:40:02.095333+0000","last_undegraded":"2023-05-15T16:40:02.095333+0000","last_fullsized":"2023-05-15T16:40:02.095333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:56:52.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097941+0000","last_change":"2023-05-15T16:40:01.147295+0000","last_active":"2023-05-15T16:40:02.097941+0000","last_peered":"2023-05-15T16:40:02.097941+0000","last_clean":"2023-05-15T16:40:02.097941+0000","last_became_active":"2023-05-15T16:40:01.146994+0000","last_became_peered":"2023-05-15T16:40:01.146994+0000","last_unstale":"2023-05-15T16:40:02.097941+0000","last_undegraded":"2023-05-15T16:40:02.097941+0000","last_fullsized":"2023-05-15T16:40:02.097941+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:13:33.110131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.279178+0000","last_change":"2023-05-15T16:40:00.733783+0000","last_active":"2023-05-15T16:40:02.279178+0000","last_peered":"2023-05-15T16:40:02.279178+0000","last_clean":"2023-05-15T16:40:02.279178+0000","last_became_active":"2023-05-15T16:40:00.733442+0000","last_became_peered":"2023-05-15T16:40:00.733442+0000","last_unstale":"2023-05-15T16:40:02.279178+0000","last_undegraded":"2023-05-15T16:40:02.279178+0000","last_fullsized":"2023-05-15T16:40:02.279178+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:56:52.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095487+0000","last_change":"2023-05-15T16:40:01.108561+0000","last_active":"2023-05-15T16:40:02.095487+0000","last_peered":"2023-05-15T16:40:02.095487+0000","last_clean":"2023-05-15T16:40:02.095487+0000","last_became_active":"2023-05-15T16:40:01.108286+0000","last_became_peered":"2023-05-15T16:40:01.108286+0000","last_unstale":"2023-05-15T16:40:02.095487+0000","last_undegraded":"2023-05-15T16:40:02.095487+0000","last_fullsized":"2023-05-15T16:40:02.095487+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:07:25.649507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099944+0000","last_change":"2023-05-15T16:40:00.748959+0000","last_active":"2023-05-15T16:40:02.099944+0000","last_peered":"2023-05-15T16:40:02.099944+0000","last_clean":"2023-05-15T16:40:02.099944+0000","last_became_active":"2023-05-15T16:40:00.744181+0000","last_became_peered":"2023-05-15T16:40:00.744181+0000","last_unstale":"2023-05-15T16:40:02.099944+0000","last_undegraded":"2023-05-15T16:40:02.099944+0000","last_fullsized":"2023-05-15T16:40:02.099944+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:30:28.823039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.278386+0000","last_change":"2023-05-15T16:40:01.111006+0000","last_active":"2023-05-15T16:40:02.278386+0000","last_peered":"2023-05-15T16:40:02.278386+0000","last_clean":"2023-05-15T16:40:02.278386+0000","last_became_active":"2023-05-15T16:40:01.110731+0000","last_became_peered":"2023-05-15T16:40:01.110731+0000","last_unstale":"2023-05-15T16:40:02.278386+0000","last_undegraded":"2023-05-15T16:40:02.278386+0000","last_fullsized":"2023-05-15T16:40:02.278386+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:21:30.182882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.097788+0000","last_change":"2023-05-15T16:40:00.760933+0000","last_active":"2023-05-15T16:40:02.097788+0000","last_peered":"2023-05-15T16:40:02.097788+0000","last_clean":"2023-05-15T16:40:02.097788+0000","last_became_active":"2023-05-15T16:40:00.760570+0000","last_became_peered":"2023-05-15T16:40:00.760570+0000","last_unstale":"2023-05-15T16:40:02.097788+0000","last_undegraded":"2023-05-15T16:40:02.097788+0000","last_fullsized":"2023-05-15T16:40:02.097788+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:51:41.940063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099449+0000","last_change":"2023-05-15T16:40:01.137937+0000","last_active":"2023-05-15T16:40:02.099449+0000","last_peered":"2023-05-15T16:40:02.099449+0000","last_clean":"2023-05-15T16:40:02.099449+0000","last_became_active":"2023-05-15T16:40:01.136661+0000","last_became_peered":"2023-05-15T16:40:01.136661+0000","last_unstale":"2023-05-15T16:40:02.099449+0000","last_undegraded":"2023-05-15T16:40:02.099449+0000","last_fullsized":"2023-05-15T16:40:02.099449+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:45:23.112789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282296+0000","last_change":"2023-05-15T16:40:00.765428+0000","last_active":"2023-05-15T16:40:02.282296+0000","last_peered":"2023-05-15T16:40:02.282296+0000","last_clean":"2023-05-15T16:40:02.282296+0000","last_became_active":"2023-05-15T16:40:00.764846+0000","last_became_peered":"2023-05-15T16:40:00.764846+0000","last_unstale":"2023-05-15T16:40:02.282296+0000","last_undegraded":"2023-05-15T16:40:02.282296+0000","last_fullsized":"2023-05-15T16:40:02.282296+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:56:13.804754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099659+0000","last_change":"2023-05-15T16:40:01.138011+0000","last_active":"2023-05-15T16:40:02.099659+0000","last_peered":"2023-05-15T16:40:02.099659+0000","last_clean":"2023-05-15T16:40:02.099659+0000","last_became_active":"2023-05-15T16:40:01.136847+0000","last_became_peered":"2023-05-15T16:40:01.136847+0000","last_unstale":"2023-05-15T16:40:02.099659+0000","last_undegraded":"2023-05-15T16:40:02.099659+0000","last_fullsized":"2023-05-15T16:40:02.099659+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:14:14.713803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"22'2","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.282986+0000","last_change":"2023-05-15T16:40:00.765361+0000","last_active":"2023-05-15T16:40:02.282986+0000","last_peered":"2023-05-15T16:40:02.282986+0000","last_clean":"2023-05-15T16:40:02.282986+0000","last_became_active":"2023-05-15T16:40:00.764881+0000","last_became_peered":"2023-05-15T16:40:00.764881+0000","last_unstale":"2023-05-15T16:40:02.282986+0000","last_undegraded":"2023-05-15T16:40:02.282986+0000","last_fullsized":"2023-05-15T16:40:02.282986+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:51:41.940063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095732+0000","last_change":"2023-05-15T16:40:01.102202+0000","last_active":"2023-05-15T16:40:02.095732+0000","last_peered":"2023-05-15T16:40:02.095732+0000","last_clean":"2023-05-15T16:40:02.095732+0000","last_became_active":"2023-05-15T16:40:01.101916+0000","last_became_peered":"2023-05-15T16:40:01.101916+0000","last_unstale":"2023-05-15T16:40:02.095732+0000","last_undegraded":"2023-05-15T16:40:02.095732+0000","last_fullsized":"2023-05-15T16:40:02.095732+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T21:26:45.774263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"22'1","reported_seq":12,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.095575+0000","last_change":"2023-05-15T16:40:00.736792+0000","last_active":"2023-05-15T16:40:02.095575+0000","last_peered":"2023-05-15T16:40:02.095575+0000","last_clean":"2023-05-15T16:40:02.095575+0000","last_became_active":"2023-05-15T16:40:00.736507+0000","last_became_peered":"2023-05-15T16:40:00.736507+0000","last_unstale":"2023-05-15T16:40:02.095575+0000","last_undegraded":"2023-05-15T16:40:02.095575+0000","last_fullsized":"2023-05-15T16:40:02.095575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:21:29.173379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.099100+0000","last_change":"2023-05-15T16:40:01.134199+0000","last_active":"2023-05-15T16:40:02.099100+0000","last_peered":"2023-05-15T16:40:02.099100+0000","last_clean":"2023-05-15T16:40:02.099100+0000","last_became_active":"2023-05-15T16:40:01.133481+0000","last_became_peered":"2023-05-15T16:40:01.133481+0000","last_unstale":"2023-05-15T16:40:02.099100+0000","last_undegraded":"2023-05-15T16:40:02.099100+0000","last_fullsized":"2023-05-15T16:40:02.099100+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:00.698778+0000","last_clean_scrub_stamp":"2023-05-15T16:40:00.698778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:57:14.492695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"22'4","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2023-05-15T16:40:02.098440+0000","last_change":"2023-05-15T16:40:00.753734+0000","last_active":"2023-05-15T16:40:02.098440+0000","last_peered":"2023-05-15T16:40:02.098440+0000","last_clean":"2023-05-15T16:40:02.098440+0000","last_became_active":"2023-05-15T16:40:00.753401+0000","last_became_peered":"2023-05-15T16:40:00.753401+0000","last_unstale":"2023-05-15T16:40:02.098440+0000","last_undegraded":"2023-05-15T16:40:02.098440+0000","last_fullsized":"2023-05-15T16:40:02.098440+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:59.689275+0000","last_clean_scrub_stamp":"2023-05-15T16:39:59.689275+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:56:52.337223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9108,"kb_used_data":844,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362732,"statfs":{"total":96636764160,"available":96627437568,"internally_reserved":0,"allocated":864256,"data_stored":681731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95599999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91300000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.876}]}]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7988,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363852,"statfs":{"total":96636764160,"available":96628584448,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94499999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.044}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98499999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1779999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7996,"kb_used_data":244,"kb_used_omap":0,"kb_used_meta":7744,"kb_avail":94363844,"statfs":{"total":96636764160,"available":96628576256,"internally_reserved":0,"allocated":249856,"data_stored":90235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7929856},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2190000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2649999999999999}]}]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8072,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363768,"statfs":{"total":96636764160,"available":96628498432,"internally_reserved":0,"allocated":262144,"data_stored":91203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0049999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8056,"kb_used_data":240,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363784,"statfs":{"total":96636764160,"available":96628514816,"internally_reserved":0,"allocated":245760,"data_stored":89689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80000000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1559999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.379}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.087}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.206}]}]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7924,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7680,"kb_avail":94363916,"statfs":{"total":96636764160,"available":96628649984,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7864320},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.621}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66500000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.393}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.347}]}]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8052,"kb_used_data":236,"kb_used_omap":0,"kb_used_meta":7808,"kb_avail":94363788,"statfs":{"total":96636764160,"available":96628518912,"internally_reserved":0,"allocated":241664,"data_stored":89599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7995392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82899999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9084,"kb_used_data":820,"kb_used_omap":0,"kb_used_meta":8256,"kb_avail":94362756,"statfs":{"total":96636764160,"available":96627462144,"internally_reserved":0,"allocated":839680,"data_stored":680533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8454144},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57399999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97999999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-15T16:40:13.873 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-05-15T16:40:13.874 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-05-15T16:40:13.874 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-05-15T16:40:13.874 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-05-15T16:40:14.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34fe3a7640 1 Processor -- start 2023-05-15T16:40:14.026 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34fe3a7640 1 -- start start 2023-05-15T16:40:14.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34fe3a7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f34f8071930 0x7f34f814b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34fe3a7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f34f8141960 0x7f34f8141de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34fe3a7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34f8147fe0 0x7f34f8148420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34fe3a7640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f8147b50 con 0x7f34f8141960 2023-05-15T16:40:14.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34fe3a7640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f814b590 con 0x7f34f8071930 2023-05-15T16:40:14.027 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34fe3a7640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f8148960 con 0x7f34f8147fe0 2023-05-15T16:40:14.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34f77fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f34f8141960 0x7f34f8141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34f77fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f34f8141960 0x7f34f8141de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43110/0 (socket says 172.21.15.62:43110) 2023-05-15T16:40:14.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34f77fe640 1 -- 172.21.15.62:0/2732728937 learned_addr learned my addr 172.21.15.62:0/2732728937 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:14.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34fc944640 1 --2- 172.21.15.62:0/2732728937 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34f8147fe0 0x7f34f8148420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34f7fff640 1 --2- 172.21.15.62:0/2732728937 >> v2:172.21.15.161:3300/0 conn(0x7f34f8071930 0x7f34f814b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34f77fe640 1 -- 172.21.15.62:0/2732728937 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34f8147fe0 msgr2=0x7f34f8148420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:14.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34f77fe640 1 --2- 172.21.15.62:0/2732728937 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34f8147fe0 0x7f34f8148420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34f77fe640 1 -- 172.21.15.62:0/2732728937 >> v2:172.21.15.161:3300/0 conn(0x7f34f8071930 msgr2=0x7f34f814b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:14.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34f77fe640 1 --2- 172.21.15.62:0/2732728937 >> v2:172.21.15.161:3300/0 conn(0x7f34f8071930 0x7f34f814b050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34f77fe640 1 -- 172.21.15.62:0/2732728937 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f814b7e0 con 0x7f34f8141960 2023-05-15T16:40:14.030 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34f77fe640 1 --2- 172.21.15.62:0/2732728937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34f8141960 0x7f34f8141de0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f34f80b9880 tx=0x7f34ec01c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=804bed8c70839d9c server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:14.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34f6ffd640 1 -- 172.21.15.62:0/2732728937 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec0a5740 con 0x7f34f8141960 2023-05-15T16:40:14.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34f6ffd640 1 -- 172.21.15.62:0/2732728937 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec0a58a0 con 0x7f34f8141960 2023-05-15T16:40:14.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.023+0000 7f34f6ffd640 1 -- 172.21.15.62:0/2732728937 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec0a5c30 con 0x7f34f8141960 2023-05-15T16:40:14.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fe3a7640 1 -- 172.21.15.62:0/2732728937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34f8141960 msgr2=0x7f34f8141de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:14.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fe3a7640 1 --2- 172.21.15.62:0/2732728937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34f8141960 0x7f34f8141de0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f34f80b9880 tx=0x7f34ec01c9d0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fe3a7640 1 -- 172.21.15.62:0/2732728937 shutdown_connections 2023-05-15T16:40:14.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fe3a7640 1 --2- 172.21.15.62:0/2732728937 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34f8147fe0 0x7f34f8148420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fe3a7640 1 --2- 172.21.15.62:0/2732728937 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34f8141960 0x7f34f8141de0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fe3a7640 1 --2- 172.21.15.62:0/2732728937 >> v2:172.21.15.161:3300/0 conn(0x7f34f8071930 0x7f34f814b050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fe3a7640 1 -- 172.21.15.62:0/2732728937 >> 172.21.15.62:0/2732728937 conn(0x7f34f806cfc0 msgr2=0x7f34f806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:14.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fe3a7640 1 -- 172.21.15.62:0/2732728937 shutdown_connections 2023-05-15T16:40:14.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fe3a7640 1 -- 172.21.15.62:0/2732728937 wait complete. 2023-05-15T16:40:14.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fe3a7640 1 Processor -- start 2023-05-15T16:40:14.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fe3a7640 1 -- start start 2023-05-15T16:40:14.034 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fe3a7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34f8071930 0x7f34f80bd2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fe3a7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34f8141960 0x7f34f8149ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fe3a7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34f8147fe0 0x7f34f814a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fe3a7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f80b6f40 con 0x7f34f8147fe0 2023-05-15T16:40:14.035 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fe3a7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f80b4e60 con 0x7f34f8071930 2023-05-15T16:40:14.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fe3a7640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f80b5120 con 0x7f34f8141960 2023-05-15T16:40:14.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fc944640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34f8147fe0 0x7f34f814a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fc944640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34f8147fe0 0x7f34f814a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43112/0 (socket says 172.21.15.62:43112) 2023-05-15T16:40:14.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fc944640 1 -- 172.21.15.62:0/795160076 learned_addr learned my addr 172.21.15.62:0/795160076 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:14.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34f77fe640 1 --2- 172.21.15.62:0/795160076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34f8141960 0x7f34f8149ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fc944640 1 -- 172.21.15.62:0/795160076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34f8141960 msgr2=0x7f34f8149ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:14.036 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fc944640 1 --2- 172.21.15.62:0/795160076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34f8141960 0x7f34f8149ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fc944640 1 -- 172.21.15.62:0/795160076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34f8071930 msgr2=0x7f34f80bd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:14.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34f7fff640 1 --2- 172.21.15.62:0/795160076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34f8071930 0x7f34f80bd2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fc944640 1 --2- 172.21.15.62:0/795160076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34f8071930 0x7f34f80bd2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fc944640 1 -- 172.21.15.62:0/795160076 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34ec009b30 con 0x7f34f8147fe0 2023-05-15T16:40:14.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34f77fe640 1 --2- 172.21.15.62:0/795160076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34f8141960 0x7f34f8149ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:14.037 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fc944640 1 --2- 172.21.15.62:0/795160076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34f8147fe0 0x7f34f814a3e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f34f000d560 tx=0x7f34f000da20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:14.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34f4ff9640 1 -- 172.21.15.62:0/795160076 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f00125f0 con 0x7f34f8147fe0 2023-05-15T16:40:14.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34f4ff9640 1 -- 172.21.15.62:0/795160076 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34f0012770 con 0x7f34f8147fe0 2023-05-15T16:40:14.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fe3a7640 1 -- 172.21.15.62:0/795160076 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f8071d00 con 0x7f34f8147fe0 2023-05-15T16:40:14.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34f4ff9640 1 -- 172.21.15.62:0/795160076 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34f0012b20 con 0x7f34f8147fe0 2023-05-15T16:40:14.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fe3a7640 1 -- 172.21.15.62:0/795160076 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f80b9610 con 0x7f34f8147fe0 2023-05-15T16:40:14.038 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.027+0000 7f34fe3a7640 1 -- 172.21.15.62:0/795160076 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f80b46c0 con 0x7f34f8147fe0 2023-05-15T16:40:14.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.031+0000 7f34f4ff9640 1 -- 172.21.15.62:0/795160076 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f34f0012c80 con 0x7f34f8147fe0 2023-05-15T16:40:14.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.031+0000 7f34f4ff9640 1 --2- 172.21.15.62:0/795160076 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f34e40653b0 0x7f34e4067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.039 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.031+0000 7f34f4ff9640 1 -- 172.21.15.62:0/795160076 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f34f0082c50 con 0x7f34f8147fe0 2023-05-15T16:40:14.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.031+0000 7f34f7fff640 1 --2- 172.21.15.62:0/795160076 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f34e40653b0 0x7f34e4067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.031+0000 7f34f7fff640 1 --2- 172.21.15.62:0/795160076 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f34e40653b0 0x7f34e4067860 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009790 tx=0x7f34e8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:14.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.035+0000 7f34f4ff9640 1 -- 172.21.15.62:0/795160076 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f34f0088020 con 0x7f34f8147fe0 2023-05-15T16:40:14.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.211+0000 7f34fe3a7640 1 -- 172.21.15.62:0/795160076 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f34f80b40b0 con 0x7f34f8147fe0 2023-05-15T16:40:14.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.211+0000 7f34f4ff9640 1 -- 172.21.15.62:0/795160076 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f34f0050960 con 0x7f34f8147fe0 2023-05-15T16:40:14.217 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:14.218 INFO:teuthology.orchestra.run.smithi062.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-05-15T16:40:14.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.215+0000 7f34fe3a7640 1 -- 172.21.15.62:0/795160076 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f34e40653b0 msgr2=0x7f34e4067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:14.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.215+0000 7f34fe3a7640 1 --2- 172.21.15.62:0/795160076 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f34e40653b0 0x7f34e4067860 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f34e8009790 tx=0x7f34e8008040 comp rx=0 tx=0).stop 2023-05-15T16:40:14.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.215+0000 7f34fe3a7640 1 -- 172.21.15.62:0/795160076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34f8147fe0 msgr2=0x7f34f814a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:14.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.215+0000 7f34fe3a7640 1 --2- 172.21.15.62:0/795160076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34f8147fe0 0x7f34f814a3e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f34f000d560 tx=0x7f34f000da20 comp rx=0 tx=0).stop 2023-05-15T16:40:14.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.215+0000 7f34fe3a7640 1 -- 172.21.15.62:0/795160076 shutdown_connections 2023-05-15T16:40:14.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.215+0000 7f34fe3a7640 1 --2- 172.21.15.62:0/795160076 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f34e40653b0 0x7f34e4067860 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.215+0000 7f34fe3a7640 1 --2- 172.21.15.62:0/795160076 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f34f8147fe0 0x7f34f814a3e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.215+0000 7f34fe3a7640 1 --2- 172.21.15.62:0/795160076 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f34f8141960 0x7f34f8149ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.215+0000 7f34fe3a7640 1 --2- 172.21.15.62:0/795160076 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f34f8071930 0x7f34f80bd2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.215+0000 7f34fe3a7640 1 -- 172.21.15.62:0/795160076 >> 172.21.15.62:0/795160076 conn(0x7f34f806cfc0 msgr2=0x7f34f80b9cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:14.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.215+0000 7f34fe3a7640 1 -- 172.21.15.62:0/795160076 shutdown_connections 2023-05-15T16:40:14.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.215+0000 7f34fe3a7640 1 -- 172.21.15.62:0/795160076 wait complete. 2023-05-15T16:40:14.235 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-05-15T16:40:14.235 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-15T16:40:14.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.347+0000 7fa1f73e4640 1 Processor -- start 2023-05-15T16:40:14.351 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.347+0000 7fa1f73e4640 1 -- start start 2023-05-15T16:40:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.347+0000 7fa1f73e4640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa1f01409a0 0x7fa1f01468d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.347+0000 7fa1f73e4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1f00b8e60 0x7fa1f014a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.347+0000 7fa1f73e4640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1f0147790 con 0x7fa1f0140d70 2023-05-15T16:40:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.347+0000 7fa1f73e4640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1f00ba440 con 0x7fa1f01409a0 2023-05-15T16:40:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.347+0000 7fa1f73e4640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f0146ef0 con 0x7fa1f00b8e60 2023-05-15T16:40:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.347+0000 7fa1f5180640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa1f01409a0 0x7fa1f01468d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.353 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.347+0000 7fa1f5180640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa1f01409a0 0x7fa1f01468d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43122/0 (socket says 172.21.15.62:43122) 2023-05-15T16:40:14.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.347+0000 7fa1f5180640 1 -- 172.21.15.62:0/396427861 learned_addr learned my addr 172.21.15.62:0/396427861 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:14.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.347+0000 7fa1f5981640 1 --2- 172.21.15.62:0/396427861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1f00b8e60 0x7fa1f014a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.347+0000 7fa1f5180640 1 -- 172.21.15.62:0/396427861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1f00b8e60 msgr2=0x7fa1f014a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:14.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.347+0000 7fa1f5180640 1 --2- 172.21.15.62:0/396427861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1f00b8e60 0x7fa1f014a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.347+0000 7fa1f5180640 1 -- 172.21.15.62:0/396427861 >> v1:172.21.15.161:6789/0 conn(0x7fa1f0140d70 legacy=0x7fa1f00b9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:14.354 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.347+0000 7fa1f5180640 1 -- 172.21.15.62:0/396427861 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1f01471d0 con 0x7fa1f01409a0 2023-05-15T16:40:14.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.351+0000 7fa1f5180640 1 --2- 172.21.15.62:0/396427861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1f01409a0 0x7fa1f01468d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec009870 tx=0x7fa1ec01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22c17fc6905229d4 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:14.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.351+0000 7fa1e7fff640 1 -- 172.21.15.62:0/396427861 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec0a8a30 con 0x7fa1f01409a0 2023-05-15T16:40:14.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.351+0000 7fa1e7fff640 1 -- 172.21.15.62:0/396427861 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1ec0a8b90 con 0x7fa1f01409a0 2023-05-15T16:40:14.355 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.351+0000 7fa1e7fff640 1 -- 172.21.15.62:0/396427861 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec0b0440 con 0x7fa1f01409a0 2023-05-15T16:40:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.351+0000 7fa1f73e4640 1 -- 172.21.15.62:0/396427861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1f01409a0 msgr2=0x7fa1f01468d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:14.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.351+0000 7fa1f73e4640 1 --2- 172.21.15.62:0/396427861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1f01409a0 0x7fa1f01468d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec009870 tx=0x7fa1ec01ed30 comp rx=0 tx=0).stop 2023-05-15T16:40:14.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.351+0000 7fa1f73e4640 1 -- 172.21.15.62:0/396427861 shutdown_connections 2023-05-15T16:40:14.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.351+0000 7fa1f73e4640 1 --2- 172.21.15.62:0/396427861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1f00b8e60 0x7fa1f014a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.351+0000 7fa1f73e4640 1 --2- 172.21.15.62:0/396427861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1f01409a0 0x7fa1f01468d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.351+0000 7fa1f73e4640 1 -- 172.21.15.62:0/396427861 >> 172.21.15.62:0/396427861 conn(0x7fa1f00bd830 msgr2=0x7fa1f00b9620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:14.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.351+0000 7fa1f73e4640 1 -- 172.21.15.62:0/396427861 shutdown_connections 2023-05-15T16:40:14.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.351+0000 7fa1f73e4640 1 -- 172.21.15.62:0/396427861 wait complete. 2023-05-15T16:40:14.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.351+0000 7fa1f73e4640 1 Processor -- start 2023-05-15T16:40:14.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.351+0000 7fa1f73e4640 1 -- start start 2023-05-15T16:40:14.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f73e4640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1f00b8e60 0x7fa1f01d2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.359 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f73e4640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1f01409a0 0x7fa1f01e1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f73e4640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1f0140d70 0x7fa1f013ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f73e4640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f00bc2f0 con 0x7fa1f01409a0 2023-05-15T16:40:14.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f73e4640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f0148360 con 0x7fa1f0140d70 2023-05-15T16:40:14.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f73e4640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1f0148de0 con 0x7fa1f00b8e60 2023-05-15T16:40:14.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f497f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1f01409a0 0x7fa1f01e1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f497f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1f01409a0 0x7fa1f01e1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43130/0 (socket says 172.21.15.62:43130) 2023-05-15T16:40:14.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f497f640 1 -- 172.21.15.62:0/2323447655 learned_addr learned my addr 172.21.15.62:0/2323447655 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f5180640 1 --2- 172.21.15.62:0/2323447655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1f00b8e60 0x7fa1f01d2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f5981640 1 --2- 172.21.15.62:0/2323447655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1f0140d70 0x7fa1f013ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f497f640 1 -- 172.21.15.62:0/2323447655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1f00b8e60 msgr2=0x7fa1f01d2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f497f640 1 --2- 172.21.15.62:0/2323447655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1f00b8e60 0x7fa1f01d2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f497f640 1 -- 172.21.15.62:0/2323447655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1f0140d70 msgr2=0x7fa1f013ceb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f497f640 1 --2- 172.21.15.62:0/2323447655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1f0140d70 0x7fa1f013ceb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f497f640 1 -- 172.21.15.62:0/2323447655 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1ec0094d0 con 0x7fa1f01409a0 2023-05-15T16:40:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f5981640 1 --2- 172.21.15.62:0/2323447655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1f0140d70 0x7fa1f013ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f497f640 1 --2- 172.21.15.62:0/2323447655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1f01409a0 0x7fa1f01e1d50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa1e000c3f0 tx=0x7fa1e000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1e5ffb640 1 -- 172.21.15.62:0/2323447655 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e00052d0 con 0x7fa1f01409a0 2023-05-15T16:40:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1e5ffb640 1 -- 172.21.15.62:0/2323447655 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1e0005430 con 0x7fa1f01409a0 2023-05-15T16:40:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f73e4640 1 -- 172.21.15.62:0/2323447655 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1f00b92e0 con 0x7fa1f01409a0 2023-05-15T16:40:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1e5ffb640 1 -- 172.21.15.62:0/2323447655 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1e0003840 con 0x7fa1f01409a0 2023-05-15T16:40:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f73e4640 1 -- 172.21.15.62:0/2323447655 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1f01474b0 con 0x7fa1f01409a0 2023-05-15T16:40:14.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f73e4640 1 -- 172.21.15.62:0/2323447655 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1f00b3bd0 con 0x7fa1f01409a0 2023-05-15T16:40:14.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1e5ffb640 1 -- 172.21.15.62:0/2323447655 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fa1e00039a0 con 0x7fa1f01409a0 2023-05-15T16:40:14.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1e5ffb640 1 --2- 172.21.15.62:0/2323447655 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa1d4065380 0x7fa1d4067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1e5ffb640 1 -- 172.21.15.62:0/2323447655 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa1e0081d40 con 0x7fa1f01409a0 2023-05-15T16:40:14.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.355+0000 7fa1f5180640 1 --2- 172.21.15.62:0/2323447655 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa1d4065380 0x7fa1d4067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.359+0000 7fa1f5180640 1 --2- 172.21.15.62:0/2323447655 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa1d4065380 0x7fa1d4067830 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0b2000 tx=0x7fa1ec008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:14.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.359+0000 7fa1e5ffb640 1 -- 172.21.15.62:0/2323447655 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fa1e004f9f0 con 0x7fa1f01409a0 2023-05-15T16:40:14.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.507+0000 7fa1f73e4640 1 -- 172.21.15.62:0/2323447655 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1f014a570 con 0x7fa1f01409a0 2023-05-15T16:40:14.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.511+0000 7fa1e5ffb640 1 -- 172.21.15.62:0/2323447655 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17811 (secure 0 0 0) 0x7fa1e0053010 con 0x7fa1f01409a0 2023-05-15T16:40:14.516 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:14.516 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:40:02.088078+0000","last_up_change":"2023-05-15T16:39:48.597049+0000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-15T16:39:49.394028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-15T16:39:55.208679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-15T16:39:59.547414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-15T16:40:00.055526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37594},{"type":"v1","addr":"172.21.15.62:6825","nonce":37594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37594},{"type":"v1","addr":"172.21.15.62:6827","nonce":37594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37594},{"type":"v1","addr":"172.21.15.62:6831","nonce":37594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37594},{"type":"v1","addr":"172.21.15.62:6829","nonce":37594}]},"public_addr":"172.21.15.62:6825/37594","cluster_addr":"172.21.15.62:6827/37594","heartbeat_back_addr":"172.21.15.62:6831/37594","heartbeat_front_addr":"172.21.15.62:6829/37594","state":["exists","up"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37592},{"type":"v1","addr":"172.21.15.62:6808","nonce":37592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":37592},{"type":"v1","addr":"172.21.15.62:6814","nonce":37592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6821","nonce":37592},{"type":"v1","addr":"172.21.15.62:6823","nonce":37592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37592},{"type":"v1","addr":"172.21.15.62:6818","nonce":37592}]},"public_addr":"172.21.15.62:6808/37592","cluster_addr":"172.21.15.62:6814/37592","heartbeat_back_addr":"172.21.15.62:6823/37592","heartbeat_front_addr":"172.21.15.62:6818/37592","state":["exists","up"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":37591},{"type":"v1","addr":"172.21.15.62:6810","nonce":37591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":37591},{"type":"v1","addr":"172.21.15.62:6815","nonce":37591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37591},{"type":"v1","addr":"172.21.15.62:6822","nonce":37591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":37591},{"type":"v1","addr":"172.21.15.62:6819","nonce":37591}]},"public_addr":"172.21.15.62:6810/37591","cluster_addr":"172.21.15.62:6815/37591","heartbeat_back_addr":"172.21.15.62:6822/37591","heartbeat_front_addr":"172.21.15.62:6819/37591","state":["exists","up"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37593},{"type":"v1","addr":"172.21.15.62:6801","nonce":37593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37593},{"type":"v1","addr":"172.21.15.62:6803","nonce":37593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":37593},{"type":"v1","addr":"172.21.15.62:6812","nonce":37593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37593},{"type":"v1","addr":"172.21.15.62:6805","nonce":37593}]},"public_addr":"172.21.15.62:6801/37593","cluster_addr":"172.21.15.62:6803/37593","heartbeat_back_addr":"172.21.15.62:6812/37593","heartbeat_front_addr":"172.21.15.62:6805/37593","state":["exists","up"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37854},{"type":"v1","addr":"172.21.15.161:6801","nonce":37854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37854},{"type":"v1","addr":"172.21.15.161:6803","nonce":37854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37854},{"type":"v1","addr":"172.21.15.161:6807","nonce":37854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37854},{"type":"v1","addr":"172.21.15.161:6805","nonce":37854}]},"public_addr":"172.21.15.161:6801/37854","cluster_addr":"172.21.15.161:6803/37854","heartbeat_back_addr":"172.21.15.161:6807/37854","heartbeat_front_addr":"172.21.15.161:6805/37854","state":["exists","up"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37855},{"type":"v1","addr":"172.21.15.161:6810","nonce":37855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37855},{"type":"v1","addr":"172.21.15.161:6815","nonce":37855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37855},{"type":"v1","addr":"172.21.15.161:6824","nonce":37855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37855},{"type":"v1","addr":"172.21.15.161:6820","nonce":37855}]},"public_addr":"172.21.15.161:6810/37855","cluster_addr":"172.21.15.161:6815/37855","heartbeat_back_addr":"172.21.15.161:6824/37855","heartbeat_front_addr":"172.21.15.161:6820/37855","state":["exists","up"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":37856},{"type":"v1","addr":"172.21.15.161:6814","nonce":37856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37856},{"type":"v1","addr":"172.21.15.161:6819","nonce":37856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":37856},{"type":"v1","addr":"172.21.15.161:6830","nonce":37856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37856},{"type":"v1","addr":"172.21.15.161:6826","nonce":37856}]},"public_addr":"172.21.15.161:6814/37856","cluster_addr":"172.21.15.161:6819/37856","heartbeat_back_addr":"172.21.15.161:6830/37856","heartbeat_front_addr":"172.21.15.161:6826/37856","state":["exists","up"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":37857},{"type":"v1","addr":"172.21.15.161:6813","nonce":37857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":37857},{"type":"v1","addr":"172.21.15.161:6821","nonce":37857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":37857},{"type":"v1","addr":"172.21.15.161:6831","nonce":37857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":37857},{"type":"v1","addr":"172.21.15.161:6827","nonce":37857}]},"public_addr":"172.21.15.161:6813/37857","cluster_addr":"172.21.15.161:6821/37857","heartbeat_back_addr":"172.21.15.161:6831/37857","heartbeat_front_addr":"172.21.15.161:6827/37857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.592907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.618143+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.641533+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.614355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.579293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.718353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.730135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.792887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:40:14.517 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.515+0000 7fa1f73e4640 1 -- 172.21.15.62:0/2323447655 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa1d4065380 msgr2=0x7fa1d4067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:14.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.515+0000 7fa1f73e4640 1 --2- 172.21.15.62:0/2323447655 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa1d4065380 0x7fa1d4067830 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec0b2000 tx=0x7fa1ec008040 comp rx=0 tx=0).stop 2023-05-15T16:40:14.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.515+0000 7fa1f73e4640 1 -- 172.21.15.62:0/2323447655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1f01409a0 msgr2=0x7fa1f01e1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:14.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.515+0000 7fa1f73e4640 1 --2- 172.21.15.62:0/2323447655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1f01409a0 0x7fa1f01e1d50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa1e000c3f0 tx=0x7fa1e000c8b0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.515+0000 7fa1f73e4640 1 -- 172.21.15.62:0/2323447655 shutdown_connections 2023-05-15T16:40:14.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.515+0000 7fa1f73e4640 1 --2- 172.21.15.62:0/2323447655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa1f0140d70 0x7fa1f013ceb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.515+0000 7fa1f73e4640 1 --2- 172.21.15.62:0/2323447655 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa1d4065380 0x7fa1d4067830 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.515+0000 7fa1f73e4640 1 --2- 172.21.15.62:0/2323447655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa1f01409a0 0x7fa1f01e1d50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.515+0000 7fa1f73e4640 1 --2- 172.21.15.62:0/2323447655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa1f00b8e60 0x7fa1f01d2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.515+0000 7fa1f73e4640 1 -- 172.21.15.62:0/2323447655 >> 172.21.15.62:0/2323447655 conn(0x7fa1f00bd830 msgr2=0x7fa1f01d3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:14.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.515+0000 7fa1f73e4640 1 -- 172.21.15.62:0/2323447655 shutdown_connections 2023-05-15T16:40:14.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.515+0000 7fa1f73e4640 1 -- 172.21.15.62:0/2323447655 wait complete. 2023-05-15T16:40:14.533 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-15T16:39:49.394028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-15T16:39:55.208679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-15T16:39:59.547414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-15T16:40:00.055526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-15T16:40:14.534 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-15T16:40:14.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd34b628640 1 Processor -- start 2023-05-15T16:40:14.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd34b628640 1 -- start start 2023-05-15T16:40:14.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd34b628640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd344144010 0x7fd34406c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd34b628640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3440bb660 con 0x7fd3440be450 2023-05-15T16:40:14.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd34b628640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3440b9070 con 0x7fd3440be080 2023-05-15T16:40:14.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd34b628640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34406c0d0 con 0x7fd344144010 2023-05-15T16:40:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd348bc3640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd3440be450 0x7fd344152600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:37948/0 (socket says 172.21.15.62:37948) 2023-05-15T16:40:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd348bc3640 1 -- 172.21.15.62:0/319455666 learned_addr learned my addr 172.21.15.62:0/319455666 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd349bc5640 1 --2- 172.21.15.62:0/319455666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd344144010 0x7fd34406c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd33bfff640 1 -- 172.21.15.62:0/319455666 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3936767618 0 0) 0x7fd3440bb660 con 0x7fd3440be450 2023-05-15T16:40:14.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd33bfff640 1 -- 172.21.15.62:0/319455666 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd330003530 con 0x7fd3440be450 2023-05-15T16:40:14.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd33bfff640 1 -- 172.21.15.62:0/319455666 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1991937253 0 0) 0x7fd330003530 con 0x7fd3440be450 2023-05-15T16:40:14.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd33bfff640 1 -- 172.21.15.62:0/319455666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd344144010 msgr2=0x7fd34406c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:14.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd33bfff640 1 --2- 172.21.15.62:0/319455666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd344144010 0x7fd34406c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd33bfff640 1 -- 172.21.15.62:0/319455666 >> v1:172.21.15.161:6789/0 conn(0x7fd3440be080 legacy=0x7fd344149cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:14.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd33bfff640 1 -- 172.21.15.62:0/319455666 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd34406b7c0 con 0x7fd3440be450 2023-05-15T16:40:14.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd33bfff640 1 -- 172.21.15.62:0/319455666 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7fd334001680 con 0x7fd3440be450 2023-05-15T16:40:14.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd33bfff640 1 -- 172.21.15.62:0/319455666 >> v1:172.21.15.62:6789/0 conn(0x7fd3440be450 legacy=0x7fd344152600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:14.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd33bfff640 1 --2- 172.21.15.62:0/319455666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3300039b0 0x7fd330003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd33bfff640 1 --2- 172.21.15.62:0/319455666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd344144010 0x7fd3300047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd33bfff640 1 --2- 172.21.15.62:0/319455666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd330004d10 0x7fd330005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd33bfff640 1 -- 172.21.15.62:0/319455666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34406c0d0 con 0x7fd330004d10 2023-05-15T16:40:14.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd33bfff640 1 -- 172.21.15.62:0/319455666 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33000bb30 con 0x7fd3300039b0 2023-05-15T16:40:14.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd33bfff640 1 -- 172.21.15.62:0/319455666 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33000bcf0 con 0x7fd344144010 2023-05-15T16:40:14.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd349bc5640 1 --2- 172.21.15.62:0/319455666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd330004d10 0x7fd330005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd3493c4640 1 --2- 172.21.15.62:0/319455666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3300039b0 0x7fd330003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd348bc3640 1 --2- 172.21.15.62:0/319455666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd344144010 0x7fd3300047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd349bc5640 1 -- 172.21.15.62:0/319455666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd344144010 msgr2=0x7fd3300047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:14.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd349bc5640 1 --2- 172.21.15.62:0/319455666 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd344144010 0x7fd3300047d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd349bc5640 1 -- 172.21.15.62:0/319455666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3300039b0 msgr2=0x7fd330003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:14.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd349bc5640 1 --2- 172.21.15.62:0/319455666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3300039b0 0x7fd330003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd349bc5640 1 -- 172.21.15.62:0/319455666 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd330003530 con 0x7fd330004d10 2023-05-15T16:40:14.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.655+0000 7fd3493c4640 1 --2- 172.21.15.62:0/319455666 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd3300039b0 0x7fd330003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:14.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd349bc5640 1 --2- 172.21.15.62:0/319455666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd330004d10 0x7fd330005180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009f90 tx=0x7fd33c01cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd2df0ea31927287 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:14.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd33bfff640 1 -- 172.21.15.62:0/319455666 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c0a5c30 con 0x7fd330004d10 2023-05-15T16:40:14.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd33bfff640 1 -- 172.21.15.62:0/319455666 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd33c00f040 con 0x7fd330004d10 2023-05-15T16:40:14.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd33bfff640 1 -- 172.21.15.62:0/319455666 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd33c0ad440 con 0x7fd330004d10 2023-05-15T16:40:14.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd34b628640 1 -- 172.21.15.62:0/319455666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd330004d10 msgr2=0x7fd330005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:14.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd34b628640 1 --2- 172.21.15.62:0/319455666 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd330004d10 0x7fd330005180 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd33c009f90 tx=0x7fd33c01cc20 comp rx=0 tx=0).stop 2023-05-15T16:40:14.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd349bc5640 1 -- 172.21.15.62:0/319455666 reap_dead start 2023-05-15T16:40:14.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd34b628640 1 -- 172.21.15.62:0/319455666 shutdown_connections 2023-05-15T16:40:14.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd34b628640 1 -- 172.21.15.62:0/319455666 >> 172.21.15.62:0/319455666 conn(0x7fd34406e480 msgr2=0x7fd34406e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:14.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd34b628640 1 -- 172.21.15.62:0/319455666 shutdown_connections 2023-05-15T16:40:14.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd34b628640 1 -- 172.21.15.62:0/319455666 wait complete. 2023-05-15T16:40:14.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd34b628640 1 Processor -- start 2023-05-15T16:40:14.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd34b628640 1 -- start start 2023-05-15T16:40:14.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd34b628640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd330004d10 0x7fd34414db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd34b628640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3441dfab0 0x7fd3441dff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.669 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd34b628640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd34413ef80 0x7fd34413f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd34b628640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34414c740 con 0x7fd3441dfab0 2023-05-15T16:40:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd34b628640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd34414e080 con 0x7fd330004d10 2023-05-15T16:40:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd34b628640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd34414c180 con 0x7fd34413ef80 2023-05-15T16:40:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd348bc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3441dfab0 0x7fd3441dff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd348bc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3441dfab0 0x7fd3441dff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43156/0 (socket says 172.21.15.62:43156) 2023-05-15T16:40:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd348bc3640 1 -- 172.21.15.62:0/1983734325 learned_addr learned my addr 172.21.15.62:0/1983734325 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:14.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd348bc3640 1 -- 172.21.15.62:0/1983734325 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd34413ef80 msgr2=0x7fd34413f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd348bc3640 1 --2- 172.21.15.62:0/1983734325 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd34413ef80 0x7fd34413f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd348bc3640 1 -- 172.21.15.62:0/1983734325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd330004d10 msgr2=0x7fd34414db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd348bc3640 1 --2- 172.21.15.62:0/1983734325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd330004d10 0x7fd34414db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd348bc3640 1 -- 172.21.15.62:0/1983734325 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3440b8d90 con 0x7fd3441dfab0 2023-05-15T16:40:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd348bc3640 1 --2- 172.21.15.62:0/1983734325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3441dfab0 0x7fd3441dff20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd33400d810 tx=0x7fd33400dcd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd339ffb640 1 -- 172.21.15.62:0/1983734325 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3340074e0 con 0x7fd3441dfab0 2023-05-15T16:40:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd339ffb640 1 -- 172.21.15.62:0/1983734325 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd334007640 con 0x7fd3441dfab0 2023-05-15T16:40:14.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd34b628640 1 -- 172.21.15.62:0/1983734325 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd34406b550 con 0x7fd3441dfab0 2023-05-15T16:40:14.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd339ffb640 1 -- 172.21.15.62:0/1983734325 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd334004a30 con 0x7fd3441dfab0 2023-05-15T16:40:14.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.659+0000 7fd34b628640 1 -- 172.21.15.62:0/1983734325 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd34406bd60 con 0x7fd3441dfab0 2023-05-15T16:40:14.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.663+0000 7fd34b628640 1 -- 172.21.15.62:0/1983734325 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd344067960 con 0x7fd3441dfab0 2023-05-15T16:40:14.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.663+0000 7fd339ffb640 1 -- 172.21.15.62:0/1983734325 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fd334004b90 con 0x7fd3441dfab0 2023-05-15T16:40:14.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.663+0000 7fd339ffb640 1 --2- 172.21.15.62:0/1983734325 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd3280653b0 0x7fd328067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.663+0000 7fd339ffb640 1 -- 172.21.15.62:0/1983734325 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fd334082250 con 0x7fd3441dfab0 2023-05-15T16:40:14.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.663+0000 7fd3493c4640 1 --2- 172.21.15.62:0/1983734325 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd3280653b0 0x7fd328067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.663+0000 7fd3493c4640 1 --2- 172.21.15.62:0/1983734325 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd3280653b0 0x7fd328067860 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd340001700 tx=0x7fd340009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:14.673 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.667+0000 7fd339ffb640 1 -- 172.21.15.62:0/1983734325 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fd33404fe40 con 0x7fd3441dfab0 2023-05-15T16:40:14.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.811+0000 7fd34b628640 1 -- 172.21.15.62:0/1983734325 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd34413f930 con 0x7fd3441dfab0 2023-05-15T16:40:14.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.815+0000 7fd339ffb640 1 -- 172.21.15.62:0/1983734325 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd334019020 con 0x7fd3441dfab0 2023-05-15T16:40:14.819 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-05-15T16:40:14.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.815+0000 7fd34b628640 1 -- 172.21.15.62:0/1983734325 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd3280653b0 msgr2=0x7fd328067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:14.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.815+0000 7fd34b628640 1 --2- 172.21.15.62:0/1983734325 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd3280653b0 0x7fd328067860 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd340001700 tx=0x7fd340009040 comp rx=0 tx=0).stop 2023-05-15T16:40:14.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.815+0000 7fd34b628640 1 -- 172.21.15.62:0/1983734325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3441dfab0 msgr2=0x7fd3441dff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.815+0000 7fd34b628640 1 --2- 172.21.15.62:0/1983734325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3441dfab0 0x7fd3441dff20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd33400d810 tx=0x7fd33400dcd0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.815+0000 7fd34b628640 1 -- 172.21.15.62:0/1983734325 shutdown_connections 2023-05-15T16:40:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.815+0000 7fd34b628640 1 --2- 172.21.15.62:0/1983734325 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd34413ef80 0x7fd34413f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.815+0000 7fd34b628640 1 --2- 172.21.15.62:0/1983734325 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd3280653b0 0x7fd328067860 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.815+0000 7fd34b628640 1 --2- 172.21.15.62:0/1983734325 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd3441dfab0 0x7fd3441dff20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.815+0000 7fd34b628640 1 --2- 172.21.15.62:0/1983734325 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd330004d10 0x7fd34414db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.815+0000 7fd34b628640 1 -- 172.21.15.62:0/1983734325 >> 172.21.15.62:0/1983734325 conn(0x7fd34406e480 msgr2=0x7fd3440ba5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:14.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.815+0000 7fd34b628640 1 -- 172.21.15.62:0/1983734325 shutdown_connections 2023-05-15T16:40:14.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.815+0000 7fd34b628640 1 -- 172.21.15.62:0/1983734325 wait complete. 2023-05-15T16:40:14.836 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-15T16:40:14.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5ce1055640 1 Processor -- start 2023-05-15T16:40:14.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5ce1055640 1 -- start start 2023-05-15T16:40:14.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5ce1055640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc0b3080 0x7f5cdc0b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5ce1055640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5cdc147c30 0x7f5cdc1524f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5ce1055640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cdc0b7400 con 0x7f5cdc0b4100 2023-05-15T16:40:14.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5ce1055640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cdc0b4e70 con 0x7f5cdc147c30 2023-05-15T16:40:14.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5ce1055640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc142380 con 0x7f5cdc0b3080 2023-05-15T16:40:14.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cdad9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f5cdc0b4100 0x7f5cdc141c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58090/0 (socket says 172.21.15.62:58090) 2023-05-15T16:40:14.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cdad9d640 1 -- 172.21.15.62:0/1364759250 learned_addr learned my addr 172.21.15.62:0/1364759250 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:14.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cda59c640 1 --2- 172.21.15.62:0/1364759250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc0b3080 0x7f5cdc0b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cdb59e640 1 --2- 172.21.15.62:0/1364759250 >> v2:172.21.15.161:3300/0 conn(0x7f5cdc147c30 0x7f5cdc1524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cd9d9b640 1 -- 172.21.15.62:0/1364759250 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698767550 0 0) 0x7f5cdc0b7400 con 0x7f5cdc0b4100 2023-05-15T16:40:14.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cd9d9b640 1 -- 172.21.15.62:0/1364759250 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cc4003530 con 0x7f5cdc0b4100 2023-05-15T16:40:14.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cd9d9b640 1 -- 172.21.15.62:0/1364759250 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 84187826 0 0) 0x7f5cc4003530 con 0x7f5cdc0b4100 2023-05-15T16:40:14.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cd9d9b640 1 -- 172.21.15.62:0/1364759250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc0b3080 msgr2=0x7f5cdc0b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:14.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cd9d9b640 1 --2- 172.21.15.62:0/1364759250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc0b3080 0x7f5cdc0b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cd9d9b640 1 -- 172.21.15.62:0/1364759250 >> v2:172.21.15.161:3300/0 conn(0x7f5cdc147c30 msgr2=0x7f5cdc1524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:14.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cd9d9b640 1 --2- 172.21.15.62:0/1364759250 >> v2:172.21.15.161:3300/0 conn(0x7f5cdc147c30 0x7f5cdc1524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cd9d9b640 1 -- 172.21.15.62:0/1364759250 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc0b6640 con 0x7f5cdc0b4100 2023-05-15T16:40:14.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cd9d9b640 1 -- 172.21.15.62:0/1364759250 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7f5cd4001a00 con 0x7f5cdc0b4100 2023-05-15T16:40:14.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cd9d9b640 1 -- 172.21.15.62:0/1364759250 >> v1:172.21.15.62:6789/0 conn(0x7f5cdc0b4100 legacy=0x7f5cdc141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:14.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cd9d9b640 1 --2- 172.21.15.62:0/1364759250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cc4003980 0x7f5cc4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cd9d9b640 1 --2- 172.21.15.62:0/1364759250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc0b3080 0x7f5cc40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cd9d9b640 1 --2- 172.21.15.62:0/1364759250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc4004d10 0x7f5cc4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cd9d9b640 1 -- 172.21.15.62:0/1364759250 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc0b4e70 con 0x7f5cc4004d10 2023-05-15T16:40:14.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cd9d9b640 1 -- 172.21.15.62:0/1364759250 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc142380 con 0x7f5cc4003980 2023-05-15T16:40:14.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cd9d9b640 1 -- 172.21.15.62:0/1364759250 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc400b990 con 0x7f5cdc0b3080 2023-05-15T16:40:14.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cdb59e640 1 --2- 172.21.15.62:0/1364759250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc4004d10 0x7f5cc4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cdad9d640 1 --2- 172.21.15.62:0/1364759250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cc4003980 0x7f5cc4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cda59c640 1 --2- 172.21.15.62:0/1364759250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc0b3080 0x7f5cc40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cdb59e640 1 -- 172.21.15.62:0/1364759250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc0b3080 msgr2=0x7f5cc40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:14.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cdb59e640 1 --2- 172.21.15.62:0/1364759250 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc0b3080 0x7f5cc40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cdb59e640 1 -- 172.21.15.62:0/1364759250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cc4003980 msgr2=0x7f5cc4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cdb59e640 1 --2- 172.21.15.62:0/1364759250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cc4003980 0x7f5cc4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cdb59e640 1 -- 172.21.15.62:0/1364759250 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc4003530 con 0x7f5cc4004d10 2023-05-15T16:40:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.959+0000 7f5cdad9d640 1 --2- 172.21.15.62:0/1364759250 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cc4003980 0x7f5cc4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5cdb59e640 1 --2- 172.21.15.62:0/1364759250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc4004d10 0x7f5cc4005180 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009ae0 tx=0x7f5ccc01ca90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=306697ddfd5f351e server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5cd9d9b640 1 -- 172.21.15.62:0/1364759250 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0a5680 con 0x7f5cc4004d10 2023-05-15T16:40:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5cd9d9b640 1 -- 172.21.15.62:0/1364759250 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ccc0a57e0 con 0x7f5cc4004d10 2023-05-15T16:40:14.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5cd9d9b640 1 -- 172.21.15.62:0/1364759250 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ccc0a5b90 con 0x7f5cc4004d10 2023-05-15T16:40:14.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5ce1055640 1 -- 172.21.15.62:0/1364759250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc4004d10 msgr2=0x7f5cc4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:14.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5ce1055640 1 --2- 172.21.15.62:0/1364759250 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cc4004d10 0x7f5cc4005180 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc009ae0 tx=0x7f5ccc01ca90 comp rx=0 tx=0).stop 2023-05-15T16:40:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5cdb59e640 1 -- 172.21.15.62:0/1364759250 reap_dead start 2023-05-15T16:40:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5ce1055640 1 -- 172.21.15.62:0/1364759250 shutdown_connections 2023-05-15T16:40:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5ce1055640 1 -- 172.21.15.62:0/1364759250 >> 172.21.15.62:0/1364759250 conn(0x7f5cdc0697b0 msgr2=0x7f5cdc069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5ce1055640 1 -- 172.21.15.62:0/1364759250 shutdown_connections 2023-05-15T16:40:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5ce1055640 1 -- 172.21.15.62:0/1364759250 wait complete. 2023-05-15T16:40:14.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5ce1055640 1 Processor -- start 2023-05-15T16:40:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5ce1055640 1 -- start start 2023-05-15T16:40:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5ce1055640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc148fd0 0x7f5cdc14ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5ce1055640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cdc1e2480 0x7f5cdc0b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5ce1055640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cdc0b10b0 0x7f5cdc0b1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5ce1055640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc14b250 con 0x7f5cdc1e2480 2023-05-15T16:40:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5ce1055640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc13a040 con 0x7f5cdc0b10b0 2023-05-15T16:40:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5ce1055640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cdc139dc0 con 0x7f5cdc148fd0 2023-05-15T16:40:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5cda59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cdc1e2480 0x7f5cdc0b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5cda59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cdc1e2480 0x7f5cdc0b0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48452/0 (socket says 172.21.15.62:48452) 2023-05-15T16:40:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5cda59c640 1 -- 172.21.15.62:0/4277857681 learned_addr learned my addr 172.21.15.62:0/4277857681 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5cdad9d640 1 --2- 172.21.15.62:0/4277857681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc148fd0 0x7f5cdc14ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5cda59c640 1 -- 172.21.15.62:0/4277857681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc148fd0 msgr2=0x7f5cdc14ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:14.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5cda59c640 1 --2- 172.21.15.62:0/4277857681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc148fd0 0x7f5cdc14ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5cda59c640 1 -- 172.21.15.62:0/4277857681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cdc0b10b0 msgr2=0x7f5cdc0b1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:14.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5cda59c640 1 --2- 172.21.15.62:0/4277857681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cdc0b10b0 0x7f5cdc0b1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:14.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5cda59c640 1 -- 172.21.15.62:0/4277857681 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cdc0b6c00 con 0x7f5cdc1e2480 2023-05-15T16:40:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5cda59c640 1 --2- 172.21.15.62:0/4277857681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cdc1e2480 0x7f5cdc0b0b70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5cd00115c0 tx=0x7f5cd0011a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5cc37fe640 1 -- 172.21.15.62:0/4277857681 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0004220 con 0x7f5cdc1e2480 2023-05-15T16:40:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5cc37fe640 1 -- 172.21.15.62:0/4277857681 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cd0004380 con 0x7f5cdc1e2480 2023-05-15T16:40:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5ce1055640 1 -- 172.21.15.62:0/4277857681 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cdc0b6920 con 0x7f5cdc1e2480 2023-05-15T16:40:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5cc37fe640 1 -- 172.21.15.62:0/4277857681 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cd0015870 con 0x7f5cdc1e2480 2023-05-15T16:40:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.963+0000 7f5ce1055640 1 -- 172.21.15.62:0/4277857681 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cdc0b6ee0 con 0x7f5cdc1e2480 2023-05-15T16:40:14.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.967+0000 7f5ce1055640 1 -- 172.21.15.62:0/4277857681 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cdc067960 con 0x7f5cdc1e2480 2023-05-15T16:40:14.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.967+0000 7f5cc37fe640 1 -- 172.21.15.62:0/4277857681 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f5cd00159d0 con 0x7f5cdc1e2480 2023-05-15T16:40:14.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.967+0000 7f5cc37fe640 1 --2- 172.21.15.62:0/4277857681 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5cc8065380 0x7f5cc8067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:14.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.967+0000 7f5cc37fe640 1 -- 172.21.15.62:0/4277857681 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5cd0082db0 con 0x7f5cdc1e2480 2023-05-15T16:40:14.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.967+0000 7f5cdad9d640 1 --2- 172.21.15.62:0/4277857681 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5cc8065380 0x7f5cc8067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:14.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.967+0000 7f5cdad9d640 1 --2- 172.21.15.62:0/4277857681 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5cc8065380 0x7f5cc8067830 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4001b30 tx=0x7f5cd4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:14.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:14.971+0000 7f5cc37fe640 1 -- 172.21.15.62:0/4277857681 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f5cd0050a30 con 0x7f5cdc1e2480 2023-05-15T16:40:15.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.119+0000 7f5ce1055640 1 -- 172.21.15.62:0/4277857681 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5cdc04dbe0 con 0x7f5cdc1e2480 2023-05-15T16:40:15.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.119+0000 7f5cc37fe640 1 -- 172.21.15.62:0/4277857681 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5cd0054050 con 0x7f5cdc1e2480 2023-05-15T16:40:15.123 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-05-15T16:40:15.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.119+0000 7f5ce1055640 1 -- 172.21.15.62:0/4277857681 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5cc8065380 msgr2=0x7f5cc8067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:15.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.119+0000 7f5ce1055640 1 --2- 172.21.15.62:0/4277857681 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5cc8065380 0x7f5cc8067830 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4001b30 tx=0x7f5cd4009040 comp rx=0 tx=0).stop 2023-05-15T16:40:15.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.119+0000 7f5ce1055640 1 -- 172.21.15.62:0/4277857681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cdc1e2480 msgr2=0x7f5cdc0b0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:15.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.119+0000 7f5ce1055640 1 --2- 172.21.15.62:0/4277857681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cdc1e2480 0x7f5cdc0b0b70 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5cd00115c0 tx=0x7f5cd0011a80 comp rx=0 tx=0).stop 2023-05-15T16:40:15.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.119+0000 7f5ce1055640 1 -- 172.21.15.62:0/4277857681 shutdown_connections 2023-05-15T16:40:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.119+0000 7f5ce1055640 1 --2- 172.21.15.62:0/4277857681 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5cdc0b10b0 0x7f5cdc0b1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.119+0000 7f5ce1055640 1 --2- 172.21.15.62:0/4277857681 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5cc8065380 0x7f5cc8067830 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.119+0000 7f5ce1055640 1 --2- 172.21.15.62:0/4277857681 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5cdc1e2480 0x7f5cdc0b0b70 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.119+0000 7f5ce1055640 1 --2- 172.21.15.62:0/4277857681 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5cdc148fd0 0x7f5cdc14ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.119+0000 7f5ce1055640 1 -- 172.21.15.62:0/4277857681 >> 172.21.15.62:0/4277857681 conn(0x7f5cdc0697b0 msgr2=0x7f5cdc0b7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.119+0000 7f5ce1055640 1 -- 172.21.15.62:0/4277857681 shutdown_connections 2023-05-15T16:40:15.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.123+0000 7f5ce1055640 1 -- 172.21.15.62:0/4277857681 wait complete. 2023-05-15T16:40:15.141 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-15T16:40:15.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.251+0000 7f6032e06640 1 Processor -- start 2023-05-15T16:40:15.257 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.251+0000 7f6032e06640 1 -- start start 2023-05-15T16:40:15.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.255+0000 7f6032e06640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f602c141fc0 0x7f602c0b8c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:15.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.255+0000 7f6032e06640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f602c06e430 0x7f602c070610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:15.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.255+0000 7f6032e06640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f602c0b49e0 con 0x7f602c14b080 2023-05-15T16:40:15.258 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.255+0000 7f6032e06640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602c0b3ea0 con 0x7f602c06e430 2023-05-15T16:40:15.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.255+0000 7f6032e06640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f602c0a3f00 con 0x7f602c141fc0 2023-05-15T16:40:15.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.255+0000 7f60313a3640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f602c14b080 0x7f602c14b470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58100/0 (socket says 172.21.15.62:58100) 2023-05-15T16:40:15.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.255+0000 7f602bfff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f602c06e430 0x7f602c070610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:15.259 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.255+0000 7f60313a3640 1 -- 172.21.15.62:0/3598058239 learned_addr learned my addr 172.21.15.62:0/3598058239 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:15.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.255+0000 7f6030ba2640 1 --2- 172.21.15.62:0/3598058239 >> v2:172.21.15.161:3300/0 conn(0x7f602c141fc0 0x7f602c0b8c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:15.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.255+0000 7f602bfff640 1 -- 172.21.15.62:0/3598058239 >> v2:172.21.15.161:3300/0 conn(0x7f602c141fc0 msgr2=0x7f602c0b8c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:15.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.255+0000 7f602bfff640 1 --2- 172.21.15.62:0/3598058239 >> v2:172.21.15.161:3300/0 conn(0x7f602c141fc0 0x7f602c0b8c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.255+0000 7f602bfff640 1 -- 172.21.15.62:0/3598058239 >> v1:172.21.15.62:6789/0 conn(0x7f602c14b080 legacy=0x7f602c14b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:15.260 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.255+0000 7f602bfff640 1 -- 172.21.15.62:0/3598058239 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602c0b40b0 con 0x7f602c06e430 2023-05-15T16:40:15.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.255+0000 7f602b7fe640 1 -- 172.21.15.62:0/3598058239 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 287741448 0 0) 0x7f602c0b49e0 con 0x7f602c14b080 2023-05-15T16:40:15.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.255+0000 7f602bfff640 1 --2- 172.21.15.62:0/3598058239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f602c06e430 0x7f602c070610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f602c071510 tx=0x7f602001c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c23100f635ab80ca server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:15.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.255+0000 7f602b7fe640 1 -- 172.21.15.62:0/3598058239 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60200a7070 con 0x7f602c06e430 2023-05-15T16:40:15.262 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.255+0000 7f602b7fe640 1 -- 172.21.15.62:0/3598058239 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60200ab430 con 0x7f602c06e430 2023-05-15T16:40:15.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.255+0000 7f602b7fe640 1 -- 172.21.15.62:0/3598058239 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60200ab7c0 con 0x7f602c06e430 2023-05-15T16:40:15.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6032e06640 1 -- 172.21.15.62:0/3598058239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f602c06e430 msgr2=0x7f602c070610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:15.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6032e06640 1 --2- 172.21.15.62:0/3598058239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f602c06e430 0x7f602c070610 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f602c071510 tx=0x7f602001c430 comp rx=0 tx=0).stop 2023-05-15T16:40:15.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6032e06640 1 -- 172.21.15.62:0/3598058239 shutdown_connections 2023-05-15T16:40:15.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6032e06640 1 --2- 172.21.15.62:0/3598058239 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f602c06e430 0x7f602c070610 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6032e06640 1 --2- 172.21.15.62:0/3598058239 >> v2:172.21.15.161:3300/0 conn(0x7f602c141fc0 0x7f602c0b8c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6032e06640 1 -- 172.21.15.62:0/3598058239 >> 172.21.15.62:0/3598058239 conn(0x7f602c0bdde0 msgr2=0x7f602c0be1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:15.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6032e06640 1 -- 172.21.15.62:0/3598058239 shutdown_connections 2023-05-15T16:40:15.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6032e06640 1 -- 172.21.15.62:0/3598058239 wait complete. 2023-05-15T16:40:15.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6032e06640 1 Processor -- start 2023-05-15T16:40:15.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6032e06640 1 -- start start 2023-05-15T16:40:15.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6032e06640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f602c06e430 0x7f602c142670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:15.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6032e06640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f602c141fc0 0x7f602c143b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:15.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6032e06640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f602c14b080 0x7f602c135ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:15.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6032e06640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c142bb0 con 0x7f602c06e430 2023-05-15T16:40:15.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6032e06640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c0b7060 con 0x7f602c141fc0 2023-05-15T16:40:15.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6032e06640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602c143600 con 0x7f602c14b080 2023-05-15T16:40:15.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6030ba2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f602c06e430 0x7f602c142670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:15.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6030ba2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f602c06e430 0x7f602c142670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48476/0 (socket says 172.21.15.62:48476) 2023-05-15T16:40:15.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6030ba2640 1 -- 172.21.15.62:0/3483237886 learned_addr learned my addr 172.21.15.62:0/3483237886 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:15.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f602bfff640 1 --2- 172.21.15.62:0/3483237886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f602c141fc0 0x7f602c143b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:15.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f60313a3640 1 --2- 172.21.15.62:0/3483237886 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f602c14b080 0x7f602c135ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:15.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6030ba2640 1 -- 172.21.15.62:0/3483237886 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f602c14b080 msgr2=0x7f602c135ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:15.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6030ba2640 1 --2- 172.21.15.62:0/3483237886 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f602c14b080 0x7f602c135ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6030ba2640 1 -- 172.21.15.62:0/3483237886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f602c141fc0 msgr2=0x7f602c143b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6030ba2640 1 --2- 172.21.15.62:0/3483237886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f602c141fc0 0x7f602c143b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6030ba2640 1 -- 172.21.15.62:0/3483237886 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6020009420 con 0x7f602c06e430 2023-05-15T16:40:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6030ba2640 1 --2- 172.21.15.62:0/3483237886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f602c06e430 0x7f602c142670 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f601800e930 tx=0x7f601800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f60297fa640 1 -- 172.21.15.62:0/3483237886 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6018009690 con 0x7f602c06e430 2023-05-15T16:40:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f60297fa640 1 -- 172.21.15.62:0/3483237886 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601800ca00 con 0x7f602c06e430 2023-05-15T16:40:15.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6032e06640 1 -- 172.21.15.62:0/3483237886 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602c070ce0 con 0x7f602c06e430 2023-05-15T16:40:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f60297fa640 1 -- 172.21.15.62:0/3483237886 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601800cd70 con 0x7f602c06e430 2023-05-15T16:40:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6032e06640 1 -- 172.21.15.62:0/3483237886 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602c070b50 con 0x7f602c06e430 2023-05-15T16:40:15.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.259+0000 7f6032e06640 1 -- 172.21.15.62:0/3483237886 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602c154b60 con 0x7f602c06e430 2023-05-15T16:40:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.263+0000 7f60297fa640 1 -- 172.21.15.62:0/3483237886 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f6018013470 con 0x7f602c06e430 2023-05-15T16:40:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.263+0000 7f60297fa640 1 --2- 172.21.15.62:0/3483237886 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6010065380 0x7f6010067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.263+0000 7f60297fa640 1 -- 172.21.15.62:0/3483237886 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6018082b70 con 0x7f602c06e430 2023-05-15T16:40:15.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.263+0000 7f602bfff640 1 --2- 172.21.15.62:0/3483237886 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6010065380 0x7f6010067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:15.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.263+0000 7f602bfff640 1 --2- 172.21.15.62:0/3483237886 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6010065380 0x7f6010067830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f60200af000 tx=0x7f60200a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:15.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.267+0000 7f60297fa640 1 -- 172.21.15.62:0/3483237886 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f60180507c0 con 0x7f602c06e430 2023-05-15T16:40:15.416 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.411+0000 7f6032e06640 1 -- 172.21.15.62:0/3483237886 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f602c0b6ec0 con 0x7f602c06e430 2023-05-15T16:40:15.417 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.411+0000 7f60297fa640 1 -- 172.21.15.62:0/3483237886 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f602c0b6ec0 con 0x7f602c06e430 2023-05-15T16:40:15.417 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-05-15T16:40:15.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.415+0000 7f6032e06640 1 -- 172.21.15.62:0/3483237886 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6010065380 msgr2=0x7f6010067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:15.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.415+0000 7f6032e06640 1 --2- 172.21.15.62:0/3483237886 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6010065380 0x7f6010067830 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f60200af000 tx=0x7f60200a7000 comp rx=0 tx=0).stop 2023-05-15T16:40:15.419 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.415+0000 7f6032e06640 1 -- 172.21.15.62:0/3483237886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f602c06e430 msgr2=0x7f602c142670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:15.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.415+0000 7f6032e06640 1 --2- 172.21.15.62:0/3483237886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f602c06e430 0x7f602c142670 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f601800e930 tx=0x7f601800edf0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.415+0000 7f6032e06640 1 -- 172.21.15.62:0/3483237886 shutdown_connections 2023-05-15T16:40:15.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.415+0000 7f6032e06640 1 --2- 172.21.15.62:0/3483237886 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f602c14b080 0x7f602c135ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.415+0000 7f6032e06640 1 --2- 172.21.15.62:0/3483237886 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f602c141fc0 0x7f602c143b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.415+0000 7f6032e06640 1 --2- 172.21.15.62:0/3483237886 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6010065380 0x7f6010067830 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.415+0000 7f6032e06640 1 --2- 172.21.15.62:0/3483237886 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f602c06e430 0x7f602c142670 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.415+0000 7f6032e06640 1 -- 172.21.15.62:0/3483237886 >> 172.21.15.62:0/3483237886 conn(0x7f602c0bdde0 msgr2=0x7f602c148e10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:15.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.415+0000 7f6032e06640 1 -- 172.21.15.62:0/3483237886 shutdown_connections 2023-05-15T16:40:15.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.415+0000 7f6032e06640 1 -- 172.21.15.62:0/3483237886 wait complete. 2023-05-15T16:40:15.434 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-15T16:40:15.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.551+0000 7ff87ac06640 1 Processor -- start 2023-05-15T16:40:15.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.551+0000 7ff87ac06640 1 -- start start 2023-05-15T16:40:15.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.551+0000 7ff87ac06640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8740b7910 0x7ff8740b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:15.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.551+0000 7ff87ac06640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff874144880 con 0x7ff87414f4c0 2023-05-15T16:40:15.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.551+0000 7ff87ac06640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8740b3220 con 0x7ff8740b5e70 2023-05-15T16:40:15.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.551+0000 7ff87ac06640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8740b5a50 con 0x7ff8740b7910 2023-05-15T16:40:15.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.551+0000 7ff8791a3640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff87414f4c0 0x7ff8741518a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58110/0 (socket says 172.21.15.62:58110) 2023-05-15T16:40:15.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.551+0000 7ff8791a3640 1 -- 172.21.15.62:0/3891455812 learned_addr learned my addr 172.21.15.62:0/3891455812 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:15.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8789a2640 1 --2- 172.21.15.62:0/3891455812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8740b7910 0x7ff8740b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8737fe640 1 -- 172.21.15.62:0/3891455812 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430335704 0 0) 0x7ff874144880 con 0x7ff87414f4c0 2023-05-15T16:40:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8737fe640 1 -- 172.21.15.62:0/3891455812 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff85c003530 con 0x7ff87414f4c0 2023-05-15T16:40:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8737fe640 1 -- 172.21.15.62:0/3891455812 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 523646282 0 0) 0x7ff85c003530 con 0x7ff87414f4c0 2023-05-15T16:40:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8737fe640 1 -- 172.21.15.62:0/3891455812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8740b7910 msgr2=0x7ff8740b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:15.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8737fe640 1 --2- 172.21.15.62:0/3891455812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8740b7910 0x7ff8740b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8737fe640 1 -- 172.21.15.62:0/3891455812 >> v1:172.21.15.161:6789/0 conn(0x7ff8740b5e70 legacy=0x7ff874144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8737fe640 1 -- 172.21.15.62:0/3891455812 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8740b4710 con 0x7ff87414f4c0 2023-05-15T16:40:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8737fe640 1 -- 172.21.15.62:0/3891455812 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7ff86c001a00 con 0x7ff87414f4c0 2023-05-15T16:40:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8737fe640 1 -- 172.21.15.62:0/3891455812 >> v1:172.21.15.62:6789/0 conn(0x7ff87414f4c0 legacy=0x7ff8741518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8737fe640 1 --2- 172.21.15.62:0/3891455812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff85c0039b0 0x7ff85c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8737fe640 1 --2- 172.21.15.62:0/3891455812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff85c0047d0 0x7ff85c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:15.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8737fe640 1 --2- 172.21.15.62:0/3891455812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8740b7910 0x7ff85c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:15.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8737fe640 1 -- 172.21.15.62:0/3891455812 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8740b5a50 con 0x7ff85c0039b0 2023-05-15T16:40:15.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8737fe640 1 -- 172.21.15.62:0/3891455812 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c00bb00 con 0x7ff85c0047d0 2023-05-15T16:40:15.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8737fe640 1 -- 172.21.15.62:0/3891455812 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff85c00bcc0 con 0x7ff8740b7910 2023-05-15T16:40:15.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8789a2640 1 --2- 172.21.15.62:0/3891455812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff85c0039b0 0x7ff85c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:15.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff873fff640 1 --2- 172.21.15.62:0/3891455812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff85c0047d0 0x7ff85c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:15.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8791a3640 1 --2- 172.21.15.62:0/3891455812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8740b7910 0x7ff85c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:15.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8789a2640 1 -- 172.21.15.62:0/3891455812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8740b7910 msgr2=0x7ff85c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:15.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8789a2640 1 --2- 172.21.15.62:0/3891455812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8740b7910 0x7ff85c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8789a2640 1 -- 172.21.15.62:0/3891455812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff85c0047d0 msgr2=0x7ff85c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:15.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8789a2640 1 --2- 172.21.15.62:0/3891455812 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff85c0047d0 0x7ff85c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8789a2640 1 -- 172.21.15.62:0/3891455812 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff85c003530 con 0x7ff85c0039b0 2023-05-15T16:40:15.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8791a3640 1 --2- 172.21.15.62:0/3891455812 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff8740b7910 0x7ff85c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:15.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8789a2640 1 --2- 172.21.15.62:0/3891455812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff85c0039b0 0x7ff85c003dc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff86400de10 tx=0x7ff864020aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7296fd38e33b1b43 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:15.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8737fe640 1 -- 172.21.15.62:0/3891455812 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86400d2d0 con 0x7ff85c0039b0 2023-05-15T16:40:15.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8737fe640 1 -- 172.21.15.62:0/3891455812 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff864013040 con 0x7ff85c0039b0 2023-05-15T16:40:15.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8737fe640 1 -- 172.21.15.62:0/3891455812 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8640a9af0 con 0x7ff85c0039b0 2023-05-15T16:40:15.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff87ac06640 1 -- 172.21.15.62:0/3891455812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff85c0039b0 msgr2=0x7ff85c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:15.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff87ac06640 1 --2- 172.21.15.62:0/3891455812 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff85c0039b0 0x7ff85c003dc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff86400de10 tx=0x7ff864020aa0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff8791a3640 1 -- 172.21.15.62:0/3891455812 reap_dead start 2023-05-15T16:40:15.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff87ac06640 1 -- 172.21.15.62:0/3891455812 shutdown_connections 2023-05-15T16:40:15.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff87ac06640 1 -- 172.21.15.62:0/3891455812 >> 172.21.15.62:0/3891455812 conn(0x7ff8740697b0 msgr2=0x7ff874069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:15.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff87ac06640 1 -- 172.21.15.62:0/3891455812 shutdown_connections 2023-05-15T16:40:15.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.555+0000 7ff87ac06640 1 -- 172.21.15.62:0/3891455812 wait complete. 2023-05-15T16:40:15.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff87ac06640 1 Processor -- start 2023-05-15T16:40:15.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff87ac06640 1 -- start start 2023-05-15T16:40:15.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff87ac06640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff85c0039b0 0x7ff87406e360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:15.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff87ac06640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff874146ea0 0x7ff87406e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:15.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff87ac06640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8741dae00 0x7ff8741db270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:15.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff87ac06640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff874071270 con 0x7ff8741dae00 2023-05-15T16:40:15.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff87ac06640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff87406ee10 con 0x7ff874146ea0 2023-05-15T16:40:15.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff87ac06640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff87406f040 con 0x7ff85c0039b0 2023-05-15T16:40:15.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff8791a3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8741dae00 0x7ff8741db270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:15.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff8791a3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8741dae00 0x7ff8741db270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48486/0 (socket says 172.21.15.62:48486) 2023-05-15T16:40:15.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff8791a3640 1 -- 172.21.15.62:0/3739626079 learned_addr learned my addr 172.21.15.62:0/3739626079 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:15.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff8789a2640 1 --2- 172.21.15.62:0/3739626079 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff85c0039b0 0x7ff87406e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:15.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff873fff640 1 --2- 172.21.15.62:0/3739626079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff874146ea0 0x7ff87406e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:15.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff8791a3640 1 -- 172.21.15.62:0/3739626079 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff85c0039b0 msgr2=0x7ff87406e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:15.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff8791a3640 1 --2- 172.21.15.62:0/3739626079 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff85c0039b0 0x7ff87406e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff8791a3640 1 -- 172.21.15.62:0/3739626079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff874146ea0 msgr2=0x7ff87406e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:15.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff8791a3640 1 --2- 172.21.15.62:0/3739626079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff874146ea0 0x7ff87406e8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff8791a3640 1 -- 172.21.15.62:0/3739626079 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8740b2a90 con 0x7ff8741dae00 2023-05-15T16:40:15.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff873fff640 1 --2- 172.21.15.62:0/3739626079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff874146ea0 0x7ff87406e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:15.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff8791a3640 1 --2- 172.21.15.62:0/3739626079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8741dae00 0x7ff8741db270 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff86c001340 tx=0x7ff86c010bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:15.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff8717fa640 1 -- 172.21.15.62:0/3739626079 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c012670 con 0x7ff8741dae00 2023-05-15T16:40:15.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff8717fa640 1 -- 172.21.15.62:0/3739626079 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff86c0127d0 con 0x7ff8741dae00 2023-05-15T16:40:15.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff87ac06640 1 -- 172.21.15.62:0/3739626079 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8740b34c0 con 0x7ff8741dae00 2023-05-15T16:40:15.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff8717fa640 1 -- 172.21.15.62:0/3739626079 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff86c012b60 con 0x7ff8741dae00 2023-05-15T16:40:15.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff87ac06640 1 -- 172.21.15.62:0/3739626079 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8740b2cf0 con 0x7ff8741dae00 2023-05-15T16:40:15.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff87ac06640 1 -- 172.21.15.62:0/3739626079 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8740705f0 con 0x7ff8741dae00 2023-05-15T16:40:15.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.559+0000 7ff8717fa640 1 -- 172.21.15.62:0/3739626079 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7ff86c012cc0 con 0x7ff8741dae00 2023-05-15T16:40:15.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.563+0000 7ff8717fa640 1 --2- 172.21.15.62:0/3739626079 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff8600653b0 0x7ff860067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:15.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.563+0000 7ff8717fa640 1 -- 172.21.15.62:0/3739626079 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff86c084f40 con 0x7ff8741dae00 2023-05-15T16:40:15.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.563+0000 7ff8789a2640 1 --2- 172.21.15.62:0/3739626079 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff8600653b0 0x7ff860067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:15.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.563+0000 7ff8789a2640 1 --2- 172.21.15.62:0/3739626079 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff8600653b0 0x7ff860067860 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff8640b2000 tx=0x7ff864004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:15.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.567+0000 7ff8717fa640 1 -- 172.21.15.62:0/3739626079 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7ff8740705f0 con 0x7ff8741dae00 2023-05-15T16:40:15.724 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.719+0000 7ff87ac06640 1 -- 172.21.15.62:0/3739626079 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff8740705f0 con 0x7ff8741dae00 2023-05-15T16:40:15.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.719+0000 7ff8717fa640 1 -- 172.21.15.62:0/3739626079 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff8740705f0 con 0x7ff8741dae00 2023-05-15T16:40:15.726 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-05-15T16:40:15.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.723+0000 7ff87ac06640 1 -- 172.21.15.62:0/3739626079 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff8600653b0 msgr2=0x7ff860067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:15.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.723+0000 7ff87ac06640 1 --2- 172.21.15.62:0/3739626079 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff8600653b0 0x7ff860067860 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff8640b2000 tx=0x7ff864004740 comp rx=0 tx=0).stop 2023-05-15T16:40:15.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.723+0000 7ff87ac06640 1 -- 172.21.15.62:0/3739626079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8741dae00 msgr2=0x7ff8741db270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:15.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.723+0000 7ff87ac06640 1 --2- 172.21.15.62:0/3739626079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8741dae00 0x7ff8741db270 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff86c001340 tx=0x7ff86c010bd0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.723+0000 7ff87ac06640 1 -- 172.21.15.62:0/3739626079 shutdown_connections 2023-05-15T16:40:15.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.723+0000 7ff87ac06640 1 --2- 172.21.15.62:0/3739626079 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff8600653b0 0x7ff860067860 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.723+0000 7ff87ac06640 1 --2- 172.21.15.62:0/3739626079 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff8741dae00 0x7ff8741db270 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.723+0000 7ff87ac06640 1 --2- 172.21.15.62:0/3739626079 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff874146ea0 0x7ff87406e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.723+0000 7ff87ac06640 1 --2- 172.21.15.62:0/3739626079 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff85c0039b0 0x7ff87406e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.723+0000 7ff87ac06640 1 -- 172.21.15.62:0/3739626079 >> 172.21.15.62:0/3739626079 conn(0x7ff8740697b0 msgr2=0x7ff8740b9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:15.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.723+0000 7ff87ac06640 1 -- 172.21.15.62:0/3739626079 shutdown_connections 2023-05-15T16:40:15.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.723+0000 7ff87ac06640 1 -- 172.21.15.62:0/3739626079 wait complete. 2023-05-15T16:40:15.744 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-15T16:40:15.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.855+0000 7f7bdc43c640 1 Processor -- start 2023-05-15T16:40:15.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.855+0000 7f7bdc43c640 1 -- start start 2023-05-15T16:40:15.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.859+0000 7f7bdc43c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7bd40b1d70 0x7f7bd4146090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:15.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.859+0000 7f7bdc43c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7bd40b2500 0x7f7bd40b4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:15.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.859+0000 7f7bdc43c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7bd40b91d0 0x7f7bd40b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:15.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.859+0000 7f7bdc43c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd40b2990 con 0x7f7bd40b2500 2023-05-15T16:40:15.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.859+0000 7f7bdc43c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bd40b2140 con 0x7f7bd40b91d0 2023-05-15T16:40:15.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.859+0000 7f7bdc43c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40b4ba0 con 0x7f7bd40b1d70 2023-05-15T16:40:15.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.859+0000 7f7bd99d7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7bd40b2500 0x7f7bd40b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:15.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.859+0000 7f7bd99d7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f7bd40b2500 0x7f7bd40b4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48500/0 (socket says 172.21.15.62:48500) 2023-05-15T16:40:15.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.859+0000 7f7bd99d7640 1 -- 172.21.15.62:0/3291770580 learned_addr learned my addr 172.21.15.62:0/3291770580 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:15.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.859+0000 7f7bda9d9640 1 --2- 172.21.15.62:0/3291770580 >> v2:172.21.15.161:3300/0 conn(0x7f7bd40b91d0 0x7f7bd40b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:15.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.859+0000 7f7bda1d8640 1 --2- 172.21.15.62:0/3291770580 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7bd40b1d70 0x7f7bd4146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:15.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.859+0000 7f7bd99d7640 1 -- 172.21.15.62:0/3291770580 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7bd40b1d70 msgr2=0x7f7bd4146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:15.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.859+0000 7f7bd99d7640 1 --2- 172.21.15.62:0/3291770580 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7bd40b1d70 0x7f7bd4146090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.859+0000 7f7bd99d7640 1 -- 172.21.15.62:0/3291770580 >> v2:172.21.15.161:3300/0 conn(0x7f7bd40b91d0 msgr2=0x7f7bd40b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:15.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.859+0000 7f7bd99d7640 1 --2- 172.21.15.62:0/3291770580 >> v2:172.21.15.161:3300/0 conn(0x7f7bd40b91d0 0x7f7bd40b4660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.859+0000 7f7bd99d7640 1 -- 172.21.15.62:0/3291770580 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd40b3060 con 0x7f7bd40b2500 2023-05-15T16:40:15.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.859+0000 7f7bd99d7640 1 --2- 172.21.15.62:0/3291770580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bd40b2500 0x7f7bd40b4120 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40b8f60 tx=0x7f7bd001c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e61d842e1f2f7d79 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:15.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.859+0000 7f7bd91d6640 1 -- 172.21.15.62:0/3291770580 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd00ab610 con 0x7f7bd40b2500 2023-05-15T16:40:15.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.859+0000 7f7bd91d6640 1 -- 172.21.15.62:0/3291770580 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd00ab770 con 0x7f7bd40b2500 2023-05-15T16:40:15.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.859+0000 7f7bd91d6640 1 -- 172.21.15.62:0/3291770580 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd00abb00 con 0x7f7bd40b2500 2023-05-15T16:40:15.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bdc43c640 1 -- 172.21.15.62:0/3291770580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bd40b2500 msgr2=0x7f7bd40b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:15.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bdc43c640 1 --2- 172.21.15.62:0/3291770580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bd40b2500 0x7f7bd40b4120 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f7bd40b8f60 tx=0x7f7bd001c4d0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bdc43c640 1 -- 172.21.15.62:0/3291770580 shutdown_connections 2023-05-15T16:40:15.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bdc43c640 1 --2- 172.21.15.62:0/3291770580 >> v2:172.21.15.161:3300/0 conn(0x7f7bd40b91d0 0x7f7bd40b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bdc43c640 1 --2- 172.21.15.62:0/3291770580 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bd40b2500 0x7f7bd40b4120 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bdc43c640 1 --2- 172.21.15.62:0/3291770580 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7bd40b1d70 0x7f7bd4146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bdc43c640 1 -- 172.21.15.62:0/3291770580 >> 172.21.15.62:0/3291770580 conn(0x7f7bd40653f0 msgr2=0x7f7bd40697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:15.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bdc43c640 1 -- 172.21.15.62:0/3291770580 shutdown_connections 2023-05-15T16:40:15.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bdc43c640 1 -- 172.21.15.62:0/3291770580 wait complete. 2023-05-15T16:40:15.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bdc43c640 1 Processor -- start 2023-05-15T16:40:15.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bdc43c640 1 -- start start 2023-05-15T16:40:15.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bdc43c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7bd40b1d70 0x7f7bd40b9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:15.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bdc43c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bd40b2500 0x7f7bd41e2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:15.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bdc43c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7bd40b91d0 0x7f7bd41e3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:15.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bdc43c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40ba160 con 0x7f7bd40b2500 2023-05-15T16:40:15.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bdc43c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40bb0e0 con 0x7f7bd40b1d70 2023-05-15T16:40:15.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bdc43c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bd40bbbf0 con 0x7f7bd40b91d0 2023-05-15T16:40:15.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bd99d7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bd40b2500 0x7f7bd41e2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:15.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bd99d7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bd40b2500 0x7f7bd41e2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48516/0 (socket says 172.21.15.62:48516) 2023-05-15T16:40:15.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bd99d7640 1 -- 172.21.15.62:0/235676486 learned_addr learned my addr 172.21.15.62:0/235676486 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:15.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bda9d9640 1 --2- 172.21.15.62:0/235676486 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7bd40b91d0 0x7f7bd41e3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:15.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bda1d8640 1 --2- 172.21.15.62:0/235676486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7bd40b1d70 0x7f7bd40b9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bd99d7640 1 -- 172.21.15.62:0/235676486 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7bd40b91d0 msgr2=0x7f7bd41e3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bd99d7640 1 --2- 172.21.15.62:0/235676486 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7bd40b91d0 0x7f7bd41e3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bd99d7640 1 -- 172.21.15.62:0/235676486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7bd40b1d70 msgr2=0x7f7bd40b9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bd99d7640 1 --2- 172.21.15.62:0/235676486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7bd40b1d70 0x7f7bd40b9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bd99d7640 1 -- 172.21.15.62:0/235676486 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd00094d0 con 0x7f7bd40b2500 2023-05-15T16:40:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bda9d9640 1 --2- 172.21.15.62:0/235676486 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7bd40b91d0 0x7f7bd41e3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bd99d7640 1 --2- 172.21.15.62:0/235676486 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bd40b2500 0x7f7bd41e2be0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7bd001ab80 tx=0x7f7bd001ad10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:15.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bc6ffd640 1 -- 172.21.15.62:0/235676486 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd00ab610 con 0x7f7bd40b2500 2023-05-15T16:40:15.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bc6ffd640 1 -- 172.21.15.62:0/235676486 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd00b4800 con 0x7f7bd40b2500 2023-05-15T16:40:15.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bdc43c640 1 -- 172.21.15.62:0/235676486 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bd41495e0 con 0x7f7bd40b2500 2023-05-15T16:40:15.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bc6ffd640 1 -- 172.21.15.62:0/235676486 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd00b4b90 con 0x7f7bd40b2500 2023-05-15T16:40:15.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bdc43c640 1 -- 172.21.15.62:0/235676486 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bd40b3b40 con 0x7f7bd40b2500 2023-05-15T16:40:15.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.863+0000 7f7bdc43c640 1 -- 172.21.15.62:0/235676486 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bd4149770 con 0x7f7bd40b2500 2023-05-15T16:40:15.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.867+0000 7f7bc6ffd640 1 -- 172.21.15.62:0/235676486 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f7bd00b4cf0 con 0x7f7bd40b2500 2023-05-15T16:40:15.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.867+0000 7f7bc6ffd640 1 --2- 172.21.15.62:0/235676486 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7bb8065380 0x7f7bb8067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:15.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.867+0000 7f7bc6ffd640 1 -- 172.21.15.62:0/235676486 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7bd011ca70 con 0x7f7bd40b2500 2023-05-15T16:40:15.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.867+0000 7f7bda1d8640 1 --2- 172.21.15.62:0/235676486 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7bb8065380 0x7f7bb8067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:15.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.867+0000 7f7bda1d8640 1 --2- 172.21.15.62:0/235676486 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7bb8065380 0x7f7bb8067830 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8009790 tx=0x7f7bc8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:15.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:15.871+0000 7f7bc6ffd640 1 -- 172.21.15.62:0/235676486 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f7bd00ea660 con 0x7f7bd40b2500 2023-05-15T16:40:16.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.055+0000 7f7bdc43c640 1 -- 172.21.15.62:0/235676486 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7bd40b5420 con 0x7f7bd40b2500 2023-05-15T16:40:16.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.055+0000 7f7bc6ffd640 1 -- 172.21.15.62:0/235676486 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3889 (secure 0 0 0) 0x7f7bd00edc80 con 0x7f7bd40b2500 2023-05-15T16:40:16.060 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:16.061 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1731611654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1731611654},{"type":"v1","addr":"172.21.15.161:6835","nonce":1731611654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2563537601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2563537601},{"type":"v1","addr":"172.21.15.62:6834","nonce":2563537601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-15T16:40:01.085500+0000","modified":"2023-05-15T16:40:03.744733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/2804159919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2804159919},{"type":"v1","addr":"172.21.15.62:6835","nonce":2804159919}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-15T16:40:16.061 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 7 2023-05-15T16:40:16.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.059+0000 7f7bdc43c640 1 -- 172.21.15.62:0/235676486 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7bb8065380 msgr2=0x7f7bb8067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:16.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.059+0000 7f7bdc43c640 1 --2- 172.21.15.62:0/235676486 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7bb8065380 0x7f7bb8067830 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7bc8009790 tx=0x7f7bc8008040 comp rx=0 tx=0).stop 2023-05-15T16:40:16.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.059+0000 7f7bdc43c640 1 -- 172.21.15.62:0/235676486 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bd40b2500 msgr2=0x7f7bd41e2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:16.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.059+0000 7f7bdc43c640 1 --2- 172.21.15.62:0/235676486 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bd40b2500 0x7f7bd41e2be0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f7bd001ab80 tx=0x7f7bd001ad10 comp rx=0 tx=0).stop 2023-05-15T16:40:16.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.059+0000 7f7bdc43c640 1 -- 172.21.15.62:0/235676486 shutdown_connections 2023-05-15T16:40:16.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.059+0000 7f7bdc43c640 1 --2- 172.21.15.62:0/235676486 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7bd40b91d0 0x7f7bd41e3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.059+0000 7f7bdc43c640 1 --2- 172.21.15.62:0/235676486 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7bb8065380 0x7f7bb8067830 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.059+0000 7f7bdc43c640 1 --2- 172.21.15.62:0/235676486 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7bd40b2500 0x7f7bd41e2be0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.059+0000 7f7bdc43c640 1 --2- 172.21.15.62:0/235676486 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7bd40b1d70 0x7f7bd40b9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.059+0000 7f7bdc43c640 1 -- 172.21.15.62:0/235676486 >> 172.21.15.62:0/235676486 conn(0x7f7bd40653f0 msgr2=0x7f7bd41445b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:16.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.059+0000 7f7bdc43c640 1 -- 172.21.15.62:0/235676486 shutdown_connections 2023-05-15T16:40:16.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.059+0000 7f7bdc43c640 1 -- 172.21.15.62:0/235676486 wait complete. 2023-05-15T16:40:16.384 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-15T16:40:01.085500+0000', 'modified': '2023-05-15T16:40:03.744733+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4263}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4263': {'gid': 4263, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/2804159919', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6833', 'nonce': 2804159919}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 2804159919}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-15T16:40:16.385 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-15T16:40:16.385 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-05-15T16:40:16.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.515+0000 7f7b2cd21640 1 Processor -- start 2023-05-15T16:40:16.521 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.515+0000 7f7b2cd21640 1 -- start start 2023-05-15T16:40:16.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.515+0000 7f7b2cd21640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b28140b30 0x7f7b280b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.515+0000 7f7b2cd21640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7b28071a00 0x7f7b280b7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.515+0000 7f7b2cd21640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b280b3660 con 0x7f7b28149df0 2023-05-15T16:40:16.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.515+0000 7f7b2cd21640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b280afd30 con 0x7f7b28071a00 2023-05-15T16:40:16.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.515+0000 7f7b2cd21640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280b3330 con 0x7f7b28140b30 2023-05-15T16:40:16.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.519+0000 7f7b26d9d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7b28071a00 0x7f7b280b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.519+0000 7f7b25d9b640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7b28149df0 0x7f7b280b3af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.62:53336/0 (socket says 172.21.15.62:53336) 2023-05-15T16:40:16.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.519+0000 7f7b2659c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b28140b30 0x7f7b280b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.519+0000 7f7b25d9b640 1 -- 172.21.15.62:0/1587843527 learned_addr learned my addr 172.21.15.62:0/1587843527 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:16.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.519+0000 7f7b2559a640 1 -- 172.21.15.62:0/1587843527 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 666734989 0 0) 0x7f7b280b3660 con 0x7f7b28149df0 2023-05-15T16:40:16.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.519+0000 7f7b2559a640 1 -- 172.21.15.62:0/1587843527 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b10003530 con 0x7f7b28149df0 2023-05-15T16:40:16.525 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.519+0000 7f7b2659c640 1 -- 172.21.15.62:0/1587843527 >> v2:172.21.15.161:3300/0 conn(0x7f7b28071a00 msgr2=0x7f7b280b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:16.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.519+0000 7f7b2659c640 1 --2- 172.21.15.62:0/1587843527 >> v2:172.21.15.161:3300/0 conn(0x7f7b28071a00 0x7f7b280b7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.519+0000 7f7b2659c640 1 -- 172.21.15.62:0/1587843527 >> v1:172.21.15.161:6789/0 conn(0x7f7b28149df0 legacy=0x7f7b280b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:16.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.519+0000 7f7b2659c640 1 -- 172.21.15.62:0/1587843527 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b280b4fd0 con 0x7f7b28140b30 2023-05-15T16:40:16.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.519+0000 7f7b26d9d640 1 --2- 172.21.15.62:0/1587843527 >> v2:172.21.15.161:3300/0 conn(0x7f7b28071a00 0x7f7b280b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-15T16:40:16.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.519+0000 7f7b2659c640 1 --2- 172.21.15.62:0/1587843527 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b28140b30 0x7f7b280b4920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7b180097c0 tx=0x7f7b1801ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54f0e46f52887475 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:16.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2559a640 1 -- 172.21.15.62:0/1587843527 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b180a8970 con 0x7f7b28140b30 2023-05-15T16:40:16.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2559a640 1 -- 172.21.15.62:0/1587843527 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b180a8ad0 con 0x7f7b28140b30 2023-05-15T16:40:16.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2559a640 1 -- 172.21.15.62:0/1587843527 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b180a8e40 con 0x7f7b28140b30 2023-05-15T16:40:16.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2cd21640 1 -- 172.21.15.62:0/1587843527 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b28140b30 msgr2=0x7f7b280b4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:16.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2cd21640 1 --2- 172.21.15.62:0/1587843527 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b28140b30 0x7f7b280b4920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7b180097c0 tx=0x7f7b1801ec70 comp rx=0 tx=0).stop 2023-05-15T16:40:16.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2cd21640 1 -- 172.21.15.62:0/1587843527 shutdown_connections 2023-05-15T16:40:16.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2cd21640 1 --2- 172.21.15.62:0/1587843527 >> v2:172.21.15.161:3300/0 conn(0x7f7b28071a00 0x7f7b280b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2cd21640 1 --2- 172.21.15.62:0/1587843527 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b28140b30 0x7f7b280b4920 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2cd21640 1 -- 172.21.15.62:0/1587843527 >> 172.21.15.62:0/1587843527 conn(0x7f7b280653f0 msgr2=0x7f7b280697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:16.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2cd21640 1 -- 172.21.15.62:0/1587843527 shutdown_connections 2023-05-15T16:40:16.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2cd21640 1 -- 172.21.15.62:0/1587843527 wait complete. 2023-05-15T16:40:16.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2cd21640 1 Processor -- start 2023-05-15T16:40:16.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2cd21640 1 -- start start 2023-05-15T16:40:16.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2cd21640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b28071a00 0x7f7b28147630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2cd21640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b28140b30 0x7f7b280ba860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2cd21640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b28149df0 0x7f7b281dc090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2cd21640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280bada0 con 0x7f7b28071a00 2023-05-15T16:40:16.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2cd21640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280bc320 con 0x7f7b28149df0 2023-05-15T16:40:16.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2cd21640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b28144130 con 0x7f7b28140b30 2023-05-15T16:40:16.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2659c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b28071a00 0x7f7b28147630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2659c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b28071a00 0x7f7b28147630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48524/0 (socket says 172.21.15.62:48524) 2023-05-15T16:40:16.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2659c640 1 -- 172.21.15.62:0/2999199376 learned_addr learned my addr 172.21.15.62:0/2999199376 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:16.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b25d9b640 1 --2- 172.21.15.62:0/2999199376 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b28140b30 0x7f7b280ba860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b26d9d640 1 --2- 172.21.15.62:0/2999199376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b28149df0 0x7f7b281dc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2659c640 1 -- 172.21.15.62:0/2999199376 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b28140b30 msgr2=0x7f7b280ba860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:16.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2659c640 1 --2- 172.21.15.62:0/2999199376 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b28140b30 0x7f7b280ba860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2659c640 1 -- 172.21.15.62:0/2999199376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b28149df0 msgr2=0x7f7b281dc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:16.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2659c640 1 --2- 172.21.15.62:0/2999199376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b28149df0 0x7f7b281dc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2659c640 1 -- 172.21.15.62:0/2999199376 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b20009a70 con 0x7f7b28071a00 2023-05-15T16:40:16.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2659c640 1 --2- 172.21.15.62:0/2999199376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b28071a00 0x7f7b28147630 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7b18000c10 tx=0x7f7b1801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:16.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b16ffd640 1 -- 172.21.15.62:0/2999199376 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b180044d0 con 0x7f7b28071a00 2023-05-15T16:40:16.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b16ffd640 1 -- 172.21.15.62:0/2999199376 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b18003620 con 0x7f7b28071a00 2023-05-15T16:40:16.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2cd21640 1 -- 172.21.15.62:0/2999199376 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b18009420 con 0x7f7b28071a00 2023-05-15T16:40:16.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b16ffd640 1 -- 172.21.15.62:0/2999199376 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b18003990 con 0x7f7b28071a00 2023-05-15T16:40:16.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.523+0000 7f7b2cd21640 1 -- 172.21.15.62:0/2999199376 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b280b5dd0 con 0x7f7b28071a00 2023-05-15T16:40:16.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b16ffd640 1 -- 172.21.15.62:0/2999199376 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f7b180b7040 con 0x7f7b28071a00 2023-05-15T16:40:16.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b16ffd640 1 --2- 172.21.15.62:0/2999199376 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7b080653b0 0x7f7b08067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b16ffd640 1 -- 172.21.15.62:0/2999199376 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b18120090 con 0x7f7b28071a00 2023-05-15T16:40:16.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b25d9b640 1 --2- 172.21.15.62:0/2999199376 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7b080653b0 0x7f7b08067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b2fe42000 1 Processor -- start 2023-05-15T16:40:16.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b2fe42000 1 -- start start 2023-05-15T16:40:16.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b25d9b640 1 --2- 172.21.15.62:0/2999199376 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7b080653b0 0x7f7b08067860 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7b280b9d80 tx=0x7f7b1c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:16.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b2fe42000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557d30eeefd0 0x557d31148280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b2fe42000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d3114b380 0x557d3114b750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b2fe42000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x557d3114ceb0 0x557d3114d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b2fe42000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d30fdfb50 con 0x557d3114b380 2023-05-15T16:40:16.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b2fe42000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d30efcdd0 con 0x557d30eeefd0 2023-05-15T16:40:16.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b2fe42000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x557d30f6d640 con 0x557d3114ceb0 2023-05-15T16:40:16.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b25d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d3114b380 0x557d3114b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b25d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d3114b380 0x557d3114b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48540/0 (socket says 172.21.15.62:48540) 2023-05-15T16:40:16.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b25d9b640 1 -- 172.21.15.62:0/872842662 learned_addr learned my addr 172.21.15.62:0/872842662 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:16.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b2659c640 1 --2- 172.21.15.62:0/872842662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557d30eeefd0 0x557d31148280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b26d9d640 1 --2- 172.21.15.62:0/872842662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x557d3114ceb0 0x557d3114d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b25d9b640 1 -- 172.21.15.62:0/872842662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x557d3114ceb0 msgr2=0x557d3114d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:16.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b25d9b640 1 --2- 172.21.15.62:0/872842662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x557d3114ceb0 0x557d3114d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b25d9b640 1 -- 172.21.15.62:0/872842662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557d30eeefd0 msgr2=0x557d31148280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:16.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b25d9b640 1 --2- 172.21.15.62:0/872842662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557d30eeefd0 0x557d31148280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b25d9b640 1 -- 172.21.15.62:0/872842662 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d30f2c0b0 con 0x557d3114b380 2023-05-15T16:40:16.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b25d9b640 1 --2- 172.21.15.62:0/872842662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d3114b380 0x557d3114b750 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c001e60 tx=0x7f7b1c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f02fbbe9daf8d826 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:16.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b07fff640 1 -- 172.21.15.62:0/872842662 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c007710 con 0x557d3114b380 2023-05-15T16:40:16.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b07fff640 1 -- 172.21.15.62:0/872842662 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1c00e750 con 0x557d3114b380 2023-05-15T16:40:16.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.527+0000 7f7b07fff640 1 -- 172.21.15.62:0/872842662 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c00eae0 con 0x557d3114b380 2023-05-15T16:40:16.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 1 -- 172.21.15.62:0/872842662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d3114b380 msgr2=0x557d3114b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:16.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 1 --2- 172.21.15.62:0/872842662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d3114b380 0x557d3114b750 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c001e60 tx=0x7f7b1c011000 comp rx=0 tx=0).stop 2023-05-15T16:40:16.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 1 -- 172.21.15.62:0/872842662 shutdown_connections 2023-05-15T16:40:16.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 1 --2- 172.21.15.62:0/872842662 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x557d3114ceb0 0x557d3114d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 1 --2- 172.21.15.62:0/872842662 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d3114b380 0x557d3114b750 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 1 --2- 172.21.15.62:0/872842662 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557d30eeefd0 0x557d31148280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 1 -- 172.21.15.62:0/872842662 >> 172.21.15.62:0/872842662 conn(0x557d30fbe1f0 msgr2=0x557d3114ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:16.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 1 -- 172.21.15.62:0/872842662 shutdown_connections 2023-05-15T16:40:16.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 1 -- 172.21.15.62:0/872842662 wait complete. 2023-05-15T16:40:16.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 1 -- start start 2023-05-15T16:40:16.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 1 Processor -- start 2023-05-15T16:40:16.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d30eeefd0 0x557d3111beb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x557d3114b380 0x557d3111c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557d3114ceb0 0x557d3111c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d30f66780 con 0x557d30eeefd0 2023-05-15T16:40:16.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d30f24250 con 0x557d3114ceb0 2023-05-15T16:40:16.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x557d30f23ef0 con 0x557d3114b380 2023-05-15T16:40:16.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 10 client.0 _ll_register_callbacks cb 0x557d31104130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-15T16:40:16.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2659c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d30eeefd0 0x557d3111beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2659c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d30eeefd0 0x557d3111beb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48550/0 (socket says 172.21.15.62:48550) 2023-05-15T16:40:16.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2659c640 1 -- 172.21.15.62:0/2818461814 learned_addr learned my addr 172.21.15.62:0/2818461814 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:16.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b26d9d640 1 --2- 172.21.15.62:0/2818461814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557d3114ceb0 0x557d3111c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b25d9b640 1 --2- 172.21.15.62:0/2818461814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x557d3114b380 0x557d3111c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2659c640 1 -- 172.21.15.62:0/2818461814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x557d3114b380 msgr2=0x557d3111c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:16.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2659c640 1 --2- 172.21.15.62:0/2818461814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x557d3114b380 0x557d3111c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2659c640 1 -- 172.21.15.62:0/2818461814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557d3114ceb0 msgr2=0x557d3111c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:16.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2659c640 1 --2- 172.21.15.62:0/2818461814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557d3114ceb0 0x557d3111c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2659c640 1 -- 172.21.15.62:0/2818461814 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b1c00f040 con 0x557d30eeefd0 2023-05-15T16:40:16.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b26d9d640 1 --2- 172.21.15.62:0/2818461814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557d3114ceb0 0x557d3111c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:16.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b25d9b640 1 --2- 172.21.15.62:0/2818461814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x557d3114b380 0x557d3111c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:16.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2659c640 1 --2- 172.21.15.62:0/2818461814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d30eeefd0 0x557d3111beb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7b1809b490 tx=0x7f7b180f9b30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3dfdde18d434d61 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:16.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b057fa640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-05-15T16:40:16.548 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b057fa640 1 -- 172.21.15.62:0/2818461814 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b18003af0 con 0x557d30eeefd0 2023-05-15T16:40:16.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b057fa640 1 -- 172.21.15.62:0/2818461814 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b18003c50 con 0x557d30eeefd0 2023-05-15T16:40:16.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 1 -- 172.21.15.62:0/2818461814 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557d30f2ac60 con 0x557d30eeefd0 2023-05-15T16:40:16.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b057fa640 1 -- 172.21.15.62:0/2818461814 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b1810e080 con 0x557d30eeefd0 2023-05-15T16:40:16.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 10 client.4626 fetch_fsmap learned FSMap version 7 2023-05-15T16:40:16.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 1 -- 172.21.15.62:0/2818461814 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x557d30c63890 con 0x557d30eeefd0 2023-05-15T16:40:16.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b057fa640 1 -- 172.21.15.62:0/2818461814 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557d30f2ac60 con 0x557d30eeefd0 2023-05-15T16:40:16.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b057fa640 1 -- 172.21.15.62:0/2818461814 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 7) v1 ==== 2561+0+0 (secure 0 0 0) 0x7f7b180ed7d0 con 0x557d30eeefd0 2023-05-15T16:40:16.549 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 10 client.4626 fetch_fsmap finished waiting for FSMap version 7 2023-05-15T16:40:16.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 10 client.4626 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-15T16:40:16.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 20 client.4626 populate_metadata read hostname 'smithi062' 2023-05-15T16:40:16.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 1 --2- 172.21.15.62:0/2818461814 >> [v2:172.21.15.62:6833/2804159919,v1:172.21.15.62:6835/2804159919] conn(0x557d31162680 0x557d31164a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 4 client.4626 mds_command: new command op to 4263 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-15T16:40:16.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b2fe42000 1 -- 172.21.15.62:0/2818461814 --> [v2:172.21.15.62:6833/2804159919,v1:172.21.15.62:6835/2804159919] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557d30f650d0 con 0x557d31162680 2023-05-15T16:40:16.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b25d9b640 1 --2- 172.21.15.62:0/2818461814 >> [v2:172.21.15.62:6833/2804159919,v1:172.21.15.62:6835/2804159919] conn(0x557d31162680 0x557d31164a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b25d9b640 1 --2- 172.21.15.62:0/2818461814 >> [v2:172.21.15.62:6833/2804159919,v1:172.21.15.62:6835/2804159919] conn(0x557d31162680 0x557d31164a60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=886c2d8a4a951f5e server_cookie=c85bea0c73596b1f in_seq=0 out_seq=0 2023-05-15T16:40:16.550 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b057fa640 10 client.4626 ms_handle_connect on v2:172.21.15.62:6833/2804159919 2023-05-15T16:40:16.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b057fa640 1 -- 172.21.15.62:0/2818461814 <== mds.0 v2:172.21.15.62:6833/2804159919 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x557d30f650d0 con 0x557d31162680 2023-05-15T16:40:16.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.531+0000 7f7b057fa640 10 client.4626 handle_command_reply: tid=0 2023-05-15T16:40:16.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.535+0000 7f7b2fe42000 1 client.4626 shutdown 2023-05-15T16:40:16.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.535+0000 7f7b2fe42000 1 -- 172.21.15.62:0/2818461814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d30eeefd0 msgr2=0x557d3111beb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:16.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.535+0000 7f7b2fe42000 1 --2- 172.21.15.62:0/2818461814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d30eeefd0 0x557d3111beb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f7b1809b490 tx=0x7f7b180f9b30 comp rx=0 tx=0).stop 2023-05-15T16:40:16.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.535+0000 7f7b2fe42000 1 -- 172.21.15.62:0/2818461814 shutdown_connections 2023-05-15T16:40:16.551 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.535+0000 7f7b2fe42000 1 --2- 172.21.15.62:0/2818461814 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557d3114ceb0 0x557d3111c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.535+0000 7f7b2fe42000 1 --2- 172.21.15.62:0/2818461814 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x557d3114b380 0x557d3111c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.535+0000 7f7b2fe42000 1 --2- 172.21.15.62:0/2818461814 >> [v2:172.21.15.62:6833/2804159919,v1:172.21.15.62:6835/2804159919] conn(0x557d31162680 0x557d31164a60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.535+0000 7f7b2fe42000 1 --2- 172.21.15.62:0/2818461814 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d30eeefd0 0x557d3111beb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.535+0000 7f7b057fa640 0 client.4626 ms_handle_reset on v2:172.21.15.62:6833/2804159919 2023-05-15T16:40:16.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.535+0000 7f7b2fe42000 1 -- 172.21.15.62:0/2818461814 >> 172.21.15.62:0/2818461814 conn(0x557d30fbe1f0 msgr2=0x557d3114a910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:16.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.535+0000 7f7b2fe42000 1 -- 172.21.15.62:0/2818461814 shutdown_connections 2023-05-15T16:40:16.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.535+0000 7f7b2fe42000 1 -- 172.21.15.62:0/2818461814 wait complete. 2023-05-15T16:40:16.552 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.535+0000 7f7b2fe42000 20 client.4626 trim_cache size 0 max 16384 2023-05-15T16:40:16.554 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.547+0000 7f7b2fe42000 1 Processor -- start 2023-05-15T16:40:16.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.547+0000 7f7b2fe42000 1 -- start start 2023-05-15T16:40:16.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.547+0000 7f7b2fe42000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x557d30eeefd0 0x557d3115fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.547+0000 7f7b2fe42000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d3114b380 0x557d311181d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.547+0000 7f7b2fe42000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557d3114ceb0 0x557d31118710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.547+0000 7f7b2fe42000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d30c24940 con 0x557d3114b380 2023-05-15T16:40:16.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.547+0000 7f7b2fe42000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d30f63f90 con 0x557d3114ceb0 2023-05-15T16:40:16.555 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.547+0000 7f7b2fe42000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x557d30f60b20 con 0x557d30eeefd0 2023-05-15T16:40:16.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.547+0000 7f7b25d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d3114b380 0x557d311181d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.547+0000 7f7b25d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d3114b380 0x557d311181d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48560/0 (socket says 172.21.15.62:48560) 2023-05-15T16:40:16.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.547+0000 7f7b25d9b640 1 -- 172.21.15.62:0/1151118927 learned_addr learned my addr 172.21.15.62:0/1151118927 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:16.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2659c640 1 --2- 172.21.15.62:0/1151118927 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x557d30eeefd0 0x557d3115fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b26d9d640 1 --2- 172.21.15.62:0/1151118927 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557d3114ceb0 0x557d31118710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b25d9b640 1 -- 172.21.15.62:0/1151118927 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x557d30eeefd0 msgr2=0x557d3115fa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:16.556 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b25d9b640 1 --2- 172.21.15.62:0/1151118927 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x557d30eeefd0 0x557d3115fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b25d9b640 1 -- 172.21.15.62:0/1151118927 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557d3114ceb0 msgr2=0x557d31118710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:16.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b25d9b640 1 --2- 172.21.15.62:0/1151118927 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557d3114ceb0 0x557d31118710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b25d9b640 1 -- 172.21.15.62:0/1151118927 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557d31147cd0 con 0x557d3114b380 2023-05-15T16:40:16.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b25d9b640 1 --2- 172.21.15.62:0/1151118927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d3114b380 0x557d311181d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c014000 tx=0x7f7b1c007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7e0dbbbd7a9f01 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:16.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b14ff9640 1 -- 172.21.15.62:0/1151118927 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c032030 con 0x557d3114b380 2023-05-15T16:40:16.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b14ff9640 1 -- 172.21.15.62:0/1151118927 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b1c0014a0 con 0x557d3114b380 2023-05-15T16:40:16.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b14ff9640 1 -- 172.21.15.62:0/1151118927 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1c028040 con 0x557d3114b380 2023-05-15T16:40:16.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 1 -- 172.21.15.62:0/1151118927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d3114b380 msgr2=0x557d311181d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:16.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 1 --2- 172.21.15.62:0/1151118927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d3114b380 0x557d311181d0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c014000 tx=0x7f7b1c007000 comp rx=0 tx=0).stop 2023-05-15T16:40:16.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 1 -- 172.21.15.62:0/1151118927 shutdown_connections 2023-05-15T16:40:16.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 1 --2- 172.21.15.62:0/1151118927 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557d3114ceb0 0x557d31118710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 1 --2- 172.21.15.62:0/1151118927 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d3114b380 0x557d311181d0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 1 --2- 172.21.15.62:0/1151118927 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x557d30eeefd0 0x557d3115fa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 1 -- 172.21.15.62:0/1151118927 >> 172.21.15.62:0/1151118927 conn(0x557d30fbe1f0 msgr2=0x557d3115f310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:16.558 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 1 -- 172.21.15.62:0/1151118927 shutdown_connections 2023-05-15T16:40:16.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 1 -- 172.21.15.62:0/1151118927 wait complete. 2023-05-15T16:40:16.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 1 -- start start 2023-05-15T16:40:16.559 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 1 Processor -- start 2023-05-15T16:40:16.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d30eeefd0 0x557d31118420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557d3114b380 0x557d3117ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x557d3114ceb0 0x557d3117e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d30f692e0 con 0x557d30eeefd0 2023-05-15T16:40:16.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x557d30f63b80 con 0x557d3114b380 2023-05-15T16:40:16.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x557d30c641b0 con 0x557d3114ceb0 2023-05-15T16:40:16.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 10 client.0 _ll_register_callbacks cb 0x557d30f285e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-15T16:40:16.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2659c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d30eeefd0 0x557d31118420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2659c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d30eeefd0 0x557d31118420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48568/0 (socket says 172.21.15.62:48568) 2023-05-15T16:40:16.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2659c640 1 -- 172.21.15.62:0/4075423062 learned_addr learned my addr 172.21.15.62:0/4075423062 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:16.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b26d9d640 1 --2- 172.21.15.62:0/4075423062 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x557d3114ceb0 0x557d3117e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b25d9b640 1 --2- 172.21.15.62:0/4075423062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557d3114b380 0x557d3117ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2659c640 1 -- 172.21.15.62:0/4075423062 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x557d3114ceb0 msgr2=0x557d3117e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:16.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2659c640 1 --2- 172.21.15.62:0/4075423062 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x557d3114ceb0 0x557d3117e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2659c640 1 -- 172.21.15.62:0/4075423062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557d3114b380 msgr2=0x557d3117ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:16.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2659c640 1 --2- 172.21.15.62:0/4075423062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557d3114b380 0x557d3117ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2659c640 1 -- 172.21.15.62:0/4075423062 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557d30f2c0b0 con 0x557d30eeefd0 2023-05-15T16:40:16.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2659c640 1 --2- 172.21.15.62:0/4075423062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d30eeefd0 0x557d31118420 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7b180f18c0 tx=0x7f7b1811e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9773f12f1bf12b7b server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:16.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b057fa640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-05-15T16:40:16.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b057fa640 1 -- 172.21.15.62:0/4075423062 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1810e080 con 0x557d30eeefd0 2023-05-15T16:40:16.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b057fa640 1 -- 172.21.15.62:0/4075423062 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7b180f97f0 con 0x557d30eeefd0 2023-05-15T16:40:16.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 1 -- 172.21.15.62:0/4075423062 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557d30f0d4d0 con 0x557d30eeefd0 2023-05-15T16:40:16.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b057fa640 1 -- 172.21.15.62:0/4075423062 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7b180efd80 con 0x557d30eeefd0 2023-05-15T16:40:16.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 10 client.4632 fetch_fsmap learned FSMap version 7 2023-05-15T16:40:16.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 1 -- 172.21.15.62:0/4075423062 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) v3 -- 0x557d30f12280 con 0x557d30eeefd0 2023-05-15T16:40:16.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b057fa640 1 -- 172.21.15.62:0/4075423062 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557d30f0d4d0 con 0x557d30eeefd0 2023-05-15T16:40:16.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b057fa640 1 -- 172.21.15.62:0/4075423062 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 7) v1 ==== 2561+0+0 (secure 0 0 0) 0x7f7b1810f070 con 0x557d30eeefd0 2023-05-15T16:40:16.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 10 client.4632 fetch_fsmap finished waiting for FSMap version 7 2023-05-15T16:40:16.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 10 client.4632 resolve_mds: resolved name 'a' to daemon mds.a 2023-05-15T16:40:16.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 20 client.4632 populate_metadata read hostname 'smithi062' 2023-05-15T16:40:16.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 1 --2- 172.21.15.62:0/4075423062 >> [v2:172.21.15.62:6833/2804159919,v1:172.21.15.62:6835/2804159919] conn(0x557d3117e950 0x557d311b9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 4 client.4632 mds_command: new command op to 4263 tid=0[{"prefix": "status"}] 2023-05-15T16:40:16.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b2fe42000 1 -- 172.21.15.62:0/4075423062 --> [v2:172.21.15.62:6833/2804159919,v1:172.21.15.62:6835/2804159919] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557d30f5f800 con 0x557d3117e950 2023-05-15T16:40:16.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.551+0000 7f7b25d9b640 1 --2- 172.21.15.62:0/4075423062 >> [v2:172.21.15.62:6833/2804159919,v1:172.21.15.62:6835/2804159919] conn(0x557d3117e950 0x557d311b9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b057fa640 10 client.4632 ms_handle_connect on v2:172.21.15.62:6833/2804159919 2023-05-15T16:40:16.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b25d9b640 1 --2- 172.21.15.62:0/4075423062 >> [v2:172.21.15.62:6833/2804159919,v1:172.21.15.62:6835/2804159919] conn(0x557d3117e950 0x557d311b9240 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73a944de8d2d82b3 server_cookie=51141c593a53167d in_seq=0 out_seq=0 2023-05-15T16:40:16.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b057fa640 1 -- 172.21.15.62:0/4075423062 <== mds.0 v2:172.21.15.62:6833/2804159919 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x557d30f5f800 con 0x557d3117e950 2023-05-15T16:40:16.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b057fa640 10 client.4632 handle_command_reply: tid=0 2023-05-15T16:40:16.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2fe42000 1 client.4632 shutdown 2023-05-15T16:40:16.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2fe42000 1 -- 172.21.15.62:0/4075423062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d30eeefd0 msgr2=0x557d31118420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:16.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2fe42000 1 --2- 172.21.15.62:0/4075423062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d30eeefd0 0x557d31118420 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7b180f18c0 tx=0x7f7b1811e3c0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2fe42000 1 -- 172.21.15.62:0/4075423062 shutdown_connections 2023-05-15T16:40:16.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2fe42000 1 --2- 172.21.15.62:0/4075423062 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x557d3114ceb0 0x557d3117e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2fe42000 1 --2- 172.21.15.62:0/4075423062 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x557d3114b380 0x557d3117ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2fe42000 1 --2- 172.21.15.62:0/4075423062 >> [v2:172.21.15.62:6833/2804159919,v1:172.21.15.62:6835/2804159919] conn(0x557d3117e950 0x557d311b9240 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2fe42000 1 --2- 172.21.15.62:0/4075423062 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x557d30eeefd0 0x557d31118420 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2fe42000 1 -- 172.21.15.62:0/4075423062 >> 172.21.15.62:0/4075423062 conn(0x557d30fbe1f0 msgr2=0x557d3114b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:16.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b057fa640 0 client.4632 ms_handle_reset on v2:172.21.15.62:6833/2804159919 2023-05-15T16:40:16.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2fe42000 1 -- 172.21.15.62:0/4075423062 shutdown_connections 2023-05-15T16:40:16.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2fe42000 1 -- 172.21.15.62:0/4075423062 wait complete. 2023-05-15T16:40:16.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2fe42000 20 client.4632 trim_cache size 0 max 16384 2023-05-15T16:40:16.569 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-05-15T16:40:16.569 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_fsid": "fed834dd-24d2-40f4-8361-7c8c5a9484de", 2023-05-15T16:40:16.569 INFO:teuthology.orchestra.run.smithi062.stdout: "whoami": 0, 2023-05-15T16:40:16.569 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 4263, 2023-05-15T16:40:16.569 INFO:teuthology.orchestra.run.smithi062.stdout: "want_state": "up:active", 2023-05-15T16:40:16.569 INFO:teuthology.orchestra.run.smithi062.stdout: "state": "up:active", 2023-05-15T16:40:16.570 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs", 2023-05-15T16:40:16.570 INFO:teuthology.orchestra.run.smithi062.stdout: "rank_uptime": 15.467497192, 2023-05-15T16:40:16.570 INFO:teuthology.orchestra.run.smithi062.stdout: "mdsmap_epoch": 7, 2023-05-15T16:40:16.570 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch": 23, 2023-05-15T16:40:16.570 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch_barrier": 23, 2023-05-15T16:40:16.570 INFO:teuthology.orchestra.run.smithi062.stdout: "uptime": 19.759286899999999 2023-05-15T16:40:16.570 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-05-15T16:40:16.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2cd21640 1 -- 172.21.15.62:0/2999199376 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7b080653b0 msgr2=0x7f7b08067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:16.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2cd21640 1 --2- 172.21.15.62:0/2999199376 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7b080653b0 0x7f7b08067860 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7b280b9d80 tx=0x7f7b1c009040 comp rx=0 tx=0).stop 2023-05-15T16:40:16.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2cd21640 1 -- 172.21.15.62:0/2999199376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b28071a00 msgr2=0x7f7b28147630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:16.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2cd21640 1 --2- 172.21.15.62:0/2999199376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b28071a00 0x7f7b28147630 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7b18000c10 tx=0x7f7b1801ba10 comp rx=0 tx=0).stop 2023-05-15T16:40:16.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2cd21640 1 -- 172.21.15.62:0/2999199376 shutdown_connections 2023-05-15T16:40:16.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2cd21640 1 --2- 172.21.15.62:0/2999199376 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7b28149df0 0x7f7b281dc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2cd21640 1 --2- 172.21.15.62:0/2999199376 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7b28140b30 0x7f7b280ba860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2cd21640 1 --2- 172.21.15.62:0/2999199376 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7b080653b0 0x7f7b08067860 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2cd21640 1 --2- 172.21.15.62:0/2999199376 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7b28071a00 0x7f7b28147630 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2cd21640 1 -- 172.21.15.62:0/2999199376 >> 172.21.15.62:0/2999199376 conn(0x7f7b280653f0 msgr2=0x7f7b280b83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:16.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2cd21640 1 -- 172.21.15.62:0/2999199376 shutdown_connections 2023-05-15T16:40:16.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.555+0000 7f7b2cd21640 1 -- 172.21.15.62:0/2999199376 wait complete. 2023-05-15T16:40:16.574 INFO:teuthology.run_tasks:Running task kclient... 2023-05-15T16:40:16.597 INFO:tasks.kclient:Mounting kernel clients... 2023-05-15T16:40:16.598 INFO:tasks.kclient:config is {'client.0': {}} 2023-05-15T16:40:16.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:16.599 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2023-05-15T16:40:16.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:16.610 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link delete ceph-brx 2023-05-15T16:40:16.677 INFO:teuthology.orchestra.run.smithi171.stderr:Cannot find device "ceph-brx" 2023-05-15T16:40:16.679 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-15T16:40:16.680 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-05-15T16:40:16.680 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-05-15T16:40:16.681 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-15T16:40:16.681 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-15T16:40:16.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.803+0000 7fc045f0b640 1 Processor -- start 2023-05-15T16:40:16.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.807+0000 7fc045f0b640 1 -- start start 2023-05-15T16:40:16.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.807+0000 7fc045f0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc04006b050 0x7fc04014a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.807+0000 7fc045f0b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc0400bd140 0x7fc04014a700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.807+0000 7fc045f0b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc040149d30 con 0x7fc0400bcd70 2023-05-15T16:40:16.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.807+0000 7fc045f0b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc04006b5e0 con 0x7fc0400bd140 2023-05-15T16:40:16.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.807+0000 7fc045f0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc04006b8c0 con 0x7fc04006b050 2023-05-15T16:40:16.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.807+0000 7fc03ffff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc0400bd140 0x7fc04014a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.807+0000 7fc03f7fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc0400bcd70 0x7fc0400badc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.62:53346/0 (socket says 172.21.15.62:53346) 2023-05-15T16:40:16.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.807+0000 7fc03f7fe640 1 -- 172.21.15.62:0/202848404 learned_addr learned my addr 172.21.15.62:0/202848404 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:16.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.807+0000 7fc03effd640 1 --2- 172.21.15.62:0/202848404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc04006b050 0x7fc04014a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.807+0000 7fc03effd640 1 -- 172.21.15.62:0/202848404 >> v2:172.21.15.161:3300/0 conn(0x7fc0400bd140 msgr2=0x7fc04014a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:16.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.807+0000 7fc03effd640 1 --2- 172.21.15.62:0/202848404 >> v2:172.21.15.161:3300/0 conn(0x7fc0400bd140 0x7fc04014a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.807+0000 7fc03effd640 1 -- 172.21.15.62:0/202848404 >> v1:172.21.15.161:6789/0 conn(0x7fc0400bcd70 legacy=0x7fc0400badc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:16.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.807+0000 7fc03effd640 1 -- 172.21.15.62:0/202848404 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04006bba0 con 0x7fc04006b050 2023-05-15T16:40:16.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc03effd640 1 --2- 172.21.15.62:0/202848404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc04006b050 0x7fc04014a1c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc0340097c0 tx=0x7fc03401ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97d91b0f7d9d2848 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:16.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc03e7fc640 1 -- 172.21.15.62:0/202848404 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0340a8970 con 0x7fc04006b050 2023-05-15T16:40:16.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc03e7fc640 1 -- 172.21.15.62:0/202848404 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0340a8ad0 con 0x7fc04006b050 2023-05-15T16:40:16.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc03e7fc640 1 -- 172.21.15.62:0/202848404 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0340a8e60 con 0x7fc04006b050 2023-05-15T16:40:16.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc045f0b640 1 -- 172.21.15.62:0/202848404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc04006b050 msgr2=0x7fc04014a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:16.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc045f0b640 1 --2- 172.21.15.62:0/202848404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc04006b050 0x7fc04014a1c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc0340097c0 tx=0x7fc03401ec70 comp rx=0 tx=0).stop 2023-05-15T16:40:16.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc045f0b640 1 -- 172.21.15.62:0/202848404 shutdown_connections 2023-05-15T16:40:16.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc045f0b640 1 --2- 172.21.15.62:0/202848404 >> v2:172.21.15.161:3300/0 conn(0x7fc0400bd140 0x7fc04014a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc045f0b640 1 --2- 172.21.15.62:0/202848404 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc04006b050 0x7fc04014a1c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc045f0b640 1 -- 172.21.15.62:0/202848404 >> 172.21.15.62:0/202848404 conn(0x7fc0400bff80 msgr2=0x7fc0400c0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:16.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc045f0b640 1 -- 172.21.15.62:0/202848404 shutdown_connections 2023-05-15T16:40:16.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc045f0b640 1 -- 172.21.15.62:0/202848404 wait complete. 2023-05-15T16:40:16.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc045f0b640 1 Processor -- start 2023-05-15T16:40:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc045f0b640 1 -- start start 2023-05-15T16:40:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc045f0b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc04006b050 0x7fc040147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc045f0b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0400bcd70 0x7fc040148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc045f0b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0400bd140 0x7fc040148ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc045f0b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc040148240 con 0x7fc0400bd140 2023-05-15T16:40:16.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc045f0b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400bb7b0 con 0x7fc04006b050 2023-05-15T16:40:16.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc045f0b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0400bb9c0 con 0x7fc0400bcd70 2023-05-15T16:40:16.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc03ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0400bd140 0x7fc040148ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc03ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0400bd140 0x7fc040148ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48570/0 (socket says 172.21.15.62:48570) 2023-05-15T16:40:16.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc03ffff640 1 -- 172.21.15.62:0/2466839017 learned_addr learned my addr 172.21.15.62:0/2466839017 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:16.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc03effd640 1 --2- 172.21.15.62:0/2466839017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0400bcd70 0x7fc040148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc03f7fe640 1 --2- 172.21.15.62:0/2466839017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc04006b050 0x7fc040147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc03ffff640 1 -- 172.21.15.62:0/2466839017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0400bcd70 msgr2=0x7fc040148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc03ffff640 1 --2- 172.21.15.62:0/2466839017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0400bcd70 0x7fc040148590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc03ffff640 1 -- 172.21.15.62:0/2466839017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc04006b050 msgr2=0x7fc040147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc03ffff640 1 --2- 172.21.15.62:0/2466839017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc04006b050 0x7fc040147d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.811+0000 7fc03ffff640 1 -- 172.21.15.62:0/2466839017 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc034009420 con 0x7fc0400bd140 2023-05-15T16:40:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.815+0000 7fc03ffff640 1 --2- 172.21.15.62:0/2466839017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0400bd140 0x7fc040148ad0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc03800efc0 tx=0x7fc03800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:16.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.815+0000 7fc027fff640 1 -- 172.21.15.62:0/2466839017 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc038009ba0 con 0x7fc0400bd140 2023-05-15T16:40:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.815+0000 7fc027fff640 1 -- 172.21.15.62:0/2466839017 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03800f040 con 0x7fc0400bd140 2023-05-15T16:40:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.815+0000 7fc027fff640 1 -- 172.21.15.62:0/2466839017 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0380146c0 con 0x7fc0400bd140 2023-05-15T16:40:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.815+0000 7fc045f0b640 1 -- 172.21.15.62:0/2466839017 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0401544d0 con 0x7fc0400bd140 2023-05-15T16:40:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.815+0000 7fc045f0b640 1 -- 172.21.15.62:0/2466839017 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0401475d0 con 0x7fc0400bd140 2023-05-15T16:40:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.815+0000 7fc045f0b640 1 -- 172.21.15.62:0/2466839017 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc040154660 con 0x7fc0400bd140 2023-05-15T16:40:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.815+0000 7fc027fff640 1 -- 172.21.15.62:0/2466839017 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fc038014820 con 0x7fc0400bd140 2023-05-15T16:40:16.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.815+0000 7fc027fff640 1 --2- 172.21.15.62:0/2466839017 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc02c065380 0x7fc02c067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:16.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.815+0000 7fc027fff640 1 -- 172.21.15.62:0/2466839017 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc0380835d0 con 0x7fc0400bd140 2023-05-15T16:40:16.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.815+0000 7fc03f7fe640 1 --2- 172.21.15.62:0/2466839017 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc02c065380 0x7fc02c067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:16.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.815+0000 7fc03f7fe640 1 --2- 172.21.15.62:0/2466839017 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc02c065380 0x7fc02c067830 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc030000f70 tx=0x7fc030009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:16.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:16.819+0000 7fc027fff640 1 -- 172.21.15.62:0/2466839017 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fc0380512e0 con 0x7fc0400bd140 2023-05-15T16:40:17.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:17.011+0000 7fc045f0b640 1 -- 172.21.15.62:0/2466839017 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc04004dbe0 con 0x7fc0400bd140 2023-05-15T16:40:17.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:17.015+0000 7fc027fff640 1 -- 172.21.15.62:0/2466839017 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc038054900 con 0x7fc0400bd140 2023-05-15T16:40:17.018 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-15T16:40:17.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:17.015+0000 7fc045f0b640 1 -- 172.21.15.62:0/2466839017 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc02c065380 msgr2=0x7fc02c067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:17.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:17.015+0000 7fc045f0b640 1 --2- 172.21.15.62:0/2466839017 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc02c065380 0x7fc02c067830 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc030000f70 tx=0x7fc030009040 comp rx=0 tx=0).stop 2023-05-15T16:40:17.020 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:17.015+0000 7fc045f0b640 1 -- 172.21.15.62:0/2466839017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0400bd140 msgr2=0x7fc040148ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:17.021 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:17.015+0000 7fc045f0b640 1 --2- 172.21.15.62:0/2466839017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0400bd140 0x7fc040148ad0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc03800efc0 tx=0x7fc03800c490 comp rx=0 tx=0).stop 2023-05-15T16:40:17.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:17.015+0000 7fc045f0b640 1 -- 172.21.15.62:0/2466839017 shutdown_connections 2023-05-15T16:40:17.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:17.015+0000 7fc045f0b640 1 --2- 172.21.15.62:0/2466839017 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc02c065380 0x7fc02c067830 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:17.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:17.015+0000 7fc045f0b640 1 --2- 172.21.15.62:0/2466839017 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc0400bd140 0x7fc040148ad0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:17.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:17.015+0000 7fc045f0b640 1 --2- 172.21.15.62:0/2466839017 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc0400bcd70 0x7fc040148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:17.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:17.015+0000 7fc045f0b640 1 --2- 172.21.15.62:0/2466839017 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc04006b050 0x7fc040147d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:17.022 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:17.015+0000 7fc045f0b640 1 -- 172.21.15.62:0/2466839017 >> 172.21.15.62:0/2466839017 conn(0x7fc0400bff80 msgr2=0x7fc0401438b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:17.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:17.015+0000 7fc045f0b640 1 -- 172.21.15.62:0/2466839017 shutdown_connections 2023-05-15T16:40:17.023 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:17.015+0000 7fc045f0b640 1 -- 172.21.15.62:0/2466839017 wait complete. 2023-05-15T16:40:17.037 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-05-15T16:40:17.037 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-15T16:40:17.037 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2023-05-15T16:40:17.038 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-15T16:40:17.038 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-15T16:40:17.038 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-05-15T16:40:17.038 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-05-15T16:40:17.038 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-15T16:40:17.039 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-15T16:40:17.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:17.039 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2023-05-15T16:40:17.049 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-15T16:40:17.049 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-15T16:40:17.049 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2023-05-15T16:40:17.049 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2023-05-15T16:40:17.049 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2023-05-15T16:40:17.050 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2023-05-15T16:40:17.050 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-15T16:40:17.050 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2023-05-15T16:40:17.050 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2023-05-15T16:40:17.050 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-15T16:40:17.050 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2023-05-15T16:40:17.050 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2023-05-15T16:40:17.051 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-15T16:40:17.051 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2023-05-15T16:40:17.051 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-15T16:40:17.051 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2023-05-15T16:40:17.051 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-05-15T16:40:17.052 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42049sec preferred_lft 42049sec 2023-05-15T16:40:17.052 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link 2023-05-15T16:40:17.052 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2023-05-15T16:40:17.052 INFO:teuthology.orchestra.run.smithi171.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-05-15T16:40:17.052 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 02:42:7a:d8:55:72 brd ff:ff:ff:ff:ff:ff 2023-05-15T16:40:17.052 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-05-15T16:40:17.052 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2023-05-15T16:40:17.053 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-05-15T16:40:17.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:17.055 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2023-05-15T16:40:17.055 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2023-05-15T16:40:17.055 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link add name ceph-brx type bridge 2023-05-15T16:40:17.056 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip addr flush dev ceph-brx 2023-05-15T16:40:17.056 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set ceph-brx up 2023-05-15T16:40:17.056 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-05-15T16:40:17.056 DEBUG:teuthology.orchestra.run.smithi171:> ') 2023-05-15T16:40:17.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:17.169 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-15T16:40:17.186 INFO:teuthology.orchestra.run.smithi171.stdout:1 2023-05-15T16:40:17.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:17.189 DEBUG:teuthology.orchestra.run.smithi171:> route 2023-05-15T16:40:17.258 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2023-05-15T16:40:17.258 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-15T16:40:17.259 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-05-15T16:40:17.259 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-15T16:40:17.259 INFO:teuthology.orchestra.run.smithi171.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-05-15T16:40:17.259 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-15T16:40:17.259 INFO:teuthology.orchestra.run.smithi171.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-15T16:40:17.259 INFO:teuthology.orchestra.run.smithi171.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-15T16:40:17.260 INFO:teuthology.orchestra.run.smithi171.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-15T16:40:17.260 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-15T16:40:17.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:17.261 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2023-05-15T16:40:17.261 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2023-05-15T16:40:17.261 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-15T16:40:17.262 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-15T16:40:17.262 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-15T16:40:17.262 DEBUG:teuthology.orchestra.run.smithi171:> ') 2023-05-15T16:40:17.349 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:17.349 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2023-05-15T16:40:17.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:17.358 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list-id 2023-05-15T16:40:17.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:17.408 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2023-05-15T16:40:17.408 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2023-05-15T16:40:17.409 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-15T16:40:17.409 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-05-15T16:40:17.409 DEBUG:teuthology.orchestra.run.smithi171:> ') 2023-05-15T16:40:17.487 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-05-15T16:40:17.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:17.488 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2023-05-15T16:40:17.488 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2023-05-15T16:40:17.489 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-05-15T16:40:17.489 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-05-15T16:40:17.489 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-05-15T16:40:17.490 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-05-15T16:40:17.490 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-05-15T16:40:17.490 DEBUG:teuthology.orchestra.run.smithi171:> ') 2023-05-15T16:40:17.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:17.647 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2023-05-15T16:40:17.647 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2023-05-15T16:40:17.647 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2023-05-15T16:40:17.647 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set dev brx.0 master ceph-brx 2023-05-15T16:40:17.648 DEBUG:teuthology.orchestra.run.smithi171:> ') 2023-05-15T16:40:17.685 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-15T16:40:17.686 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-05-15T16:40:17.739 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-05-15T16:40:17.739 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-15T16:40:17.739 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-05-15T16:40:17.796 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-05-15T16:40:17.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:17.797 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-05-15T16:40:17.896 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-05-15T16:40:17.896 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-05-15T16:40:17.896 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2023-05-15T16:40:17.994 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-05-15T16:40:17.994 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-05-15T16:40:17.994 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2023-05-15T16:40:17.994 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.62:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-05-15T16:40:17.994 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-15T16:40:18.008 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-05-15T16:40:18.009 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-05-15T16:40:18.009 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2023-05-15T16:40:18.009 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.62:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-05-15T16:40:18.009 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-15T16:40:18.009 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.62:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-05-15T16:40:18.009 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.62:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-05-15T16:40:18.010 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fed834dd-24d2-40f4-8361-7c8c5a9484de" will pass to kernel 2023-05-15T16:40:18.012 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-15T16:40:18.012 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:18.013 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-15T16:40:18.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:18.037 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-15T16:40:18.115 INFO:teuthology.orchestra.run.smithi171.stdout:client4638 2023-05-15T16:40:18.115 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2023-05-15T16:40:18.116 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-15T16:40:18.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:18.166 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-15T16:40:18.231 INFO:teuthology.orchestra.run.smithi171.stdout:client4638 2023-05-15T16:40:18.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:18.232 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-15T16:40:18.298 INFO:teuthology.orchestra.run.smithi171.stdout:client4638 2023-05-15T16:40:18.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:18.299 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/fed834dd-24d2-40f4-8361-7c8c5a9484de.client4638/status') 2023-05-15T16:40:18.370 INFO:teuthology.orchestra.run.smithi171.stdout:instance: client.4638 (3)172.21.15.171:0/1505558524 2023-05-15T16:40:18.370 INFO:teuthology.orchestra.run.smithi171.stdout:blocklisted: false 2023-05-15T16:40:18.371 INFO:teuthology.orchestra.run.smithi171.stderr:0+1 records in 2023-05-15T16:40:18.371 INFO:teuthology.orchestra.run.smithi171.stderr:0+1 records out 2023-05-15T16:40:18.371 INFO:teuthology.orchestra.run.smithi171.stderr:71 bytes copied, 6.6449e-05 s, 1.1 MB/s 2023-05-15T16:40:18.373 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-05-15T16:40:18.396 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-15T16:40:18.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.527+0000 7f0f69cce640 1 Processor -- start 2023-05-15T16:40:18.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.527+0000 7f0f69cce640 1 -- start start 2023-05-15T16:40:18.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.527+0000 7f0f69cce640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f640bd010 0x7f0f640ba940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:18.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.527+0000 7f0f69cce640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0f64143dc0 0x7f0f64154610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:18.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.527+0000 7f0f69cce640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f640bb710 con 0x7f0f640bbba0 2023-05-15T16:40:18.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.527+0000 7f0f69cce640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f640bae80 con 0x7f0f64143dc0 2023-05-15T16:40:18.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.527+0000 7f0f69cce640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f640bc820 con 0x7f0f640bd010 2023-05-15T16:40:18.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.527+0000 7f0f63fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0f64143dc0 0x7f0f64154610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:18.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.527+0000 7f0f62ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0f640bbba0 0x7f0f6406b100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58122/0 (socket says 172.21.15.62:58122) 2023-05-15T16:40:18.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.527+0000 7f0f62ffd640 1 -- 172.21.15.62:0/1732296907 learned_addr learned my addr 172.21.15.62:0/1732296907 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:18.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.527+0000 7f0f63fff640 1 -- 172.21.15.62:0/1732296907 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f640bd010 msgr2=0x7f0f640ba940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:18.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.527+0000 7f0f637fe640 1 --2- 172.21.15.62:0/1732296907 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f640bd010 0x7f0f640ba940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:18.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.527+0000 7f0f627fc640 1 -- 172.21.15.62:0/1732296907 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3815521715 0 0) 0x7f0f640bb710 con 0x7f0f640bbba0 2023-05-15T16:40:18.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.527+0000 7f0f63fff640 1 --2- 172.21.15.62:0/1732296907 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f640bd010 0x7f0f640ba940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:18.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.527+0000 7f0f63fff640 1 -- 172.21.15.62:0/1732296907 >> v1:172.21.15.62:6789/0 conn(0x7f0f640bbba0 legacy=0x7f0f6406b100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:18.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.527+0000 7f0f63fff640 1 -- 172.21.15.62:0/1732296907 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f640bc260 con 0x7f0f64143dc0 2023-05-15T16:40:18.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.527+0000 7f0f637fe640 1 --2- 172.21.15.62:0/1732296907 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f640bd010 0x7f0f640ba940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:18.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.531+0000 7f0f63fff640 1 --2- 172.21.15.62:0/1732296907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f64143dc0 0x7f0f64154610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009d90 tx=0x7f0f5c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd00ae349b7fca8 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:18.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.531+0000 7f0f627fc640 1 -- 172.21.15.62:0/1732296907 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0a5970 con 0x7f0f64143dc0 2023-05-15T16:40:18.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.531+0000 7f0f627fc640 1 -- 172.21.15.62:0/1732296907 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c0a5ad0 con 0x7f0f64143dc0 2023-05-15T16:40:18.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.531+0000 7f0f627fc640 1 -- 172.21.15.62:0/1732296907 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c0a5e60 con 0x7f0f64143dc0 2023-05-15T16:40:18.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.531+0000 7f0f69cce640 1 -- 172.21.15.62:0/1732296907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f64143dc0 msgr2=0x7f0f64154610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:18.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.531+0000 7f0f69cce640 1 --2- 172.21.15.62:0/1732296907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f64143dc0 0x7f0f64154610 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c009d90 tx=0x7f0f5c01c890 comp rx=0 tx=0).stop 2023-05-15T16:40:18.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.531+0000 7f0f69cce640 1 -- 172.21.15.62:0/1732296907 shutdown_connections 2023-05-15T16:40:18.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.531+0000 7f0f69cce640 1 --2- 172.21.15.62:0/1732296907 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f64143dc0 0x7f0f64154610 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:18.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.531+0000 7f0f69cce640 1 --2- 172.21.15.62:0/1732296907 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f640bd010 0x7f0f640ba940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:18.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.531+0000 7f0f69cce640 1 -- 172.21.15.62:0/1732296907 >> 172.21.15.62:0/1732296907 conn(0x7f0f640bffc0 msgr2=0x7f0f640c03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:18.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.531+0000 7f0f69cce640 1 -- 172.21.15.62:0/1732296907 shutdown_connections 2023-05-15T16:40:18.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.531+0000 7f0f69cce640 1 -- 172.21.15.62:0/1732296907 wait complete. 2023-05-15T16:40:18.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.531+0000 7f0f69cce640 1 Processor -- start 2023-05-15T16:40:18.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.531+0000 7f0f69cce640 1 -- start start 2023-05-15T16:40:18.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f69cce640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f640bbba0 0x7f0f64099f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:18.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f69cce640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f640bd010 0x7f0f641e59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:18.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f69cce640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f64143dc0 0x7f0f641e5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:18.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f69cce640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6409aa20 con 0x7f0f640bbba0 2023-05-15T16:40:18.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f69cce640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f641e6560 con 0x7f0f640bd010 2023-05-15T16:40:18.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f69cce640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f640994a0 con 0x7f0f64143dc0 2023-05-15T16:40:18.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f637fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f640bbba0 0x7f0f64099f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:18.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f637fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f640bbba0 0x7f0f64099f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48578/0 (socket says 172.21.15.62:48578) 2023-05-15T16:40:18.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f637fe640 1 -- 172.21.15.62:0/4284533293 learned_addr learned my addr 172.21.15.62:0/4284533293 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:18.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f63fff640 1 --2- 172.21.15.62:0/4284533293 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f64143dc0 0x7f0f641e5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:18.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f62ffd640 1 --2- 172.21.15.62:0/4284533293 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f640bd010 0x7f0f641e59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:18.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f637fe640 1 -- 172.21.15.62:0/4284533293 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f64143dc0 msgr2=0x7f0f641e5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:18.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f637fe640 1 --2- 172.21.15.62:0/4284533293 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f64143dc0 0x7f0f641e5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:18.542 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f637fe640 1 -- 172.21.15.62:0/4284533293 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f640bd010 msgr2=0x7f0f641e59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:18.543 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f637fe640 1 --2- 172.21.15.62:0/4284533293 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f640bd010 0x7f0f641e59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:18.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f637fe640 1 -- 172.21.15.62:0/4284533293 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c009a70 con 0x7f0f640bbba0 2023-05-15T16:40:18.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f637fe640 1 --2- 172.21.15.62:0/4284533293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f640bbba0 0x7f0f64099f80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00c7f0 tx=0x7f0f4c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:18.544 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f5bfff640 1 -- 172.21.15.62:0/4284533293 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c005ba0 con 0x7f0f640bbba0 2023-05-15T16:40:18.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f5bfff640 1 -- 172.21.15.62:0/4284533293 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4c005d00 con 0x7f0f640bbba0 2023-05-15T16:40:18.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f69cce640 1 -- 172.21.15.62:0/4284533293 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f64069cc0 con 0x7f0f640bbba0 2023-05-15T16:40:18.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f5bfff640 1 -- 172.21.15.62:0/4284533293 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c007a50 con 0x7f0f640bbba0 2023-05-15T16:40:18.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f69cce640 1 -- 172.21.15.62:0/4284533293 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f64069b30 con 0x7f0f640bbba0 2023-05-15T16:40:18.545 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f69cce640 1 -- 172.21.15.62:0/4284533293 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6406a8e0 con 0x7f0f640bbba0 2023-05-15T16:40:18.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f5bfff640 1 -- 172.21.15.62:0/4284533293 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f0f4c007bb0 con 0x7f0f640bbba0 2023-05-15T16:40:18.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f5bfff640 1 --2- 172.21.15.62:0/4284533293 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0f440653b0 0x7f0f44067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:18.546 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f5bfff640 1 -- 172.21.15.62:0/4284533293 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0f4c082880 con 0x7f0f640bbba0 2023-05-15T16:40:18.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.535+0000 7f0f62ffd640 1 --2- 172.21.15.62:0/4284533293 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0f440653b0 0x7f0f44067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:18.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.539+0000 7f0f62ffd640 1 --2- 172.21.15.62:0/4284533293 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0f440653b0 0x7f0f44067860 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0f6406ba60 tx=0x7f0f54009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:18.547 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.539+0000 7f0f5bfff640 1 -- 172.21.15.62:0/4284533293 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f0f4c053e90 con 0x7f0f640bbba0 2023-05-15T16:40:18.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.695+0000 7f0f69cce640 1 -- 172.21.15.62:0/4284533293 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0f64067960 con 0x7f0f640bbba0 2023-05-15T16:40:18.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.695+0000 7f0f5bfff640 1 -- 172.21.15.62:0/4284533293 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17811 (secure 0 0 0) 0x7f0f4c007e60 con 0x7f0f640bbba0 2023-05-15T16:40:18.701 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:18.701 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:40:02.088078+0000","last_up_change":"2023-05-15T16:39:48.597049+0000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-15T16:39:49.394028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-15T16:39:55.208679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-15T16:39:59.547414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-15T16:40:00.055526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37594},{"type":"v1","addr":"172.21.15.62:6825","nonce":37594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37594},{"type":"v1","addr":"172.21.15.62:6827","nonce":37594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37594},{"type":"v1","addr":"172.21.15.62:6831","nonce":37594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37594},{"type":"v1","addr":"172.21.15.62:6829","nonce":37594}]},"public_addr":"172.21.15.62:6825/37594","cluster_addr":"172.21.15.62:6827/37594","heartbeat_back_addr":"172.21.15.62:6831/37594","heartbeat_front_addr":"172.21.15.62:6829/37594","state":["exists","up"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37592},{"type":"v1","addr":"172.21.15.62:6808","nonce":37592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":37592},{"type":"v1","addr":"172.21.15.62:6814","nonce":37592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6821","nonce":37592},{"type":"v1","addr":"172.21.15.62:6823","nonce":37592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37592},{"type":"v1","addr":"172.21.15.62:6818","nonce":37592}]},"public_addr":"172.21.15.62:6808/37592","cluster_addr":"172.21.15.62:6814/37592","heartbeat_back_addr":"172.21.15.62:6823/37592","heartbeat_front_addr":"172.21.15.62:6818/37592","state":["exists","up"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":37591},{"type":"v1","addr":"172.21.15.62:6810","nonce":37591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":37591},{"type":"v1","addr":"172.21.15.62:6815","nonce":37591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37591},{"type":"v1","addr":"172.21.15.62:6822","nonce":37591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":37591},{"type":"v1","addr":"172.21.15.62:6819","nonce":37591}]},"public_addr":"172.21.15.62:6810/37591","cluster_addr":"172.21.15.62:6815/37591","heartbeat_back_addr":"172.21.15.62:6822/37591","heartbeat_front_addr":"172.21.15.62:6819/37591","state":["exists","up"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37593},{"type":"v1","addr":"172.21.15.62:6801","nonce":37593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37593},{"type":"v1","addr":"172.21.15.62:6803","nonce":37593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":37593},{"type":"v1","addr":"172.21.15.62:6812","nonce":37593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37593},{"type":"v1","addr":"172.21.15.62:6805","nonce":37593}]},"public_addr":"172.21.15.62:6801/37593","cluster_addr":"172.21.15.62:6803/37593","heartbeat_back_addr":"172.21.15.62:6812/37593","heartbeat_front_addr":"172.21.15.62:6805/37593","state":["exists","up"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37854},{"type":"v1","addr":"172.21.15.161:6801","nonce":37854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37854},{"type":"v1","addr":"172.21.15.161:6803","nonce":37854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37854},{"type":"v1","addr":"172.21.15.161:6807","nonce":37854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37854},{"type":"v1","addr":"172.21.15.161:6805","nonce":37854}]},"public_addr":"172.21.15.161:6801/37854","cluster_addr":"172.21.15.161:6803/37854","heartbeat_back_addr":"172.21.15.161:6807/37854","heartbeat_front_addr":"172.21.15.161:6805/37854","state":["exists","up"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37855},{"type":"v1","addr":"172.21.15.161:6810","nonce":37855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37855},{"type":"v1","addr":"172.21.15.161:6815","nonce":37855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37855},{"type":"v1","addr":"172.21.15.161:6824","nonce":37855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37855},{"type":"v1","addr":"172.21.15.161:6820","nonce":37855}]},"public_addr":"172.21.15.161:6810/37855","cluster_addr":"172.21.15.161:6815/37855","heartbeat_back_addr":"172.21.15.161:6824/37855","heartbeat_front_addr":"172.21.15.161:6820/37855","state":["exists","up"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":37856},{"type":"v1","addr":"172.21.15.161:6814","nonce":37856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37856},{"type":"v1","addr":"172.21.15.161:6819","nonce":37856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":37856},{"type":"v1","addr":"172.21.15.161:6830","nonce":37856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37856},{"type":"v1","addr":"172.21.15.161:6826","nonce":37856}]},"public_addr":"172.21.15.161:6814/37856","cluster_addr":"172.21.15.161:6819/37856","heartbeat_back_addr":"172.21.15.161:6830/37856","heartbeat_front_addr":"172.21.15.161:6826/37856","state":["exists","up"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":37857},{"type":"v1","addr":"172.21.15.161:6813","nonce":37857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":37857},{"type":"v1","addr":"172.21.15.161:6821","nonce":37857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":37857},{"type":"v1","addr":"172.21.15.161:6831","nonce":37857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":37857},{"type":"v1","addr":"172.21.15.161:6827","nonce":37857}]},"public_addr":"172.21.15.161:6813/37857","cluster_addr":"172.21.15.161:6821/37857","heartbeat_back_addr":"172.21.15.161:6831/37857","heartbeat_front_addr":"172.21.15.161:6827/37857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.592907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.618143+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.641533+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.614355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.579293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.718353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.730135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.792887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:40:18.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.699+0000 7f0f69cce640 1 -- 172.21.15.62:0/4284533293 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0f440653b0 msgr2=0x7f0f44067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:18.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.699+0000 7f0f69cce640 1 --2- 172.21.15.62:0/4284533293 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0f440653b0 0x7f0f44067860 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0f6406ba60 tx=0x7f0f54009040 comp rx=0 tx=0).stop 2023-05-15T16:40:18.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.699+0000 7f0f69cce640 1 -- 172.21.15.62:0/4284533293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f640bbba0 msgr2=0x7f0f64099f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:18.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.699+0000 7f0f69cce640 1 --2- 172.21.15.62:0/4284533293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f640bbba0 0x7f0f64099f80 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c00c7f0 tx=0x7f0f4c00cbf0 comp rx=0 tx=0).stop 2023-05-15T16:40:18.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.699+0000 7f0f69cce640 1 -- 172.21.15.62:0/4284533293 shutdown_connections 2023-05-15T16:40:18.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.699+0000 7f0f69cce640 1 --2- 172.21.15.62:0/4284533293 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0f64143dc0 0x7f0f641e5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:18.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.699+0000 7f0f69cce640 1 --2- 172.21.15.62:0/4284533293 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0f640bd010 0x7f0f641e59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:18.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.699+0000 7f0f69cce640 1 --2- 172.21.15.62:0/4284533293 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0f440653b0 0x7f0f44067860 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:18.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.699+0000 7f0f69cce640 1 --2- 172.21.15.62:0/4284533293 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0f640bbba0 0x7f0f64099f80 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:18.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.699+0000 7f0f69cce640 1 -- 172.21.15.62:0/4284533293 >> 172.21.15.62:0/4284533293 conn(0x7f0f640bffc0 msgr2=0x7f0f640a5220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:18.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.699+0000 7f0f69cce640 1 -- 172.21.15.62:0/4284533293 shutdown_connections 2023-05-15T16:40:18.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.699+0000 7f0f69cce640 1 -- 172.21.15.62:0/4284533293 wait complete. 2023-05-15T16:40:18.723 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-15T16:39:49.394028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-15T16:39:55.208679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-15T16:39:59.547414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-15T16:40:00.055526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-15T16:40:18.725 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-15T16:40:18.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.843+0000 7fe9112aa640 1 Processor -- start 2023-05-15T16:40:18.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.843+0000 7fe9112aa640 1 -- start start 2023-05-15T16:40:18.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.843+0000 7fe9112aa640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe90c0b7ba0 0x7fe90c0bd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:18.847 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.843+0000 7fe9112aa640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe90c0b8fd0 0x7fe90c0b4770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:18.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.843+0000 7fe9112aa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe90c0b7f70 0x7fe90c147bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:18.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.843+0000 7fe9112aa640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe90c0b88b0 con 0x7fe90c0b7ba0 2023-05-15T16:40:18.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.843+0000 7fe9112aa640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe90c142200 con 0x7fe90c0b8fd0 2023-05-15T16:40:18.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.843+0000 7fe9112aa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c0b9db0 con 0x7fe90c0b7f70 2023-05-15T16:40:18.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.843+0000 7fe90affd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe90c0b7ba0 0x7fe90c0bd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:18.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.843+0000 7fe90affd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fe90c0b7ba0 0x7fe90c0bd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48580/0 (socket says 172.21.15.62:48580) 2023-05-15T16:40:18.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.843+0000 7fe90affd640 1 -- 172.21.15.62:0/249433985 learned_addr learned my addr 172.21.15.62:0/249433985 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:18.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.843+0000 7fe90b7fe640 1 --2- 172.21.15.62:0/249433985 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe90c0b7f70 0x7fe90c147bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:18.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.843+0000 7fe90a7fc640 1 --2- 172.21.15.62:0/249433985 >> v2:172.21.15.161:3300/0 conn(0x7fe90c0b8fd0 0x7fe90c0b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:18.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.843+0000 7fe90affd640 1 -- 172.21.15.62:0/249433985 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe90c0b7f70 msgr2=0x7fe90c147bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:18.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.843+0000 7fe90affd640 1 --2- 172.21.15.62:0/249433985 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe90c0b7f70 0x7fe90c147bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:18.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.843+0000 7fe90affd640 1 -- 172.21.15.62:0/249433985 >> v2:172.21.15.161:3300/0 conn(0x7fe90c0b8fd0 msgr2=0x7fe90c0b4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:18.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.843+0000 7fe90affd640 1 --2- 172.21.15.62:0/249433985 >> v2:172.21.15.161:3300/0 conn(0x7fe90c0b8fd0 0x7fe90c0b4770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:18.850 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.843+0000 7fe90affd640 1 -- 172.21.15.62:0/249433985 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe90c0ba020 con 0x7fe90c0b7ba0 2023-05-15T16:40:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe90affd640 1 --2- 172.21.15.62:0/249433985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe90c0b7ba0 0x7fe90c0bd770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0b5610 tx=0x7fe90001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=955defa1bec98f96 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe909ffb640 1 -- 172.21.15.62:0/249433985 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9000a89b0 con 0x7fe90c0b7ba0 2023-05-15T16:40:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe909ffb640 1 -- 172.21.15.62:0/249433985 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9000a8b10 con 0x7fe90c0b7ba0 2023-05-15T16:40:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe909ffb640 1 -- 172.21.15.62:0/249433985 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9000a8ea0 con 0x7fe90c0b7ba0 2023-05-15T16:40:18.851 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe9112aa640 1 -- 172.21.15.62:0/249433985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe90c0b7ba0 msgr2=0x7fe90c0bd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe9112aa640 1 --2- 172.21.15.62:0/249433985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe90c0b7ba0 0x7fe90c0bd770 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fe90c0b5610 tx=0x7fe90001ecf0 comp rx=0 tx=0).stop 2023-05-15T16:40:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe9112aa640 1 -- 172.21.15.62:0/249433985 shutdown_connections 2023-05-15T16:40:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe9112aa640 1 --2- 172.21.15.62:0/249433985 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe90c0b7f70 0x7fe90c147bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe9112aa640 1 --2- 172.21.15.62:0/249433985 >> v2:172.21.15.161:3300/0 conn(0x7fe90c0b8fd0 0x7fe90c0b4770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe9112aa640 1 --2- 172.21.15.62:0/249433985 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe90c0b7ba0 0x7fe90c0bd770 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe9112aa640 1 -- 172.21.15.62:0/249433985 >> 172.21.15.62:0/249433985 conn(0x7fe90c0bdde0 msgr2=0x7fe90c0be1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:18.852 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe9112aa640 1 -- 172.21.15.62:0/249433985 shutdown_connections 2023-05-15T16:40:18.853 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe9112aa640 1 -- 172.21.15.62:0/249433985 wait complete. 2023-05-15T16:40:18.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe9112aa640 1 Processor -- start 2023-05-15T16:40:18.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe9112aa640 1 -- start start 2023-05-15T16:40:18.854 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe9112aa640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe90c0b7ba0 0x7fe90c143a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:18.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe9112aa640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe90c0b7f70 0x7fe90c142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:18.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe9112aa640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe90c0b8fd0 0x7fe90c1dcf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:18.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe9112aa640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c1452e0 con 0x7fe90c0b7f70 2023-05-15T16:40:18.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe9112aa640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c06d130 con 0x7fe90c0b8fd0 2023-05-15T16:40:18.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe9112aa640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe90c1449b0 con 0x7fe90c0b7ba0 2023-05-15T16:40:18.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe90a7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe90c0b7f70 0x7fe90c142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:18.855 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe90a7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe90c0b7f70 0x7fe90c142a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48586/0 (socket says 172.21.15.62:48586) 2023-05-15T16:40:18.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.847+0000 7fe90a7fc640 1 -- 172.21.15.62:0/2867964673 learned_addr learned my addr 172.21.15.62:0/2867964673 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:18.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.851+0000 7fe90b7fe640 1 --2- 172.21.15.62:0/2867964673 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe90c0b8fd0 0x7fe90c1dcf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:18.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.851+0000 7fe90affd640 1 --2- 172.21.15.62:0/2867964673 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe90c0b7ba0 0x7fe90c143a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:18.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.851+0000 7fe90a7fc640 1 -- 172.21.15.62:0/2867964673 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe90c0b7ba0 msgr2=0x7fe90c143a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:18.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.851+0000 7fe90a7fc640 1 --2- 172.21.15.62:0/2867964673 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe90c0b7ba0 0x7fe90c143a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:18.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.851+0000 7fe90a7fc640 1 -- 172.21.15.62:0/2867964673 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe90c0b8fd0 msgr2=0x7fe90c1dcf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:18.856 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.851+0000 7fe90a7fc640 1 --2- 172.21.15.62:0/2867964673 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe90c0b8fd0 0x7fe90c1dcf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:18.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.851+0000 7fe90a7fc640 1 -- 172.21.15.62:0/2867964673 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9000094d0 con 0x7fe90c0b7f70 2023-05-15T16:40:18.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.851+0000 7fe90a7fc640 1 --2- 172.21.15.62:0/2867964673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe90c0b7f70 0x7fe90c142a30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00e870 tx=0x7fe8fc00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:18.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.851+0000 7fe8f37fe640 1 -- 172.21.15.62:0/2867964673 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc009510 con 0x7fe90c0b7f70 2023-05-15T16:40:18.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.851+0000 7fe8f37fe640 1 -- 172.21.15.62:0/2867964673 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8fc00eec0 con 0x7fe90c0b7f70 2023-05-15T16:40:18.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.851+0000 7fe8f37fe640 1 -- 172.21.15.62:0/2867964673 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8fc00cb40 con 0x7fe90c0b7f70 2023-05-15T16:40:18.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.851+0000 7fe9112aa640 1 -- 172.21.15.62:0/2867964673 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe90c0b94d0 con 0x7fe90c0b7f70 2023-05-15T16:40:18.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.851+0000 7fe9112aa640 1 -- 172.21.15.62:0/2867964673 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe90c0ba300 con 0x7fe90c0b7f70 2023-05-15T16:40:18.857 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.851+0000 7fe9112aa640 1 -- 172.21.15.62:0/2867964673 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe90c0b9660 con 0x7fe90c0b7f70 2023-05-15T16:40:18.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.851+0000 7fe8f37fe640 1 -- 172.21.15.62:0/2867964673 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fe8fc00cca0 con 0x7fe90c0b7f70 2023-05-15T16:40:18.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.851+0000 7fe8f37fe640 1 --2- 172.21.15.62:0/2867964673 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe8f8065380 0x7fe8f8067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:18.858 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.851+0000 7fe8f37fe640 1 -- 172.21.15.62:0/2867964673 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe8fc082980 con 0x7fe90c0b7f70 2023-05-15T16:40:18.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.851+0000 7fe90affd640 1 --2- 172.21.15.62:0/2867964673 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe8f8065380 0x7fe8f8067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:18.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.851+0000 7fe90affd640 1 --2- 172.21.15.62:0/2867964673 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe8f8065380 0x7fe8f8067830 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe9000b2000 tx=0x7fe900008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:18.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:18.855+0000 7fe8f37fe640 1 -- 172.21.15.62:0/2867964673 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fe8fc050600 con 0x7fe90c0b7f70 2023-05-15T16:40:19.014 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.011+0000 7fe9112aa640 1 -- 172.21.15.62:0/2867964673 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe90c04dbe0 con 0x7fe90c0b7f70 2023-05-15T16:40:19.015 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.011+0000 7fe8f37fe640 1 -- 172.21.15.62:0/2867964673 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe8fc082070 con 0x7fe90c0b7f70 2023-05-15T16:40:19.015 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-05-15T16:40:19.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.011+0000 7fe9112aa640 1 -- 172.21.15.62:0/2867964673 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe8f8065380 msgr2=0x7fe8f8067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:19.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.011+0000 7fe9112aa640 1 --2- 172.21.15.62:0/2867964673 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe8f8065380 0x7fe8f8067830 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fe9000b2000 tx=0x7fe900008040 comp rx=0 tx=0).stop 2023-05-15T16:40:19.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.011+0000 7fe9112aa640 1 -- 172.21.15.62:0/2867964673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe90c0b7f70 msgr2=0x7fe90c142a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:19.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.011+0000 7fe9112aa640 1 --2- 172.21.15.62:0/2867964673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe90c0b7f70 0x7fe90c142a30 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe8fc00e870 tx=0x7fe8fc00ec70 comp rx=0 tx=0).stop 2023-05-15T16:40:19.017 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.011+0000 7fe9112aa640 1 -- 172.21.15.62:0/2867964673 shutdown_connections 2023-05-15T16:40:19.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.011+0000 7fe9112aa640 1 --2- 172.21.15.62:0/2867964673 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe90c0b8fd0 0x7fe90c1dcf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.011+0000 7fe9112aa640 1 --2- 172.21.15.62:0/2867964673 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe8f8065380 0x7fe8f8067830 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.011+0000 7fe9112aa640 1 --2- 172.21.15.62:0/2867964673 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe90c0b7f70 0x7fe90c142a30 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.011+0000 7fe9112aa640 1 --2- 172.21.15.62:0/2867964673 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe90c0b7ba0 0x7fe90c143a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.011+0000 7fe9112aa640 1 -- 172.21.15.62:0/2867964673 >> 172.21.15.62:0/2867964673 conn(0x7fe90c0bdde0 msgr2=0x7fe90c0bc280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:19.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.011+0000 7fe9112aa640 1 -- 172.21.15.62:0/2867964673 shutdown_connections 2023-05-15T16:40:19.018 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.011+0000 7fe9112aa640 1 -- 172.21.15.62:0/2867964673 wait complete. 2023-05-15T16:40:19.033 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-15T16:40:19.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f146ecab640 1 Processor -- start 2023-05-15T16:40:19.150 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f146ecab640 1 -- start start 2023-05-15T16:40:19.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f146ecab640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f14680a2160 0x7f1468143e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f146ecab640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1468144360 0x7f146806b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f146ecab640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14680bc820 con 0x7f146806a730 2023-05-15T16:40:19.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f146ecab640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14680bbd40 con 0x7f14680a2160 2023-05-15T16:40:19.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f146ecab640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14680bc260 con 0x7f1468144360 2023-05-15T16:40:19.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f146d248640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f146806a730 0x7f146814d340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58136/0 (socket says 172.21.15.62:58136) 2023-05-15T16:40:19.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f146d248640 1 -- 172.21.15.62:0/3275511964 learned_addr learned my addr 172.21.15.62:0/3275511964 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:19.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f146ca47640 1 --2- 172.21.15.62:0/3275511964 >> v2:172.21.15.161:3300/0 conn(0x7f14680a2160 0x7f1468143e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f1467fff640 1 --2- 172.21.15.62:0/3275511964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1468144360 0x7f146806b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f14677fe640 1 -- 172.21.15.62:0/3275511964 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1864509221 0 0) 0x7f14680bc820 con 0x7f146806a730 2023-05-15T16:40:19.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f14677fe640 1 -- 172.21.15.62:0/3275511964 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1458003530 con 0x7f146806a730 2023-05-15T16:40:19.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f14677fe640 1 -- 172.21.15.62:0/3275511964 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 412495400 0 0) 0x7f1458003530 con 0x7f146806a730 2023-05-15T16:40:19.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f14677fe640 1 -- 172.21.15.62:0/3275511964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1468144360 msgr2=0x7f146806b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:19.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f14677fe640 1 --2- 172.21.15.62:0/3275511964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1468144360 0x7f146806b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f14677fe640 1 -- 172.21.15.62:0/3275511964 >> v2:172.21.15.161:3300/0 conn(0x7f14680a2160 msgr2=0x7f1468143e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:19.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f14677fe640 1 --2- 172.21.15.62:0/3275511964 >> v2:172.21.15.161:3300/0 conn(0x7f14680a2160 0x7f1468143e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f14677fe640 1 -- 172.21.15.62:0/3275511964 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14680bc540 con 0x7f146806a730 2023-05-15T16:40:19.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f14677fe640 1 -- 172.21.15.62:0/3275511964 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7f1460001a00 con 0x7f146806a730 2023-05-15T16:40:19.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f14677fe640 1 -- 172.21.15.62:0/3275511964 >> v1:172.21.15.62:6789/0 conn(0x7f146806a730 legacy=0x7f146814d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:19.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f14677fe640 1 --2- 172.21.15.62:0/3275511964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1458003980 0x7f1458003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f14677fe640 1 --2- 172.21.15.62:0/3275511964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14580043b0 0x7f1458004870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f14677fe640 1 --2- 172.21.15.62:0/3275511964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1458004ee0 0x7f145800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f14677fe640 1 -- 172.21.15.62:0/3275511964 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14680bbd40 con 0x7f1458003980 2023-05-15T16:40:19.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f14677fe640 1 -- 172.21.15.62:0/3275511964 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14680bc260 con 0x7f14580043b0 2023-05-15T16:40:19.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f14677fe640 1 -- 172.21.15.62:0/3275511964 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1458005590 con 0x7f1458004ee0 2023-05-15T16:40:19.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f146ca47640 1 --2- 172.21.15.62:0/3275511964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1458003980 0x7f1458003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f1467fff640 1 --2- 172.21.15.62:0/3275511964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14580043b0 0x7f1458004870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f146d248640 1 --2- 172.21.15.62:0/3275511964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1458004ee0 0x7f145800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f146ca47640 1 -- 172.21.15.62:0/3275511964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1458004ee0 msgr2=0x7f145800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:19.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f146ca47640 1 --2- 172.21.15.62:0/3275511964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1458004ee0 0x7f145800b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f146ca47640 1 -- 172.21.15.62:0/3275511964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14580043b0 msgr2=0x7f1458004870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:19.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f146ca47640 1 --2- 172.21.15.62:0/3275511964 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14580043b0 0x7f1458004870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f146ca47640 1 -- 172.21.15.62:0/3275511964 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1458003530 con 0x7f1458003980 2023-05-15T16:40:19.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.147+0000 7f146d248640 1 --2- 172.21.15.62:0/3275511964 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1458004ee0 0x7f145800b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:19.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ca47640 1 --2- 172.21.15.62:0/3275511964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1458003980 0x7f1458003d90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f145c009ae0 tx=0x7f145c01ca60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0a4f0d4171e28a server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:19.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f14677fe640 1 -- 172.21.15.62:0/3275511964 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c0a5650 con 0x7f1458003980 2023-05-15T16:40:19.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f14677fe640 1 -- 172.21.15.62:0/3275511964 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145c0a57b0 con 0x7f1458003980 2023-05-15T16:40:19.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f14677fe640 1 -- 172.21.15.62:0/3275511964 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c0a5b60 con 0x7f1458003980 2023-05-15T16:40:19.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ecab640 1 -- 172.21.15.62:0/3275511964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1458003980 msgr2=0x7f1458003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:19.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ecab640 1 --2- 172.21.15.62:0/3275511964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1458003980 0x7f1458003d90 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f145c009ae0 tx=0x7f145c01ca60 comp rx=0 tx=0).stop 2023-05-15T16:40:19.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146d248640 1 -- 172.21.15.62:0/3275511964 reap_dead start 2023-05-15T16:40:19.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ecab640 1 -- 172.21.15.62:0/3275511964 shutdown_connections 2023-05-15T16:40:19.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ecab640 1 -- 172.21.15.62:0/3275511964 >> 172.21.15.62:0/3275511964 conn(0x7f14680bffb0 msgr2=0x7f14680c03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:19.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ecab640 1 -- 172.21.15.62:0/3275511964 shutdown_connections 2023-05-15T16:40:19.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ecab640 1 -- 172.21.15.62:0/3275511964 wait complete. 2023-05-15T16:40:19.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ecab640 1 Processor -- start 2023-05-15T16:40:19.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ecab640 1 -- start start 2023-05-15T16:40:19.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ecab640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1458003980 0x7f14680b75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ecab640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14680b7b00 0x7f14680a55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ecab640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14680a5ae0 0x7f14680a3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ecab640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14680a5f60 con 0x7f1458003980 2023-05-15T16:40:19.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ecab640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14681e31e0 con 0x7f14680a5ae0 2023-05-15T16:40:19.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ecab640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14681e2420 con 0x7f14680b7b00 2023-05-15T16:40:19.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ca47640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1458003980 0x7f14680b75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ca47640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1458003980 0x7f14680b75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48594/0 (socket says 172.21.15.62:48594) 2023-05-15T16:40:19.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ca47640 1 -- 172.21.15.62:0/3436505423 learned_addr learned my addr 172.21.15.62:0/3436505423 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:19.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146d248640 1 --2- 172.21.15.62:0/3436505423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14680a5ae0 0x7f14680a3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f1467fff640 1 --2- 172.21.15.62:0/3436505423 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14680b7b00 0x7f14680a55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ca47640 1 -- 172.21.15.62:0/3436505423 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14680b7b00 msgr2=0x7f14680a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:19.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ca47640 1 --2- 172.21.15.62:0/3436505423 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14680b7b00 0x7f14680a55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ca47640 1 -- 172.21.15.62:0/3436505423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14680a5ae0 msgr2=0x7f14680a3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:19.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ca47640 1 --2- 172.21.15.62:0/3436505423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14680a5ae0 0x7f14680a3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146ca47640 1 -- 172.21.15.62:0/3436505423 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146806b0a0 con 0x7f1458003980 2023-05-15T16:40:19.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.151+0000 7f146d248640 1 --2- 172.21.15.62:0/3436505423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14680a5ae0 0x7f14680a3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:19.169 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.155+0000 7f146ca47640 1 --2- 172.21.15.62:0/3436505423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1458003980 0x7f14680b75c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f145c0b0040 tx=0x7f1458005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:19.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.155+0000 7f14657fa640 1 -- 172.21.15.62:0/3436505423 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c0a5650 con 0x7f1458003980 2023-05-15T16:40:19.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.155+0000 7f14657fa640 1 -- 172.21.15.62:0/3436505423 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145c004220 con 0x7f1458003980 2023-05-15T16:40:19.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.155+0000 7f146ecab640 1 -- 172.21.15.62:0/3436505423 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14680ba930 con 0x7f1458003980 2023-05-15T16:40:19.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.155+0000 7f14657fa640 1 -- 172.21.15.62:0/3436505423 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145c003620 con 0x7f1458003980 2023-05-15T16:40:19.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.155+0000 7f146ecab640 1 -- 172.21.15.62:0/3436505423 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f146806b230 con 0x7f1458003980 2023-05-15T16:40:19.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.155+0000 7f146ecab640 1 -- 172.21.15.62:0/3436505423 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1468067960 con 0x7f1458003980 2023-05-15T16:40:19.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.155+0000 7f14657fa640 1 -- 172.21.15.62:0/3436505423 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f145c0b4040 con 0x7f1458003980 2023-05-15T16:40:19.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.155+0000 7f14657fa640 1 --2- 172.21.15.62:0/3436505423 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f144c065380 0x7f144c067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.155+0000 7f14657fa640 1 -- 172.21.15.62:0/3436505423 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f145c11c1c0 con 0x7f1458003980 2023-05-15T16:40:19.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.155+0000 7f1467fff640 1 --2- 172.21.15.62:0/3436505423 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f144c065380 0x7f144c067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.155+0000 7f1467fff640 1 --2- 172.21.15.62:0/3436505423 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f144c065380 0x7f144c067830 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f14680a4e20 tx=0x7f1454008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:19.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.159+0000 7f14657fa640 1 -- 172.21.15.62:0/3436505423 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f145c0e9dc0 con 0x7f1458003980 2023-05-15T16:40:19.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.303+0000 7f146ecab640 1 -- 172.21.15.62:0/3436505423 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f146804dbe0 con 0x7f1458003980 2023-05-15T16:40:19.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.303+0000 7f14657fa640 1 -- 172.21.15.62:0/3436505423 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f145c0ed3e0 con 0x7f1458003980 2023-05-15T16:40:19.309 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-05-15T16:40:19.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.307+0000 7f146ecab640 1 -- 172.21.15.62:0/3436505423 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f144c065380 msgr2=0x7f144c067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:19.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.307+0000 7f146ecab640 1 --2- 172.21.15.62:0/3436505423 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f144c065380 0x7f144c067830 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f14680a4e20 tx=0x7f1454008040 comp rx=0 tx=0).stop 2023-05-15T16:40:19.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.307+0000 7f146ecab640 1 -- 172.21.15.62:0/3436505423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1458003980 msgr2=0x7f14680b75c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:19.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.307+0000 7f146ecab640 1 --2- 172.21.15.62:0/3436505423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1458003980 0x7f14680b75c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f145c0b0040 tx=0x7f1458005800 comp rx=0 tx=0).stop 2023-05-15T16:40:19.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.307+0000 7f146ecab640 1 -- 172.21.15.62:0/3436505423 shutdown_connections 2023-05-15T16:40:19.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.307+0000 7f146ecab640 1 --2- 172.21.15.62:0/3436505423 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f14680a5ae0 0x7f14680a3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.307+0000 7f146ecab640 1 --2- 172.21.15.62:0/3436505423 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f14680b7b00 0x7f14680a55a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.307+0000 7f146ecab640 1 --2- 172.21.15.62:0/3436505423 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f144c065380 0x7f144c067830 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.307+0000 7f146ecab640 1 --2- 172.21.15.62:0/3436505423 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1458003980 0x7f14680b75c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.307+0000 7f146ecab640 1 -- 172.21.15.62:0/3436505423 >> 172.21.15.62:0/3436505423 conn(0x7f14680bffb0 msgr2=0x7f14680beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:19.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.307+0000 7f146ecab640 1 -- 172.21.15.62:0/3436505423 shutdown_connections 2023-05-15T16:40:19.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.307+0000 7f146ecab640 1 -- 172.21.15.62:0/3436505423 wait complete. 2023-05-15T16:40:19.326 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-15T16:40:19.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.435+0000 7fb3bf972640 1 Processor -- start 2023-05-15T16:40:19.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.435+0000 7fb3bf972640 1 -- start start 2023-05-15T16:40:19.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3bf972640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fb3b81441b0 0x7fb3b80b86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3bf972640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3b80be0a0 0x7fb3b80b9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3bf972640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3b806c7b0 con 0x7fb3b80be4d0 2023-05-15T16:40:19.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3bf972640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3b806b5e0 con 0x7fb3b81441b0 2023-05-15T16:40:19.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3bf972640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b8144580 con 0x7fb3b80be0a0 2023-05-15T16:40:19.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3bdf0f640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb3b80be4d0 0x7fb3b80ba790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58152/0 (socket says 172.21.15.62:58152) 2023-05-15T16:40:19.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3bdf0f640 1 -- 172.21.15.62:0/3587211321 learned_addr learned my addr 172.21.15.62:0/3587211321 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:19.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3affff640 1 -- 172.21.15.62:0/3587211321 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692249235 0 0) 0x7fb3b806c7b0 con 0x7fb3b80be4d0 2023-05-15T16:40:19.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3bd70e640 1 --2- 172.21.15.62:0/3587211321 >> v2:172.21.15.161:3300/0 conn(0x7fb3b81441b0 0x7fb3b80b86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3bcf0d640 1 --2- 172.21.15.62:0/3587211321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3b80be0a0 0x7fb3b80b9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3affff640 1 -- 172.21.15.62:0/3587211321 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3a4003530 con 0x7fb3b80be4d0 2023-05-15T16:40:19.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3affff640 1 -- 172.21.15.62:0/3587211321 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1051129876 0 0) 0x7fb3a4003530 con 0x7fb3b80be4d0 2023-05-15T16:40:19.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3affff640 1 -- 172.21.15.62:0/3587211321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3b80be0a0 msgr2=0x7fb3b80b9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:19.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3affff640 1 --2- 172.21.15.62:0/3587211321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3b80be0a0 0x7fb3b80b9ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3affff640 1 -- 172.21.15.62:0/3587211321 >> v2:172.21.15.161:3300/0 conn(0x7fb3b81441b0 msgr2=0x7fb3b80b86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:19.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3affff640 1 --2- 172.21.15.62:0/3587211321 >> v2:172.21.15.161:3300/0 conn(0x7fb3b81441b0 0x7fb3b80b86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3affff640 1 -- 172.21.15.62:0/3587211321 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b806bbe0 con 0x7fb3b80be4d0 2023-05-15T16:40:19.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3affff640 1 -- 172.21.15.62:0/3587211321 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7fb3b4001a00 con 0x7fb3b80be4d0 2023-05-15T16:40:19.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3affff640 1 -- 172.21.15.62:0/3587211321 >> v1:172.21.15.62:6789/0 conn(0x7fb3b80be4d0 legacy=0x7fb3b80ba790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:19.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3affff640 1 --2- 172.21.15.62:0/3587211321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3a4003980 0x7fb3a4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3affff640 1 --2- 172.21.15.62:0/3587211321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3b80be0a0 0x7fb3a40047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3affff640 1 --2- 172.21.15.62:0/3587211321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3a4004d10 0x7fb3a4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.451 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3affff640 1 -- 172.21.15.62:0/3587211321 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b806b5e0 con 0x7fb3a4004d10 2023-05-15T16:40:19.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3affff640 1 -- 172.21.15.62:0/3587211321 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b8144580 con 0x7fb3a4003980 2023-05-15T16:40:19.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3affff640 1 -- 172.21.15.62:0/3587211321 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3a400ba20 con 0x7fb3b80be0a0 2023-05-15T16:40:19.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3bdf0f640 1 --2- 172.21.15.62:0/3587211321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3a4004d10 0x7fb3a4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3bd70e640 1 --2- 172.21.15.62:0/3587211321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3a4003980 0x7fb3a4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3bcf0d640 1 --2- 172.21.15.62:0/3587211321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3b80be0a0 0x7fb3a40047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3bdf0f640 1 -- 172.21.15.62:0/3587211321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3b80be0a0 msgr2=0x7fb3a40047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:19.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3bdf0f640 1 --2- 172.21.15.62:0/3587211321 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3b80be0a0 0x7fb3a40047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3bdf0f640 1 -- 172.21.15.62:0/3587211321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3a4003980 msgr2=0x7fb3a4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:19.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3bdf0f640 1 --2- 172.21.15.62:0/3587211321 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3a4003980 0x7fb3a4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.439+0000 7fb3bdf0f640 1 -- 172.21.15.62:0/3587211321 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3a4003530 con 0x7fb3a4004d10 2023-05-15T16:40:19.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bdf0f640 1 --2- 172.21.15.62:0/3587211321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3a4004d10 0x7fb3a4005180 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400a8d0 tx=0x7fb3b401d3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6048a4d0815800c7 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:19.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3affff640 1 -- 172.21.15.62:0/3587211321 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40ad630 con 0x7fb3a4004d10 2023-05-15T16:40:19.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3affff640 1 -- 172.21.15.62:0/3587211321 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3b40a8070 con 0x7fb3a4004d10 2023-05-15T16:40:19.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3affff640 1 -- 172.21.15.62:0/3587211321 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3b40ad9d0 con 0x7fb3a4004d10 2023-05-15T16:40:19.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bf972640 1 -- 172.21.15.62:0/3587211321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3a4004d10 msgr2=0x7fb3a4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:19.461 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bf972640 1 --2- 172.21.15.62:0/3587211321 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3a4004d10 0x7fb3a4005180 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb3b400a8d0 tx=0x7fb3b401d3e0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bdf0f640 1 -- 172.21.15.62:0/3587211321 reap_dead start 2023-05-15T16:40:19.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bf972640 1 -- 172.21.15.62:0/3587211321 shutdown_connections 2023-05-15T16:40:19.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bf972640 1 -- 172.21.15.62:0/3587211321 >> 172.21.15.62:0/3587211321 conn(0x7fb3b806e480 msgr2=0x7fb3b806e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:19.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bf972640 1 -- 172.21.15.62:0/3587211321 shutdown_connections 2023-05-15T16:40:19.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bf972640 1 -- 172.21.15.62:0/3587211321 wait complete. 2023-05-15T16:40:19.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bf972640 1 Processor -- start 2023-05-15T16:40:19.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bf972640 1 -- start start 2023-05-15T16:40:19.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bf972640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3a4004d10 0x7fb3b813d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bf972640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3b813b7f0 0x7fb3b81df7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bf972640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3b814ac90 0x7fb3b813be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bf972640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b813ecd0 con 0x7fb3b813b7f0 2023-05-15T16:40:19.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bf972640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b81dedd0 con 0x7fb3a4004d10 2023-05-15T16:40:19.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bf972640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3b813da70 con 0x7fb3b814ac90 2023-05-15T16:40:19.463 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bcf0d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3b813b7f0 0x7fb3b81df7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bcf0d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3b813b7f0 0x7fb3b81df7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48620/0 (socket says 172.21.15.62:48620) 2023-05-15T16:40:19.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bcf0d640 1 -- 172.21.15.62:0/4216486377 learned_addr learned my addr 172.21.15.62:0/4216486377 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:19.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bd70e640 1 --2- 172.21.15.62:0/4216486377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3a4004d10 0x7fb3b813d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bdf0f640 1 --2- 172.21.15.62:0/4216486377 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3b814ac90 0x7fb3b813be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bcf0d640 1 -- 172.21.15.62:0/4216486377 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3b814ac90 msgr2=0x7fb3b813be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:19.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bcf0d640 1 --2- 172.21.15.62:0/4216486377 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3b814ac90 0x7fb3b813be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bcf0d640 1 -- 172.21.15.62:0/4216486377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3a4004d10 msgr2=0x7fb3b813d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:19.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bcf0d640 1 --2- 172.21.15.62:0/4216486377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3a4004d10 0x7fb3b813d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bcf0d640 1 -- 172.21.15.62:0/4216486377 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3b806c160 con 0x7fb3b813b7f0 2023-05-15T16:40:19.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bcf0d640 1 --2- 172.21.15.62:0/4216486377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3b813b7f0 0x7fb3b81df7c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800f580 tx=0x7fb3a800fa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:19.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3adffb640 1 -- 172.21.15.62:0/4216486377 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8014870 con 0x7fb3b813b7f0 2023-05-15T16:40:19.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3adffb640 1 -- 172.21.15.62:0/4216486377 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3a80149d0 con 0x7fb3b813b7f0 2023-05-15T16:40:19.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bf972640 1 -- 172.21.15.62:0/4216486377 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3b806be80 con 0x7fb3b813b7f0 2023-05-15T16:40:19.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3adffb640 1 -- 172.21.15.62:0/4216486377 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8014d60 con 0x7fb3b813b7f0 2023-05-15T16:40:19.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.443+0000 7fb3bf972640 1 -- 172.21.15.62:0/4216486377 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3b806c440 con 0x7fb3b813b7f0 2023-05-15T16:40:19.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.447+0000 7fb3bf972640 1 -- 172.21.15.62:0/4216486377 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3b8067960 con 0x7fb3b813b7f0 2023-05-15T16:40:19.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.447+0000 7fb3adffb640 1 -- 172.21.15.62:0/4216486377 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fb3a8015410 con 0x7fb3b813b7f0 2023-05-15T16:40:19.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.447+0000 7fb3adffb640 1 --2- 172.21.15.62:0/4216486377 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb39c065380 0x7fb39c067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.447+0000 7fb3adffb640 1 -- 172.21.15.62:0/4216486377 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb3a80832f0 con 0x7fb3b813b7f0 2023-05-15T16:40:19.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.447+0000 7fb3bd70e640 1 --2- 172.21.15.62:0/4216486377 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb39c065380 0x7fb39c067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.447+0000 7fb3bd70e640 1 --2- 172.21.15.62:0/4216486377 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb39c065380 0x7fb39c067830 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009a30 tx=0x7fb3b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:19.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.451+0000 7fb3adffb640 1 -- 172.21.15.62:0/4216486377 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fb3a8050e90 con 0x7fb3b813b7f0 2023-05-15T16:40:19.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.599+0000 7fb3bf972640 1 -- 172.21.15.62:0/4216486377 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb3b804dbe0 con 0x7fb3b813b7f0 2023-05-15T16:40:19.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.603+0000 7fb3adffb640 1 -- 172.21.15.62:0/4216486377 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb3a80544b0 con 0x7fb3b813b7f0 2023-05-15T16:40:19.606 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-05-15T16:40:19.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.603+0000 7fb3bf972640 1 -- 172.21.15.62:0/4216486377 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb39c065380 msgr2=0x7fb39c067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:19.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.603+0000 7fb3bf972640 1 --2- 172.21.15.62:0/4216486377 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb39c065380 0x7fb39c067830 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb3b0009a30 tx=0x7fb3b0008040 comp rx=0 tx=0).stop 2023-05-15T16:40:19.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.603+0000 7fb3bf972640 1 -- 172.21.15.62:0/4216486377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3b813b7f0 msgr2=0x7fb3b81df7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:19.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.603+0000 7fb3bf972640 1 --2- 172.21.15.62:0/4216486377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3b813b7f0 0x7fb3b81df7c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800f580 tx=0x7fb3a800fa40 comp rx=0 tx=0).stop 2023-05-15T16:40:19.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.603+0000 7fb3bf972640 1 -- 172.21.15.62:0/4216486377 shutdown_connections 2023-05-15T16:40:19.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.603+0000 7fb3bf972640 1 --2- 172.21.15.62:0/4216486377 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb3b814ac90 0x7fb3b813be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.603+0000 7fb3bf972640 1 --2- 172.21.15.62:0/4216486377 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb39c065380 0x7fb39c067830 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.603+0000 7fb3bf972640 1 --2- 172.21.15.62:0/4216486377 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb3b813b7f0 0x7fb3b81df7c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.603+0000 7fb3bf972640 1 --2- 172.21.15.62:0/4216486377 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb3a4004d10 0x7fb3b813d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.603+0000 7fb3bf972640 1 -- 172.21.15.62:0/4216486377 >> 172.21.15.62:0/4216486377 conn(0x7fb3b806e480 msgr2=0x7fb3b81400e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:19.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.603+0000 7fb3bf972640 1 -- 172.21.15.62:0/4216486377 shutdown_connections 2023-05-15T16:40:19.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.603+0000 7fb3bf972640 1 -- 172.21.15.62:0/4216486377 wait complete. 2023-05-15T16:40:19.623 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-15T16:40:19.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.735+0000 7f6a89a71640 1 Processor -- start 2023-05-15T16:40:19.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.735+0000 7f6a89a71640 1 -- start start 2023-05-15T16:40:19.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.735+0000 7f6a89a71640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6a840b4100 0x7f6a840b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.735+0000 7f6a89a71640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a840b3080 0x7f6a84141c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.735+0000 7f6a89a71640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a840b7400 con 0x7f6a841421b0 2023-05-15T16:40:19.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.735+0000 7f6a89a71640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a840b4e70 con 0x7f6a840b4100 2023-05-15T16:40:19.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.735+0000 7f6a89a71640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a840b6640 con 0x7f6a840b3080 2023-05-15T16:40:19.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.735+0000 7f6a837fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6a840b4100 0x7f6a840b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.735+0000 7f6a837fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6a840b4100 0x7f6a840b38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48628/0 (socket says 172.21.15.62:48628) 2023-05-15T16:40:19.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.735+0000 7f6a837fe640 1 -- 172.21.15.62:0/2686109873 learned_addr learned my addr 172.21.15.62:0/2686109873 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:19.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.735+0000 7f6a82ffd640 1 --2- 172.21.15.62:0/2686109873 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a840b3080 0x7f6a84141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.735+0000 7f6a837fe640 1 -- 172.21.15.62:0/2686109873 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a840b3080 msgr2=0x7f6a84141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:19.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.735+0000 7f6a837fe640 1 --2- 172.21.15.62:0/2686109873 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a840b3080 0x7f6a84141c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.735+0000 7f6a837fe640 1 -- 172.21.15.62:0/2686109873 >> v1:172.21.15.161:6789/0 conn(0x7f6a841421b0 legacy=0x7f6a84147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:19.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.735+0000 7f6a837fe640 1 -- 172.21.15.62:0/2686109873 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a840b6920 con 0x7f6a840b4100 2023-05-15T16:40:19.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.735+0000 7f6a82ffd640 1 --2- 172.21.15.62:0/2686109873 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a840b3080 0x7f6a84141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-15T16:40:19.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.739+0000 7f6a837fe640 1 --2- 172.21.15.62:0/2686109873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a840b4100 0x7f6a840b38a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6a74009870 tx=0x7f6a7401c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44fe6f8c24a22fd6 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:19.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.739+0000 7f6a827fc640 1 -- 172.21.15.62:0/2686109873 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a740aa670 con 0x7f6a840b4100 2023-05-15T16:40:19.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.739+0000 7f6a827fc640 1 -- 172.21.15.62:0/2686109873 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a740aa7d0 con 0x7f6a840b4100 2023-05-15T16:40:19.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.739+0000 7f6a827fc640 1 -- 172.21.15.62:0/2686109873 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a740aab60 con 0x7f6a840b4100 2023-05-15T16:40:19.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.739+0000 7f6a89a71640 1 -- 172.21.15.62:0/2686109873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a840b4100 msgr2=0x7f6a840b38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:19.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.739+0000 7f6a89a71640 1 --2- 172.21.15.62:0/2686109873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a840b4100 0x7f6a840b38a0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6a74009870 tx=0x7f6a7401c510 comp rx=0 tx=0).stop 2023-05-15T16:40:19.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.739+0000 7f6a89a71640 1 -- 172.21.15.62:0/2686109873 shutdown_connections 2023-05-15T16:40:19.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.739+0000 7f6a89a71640 1 --2- 172.21.15.62:0/2686109873 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a840b3080 0x7f6a84141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.739+0000 7f6a89a71640 1 --2- 172.21.15.62:0/2686109873 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a840b4100 0x7f6a840b38a0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.739+0000 7f6a89a71640 1 -- 172.21.15.62:0/2686109873 >> 172.21.15.62:0/2686109873 conn(0x7f6a840697b0 msgr2=0x7f6a84069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:19.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.739+0000 7f6a89a71640 1 -- 172.21.15.62:0/2686109873 shutdown_connections 2023-05-15T16:40:19.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.739+0000 7f6a89a71640 1 -- 172.21.15.62:0/2686109873 wait complete. 2023-05-15T16:40:19.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.739+0000 7f6a89a71640 1 Processor -- start 2023-05-15T16:40:19.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.739+0000 7f6a89a71640 1 -- start start 2023-05-15T16:40:19.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a89a71640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a840b3080 0x7f6a84139330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a89a71640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a840b4100 0x7f6a84135ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a89a71640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a841421b0 0x7f6a841e0610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a89a71640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a84136020 con 0x7f6a840b3080 2023-05-15T16:40:19.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a89a71640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a84139fa0 con 0x7f6a841421b0 2023-05-15T16:40:19.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a89a71640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a841399e0 con 0x7f6a840b4100 2023-05-15T16:40:19.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a837fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a840b3080 0x7f6a84139330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a837fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a840b3080 0x7f6a84139330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48630/0 (socket says 172.21.15.62:48630) 2023-05-15T16:40:19.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a837fe640 1 -- 172.21.15.62:0/3710349759 learned_addr learned my addr 172.21.15.62:0/3710349759 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:19.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a83fff640 1 --2- 172.21.15.62:0/3710349759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a841421b0 0x7f6a841e0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a82ffd640 1 --2- 172.21.15.62:0/3710349759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a840b4100 0x7f6a84135ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a837fe640 1 -- 172.21.15.62:0/3710349759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a840b4100 msgr2=0x7f6a84135ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:19.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a837fe640 1 --2- 172.21.15.62:0/3710349759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a840b4100 0x7f6a84135ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a837fe640 1 -- 172.21.15.62:0/3710349759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a841421b0 msgr2=0x7f6a841e0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:19.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a837fe640 1 --2- 172.21.15.62:0/3710349759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a841421b0 0x7f6a841e0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a837fe640 1 -- 172.21.15.62:0/3710349759 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a740094d0 con 0x7f6a840b3080 2023-05-15T16:40:19.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a82ffd640 1 --2- 172.21.15.62:0/3710349759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a840b4100 0x7f6a84135ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:19.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a837fe640 1 --2- 172.21.15.62:0/3710349759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a840b3080 0x7f6a84139330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6a740ac040 tx=0x7f6a7401ad50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:19.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a6bfff640 1 -- 172.21.15.62:0/3710349759 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a740b3800 con 0x7f6a840b3080 2023-05-15T16:40:19.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a6bfff640 1 -- 172.21.15.62:0/3710349759 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a740b3980 con 0x7f6a840b3080 2023-05-15T16:40:19.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a89a71640 1 -- 172.21.15.62:0/3710349759 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a840b44d0 con 0x7f6a840b3080 2023-05-15T16:40:19.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a6bfff640 1 -- 172.21.15.62:0/3710349759 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a740b3d30 con 0x7f6a840b3080 2023-05-15T16:40:19.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a89a71640 1 -- 172.21.15.62:0/3710349759 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a84148340 con 0x7f6a840b3080 2023-05-15T16:40:19.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a89a71640 1 -- 172.21.15.62:0/3710349759 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a840a1dc0 con 0x7f6a840b3080 2023-05-15T16:40:19.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a6bfff640 1 -- 172.21.15.62:0/3710349759 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f6a740c8430 con 0x7f6a840b3080 2023-05-15T16:40:19.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a6bfff640 1 --2- 172.21.15.62:0/3710349759 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6a70065380 0x7f6a70067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:19.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a6bfff640 1 -- 172.21.15.62:0/3710349759 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6a7411d680 con 0x7f6a840b3080 2023-05-15T16:40:19.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.743+0000 7f6a82ffd640 1 --2- 172.21.15.62:0/3710349759 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6a70065380 0x7f6a70067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:19.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.747+0000 7f6a82ffd640 1 --2- 172.21.15.62:0/3710349759 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6a70065380 0x7f6a70067830 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6a840b6100 tx=0x7f6a78008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:19.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.747+0000 7f6a6bfff640 1 -- 172.21.15.62:0/3710349759 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f6a740eb1f0 con 0x7f6a840b3080 2023-05-15T16:40:19.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.899+0000 7f6a89a71640 1 -- 172.21.15.62:0/3710349759 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6a84139b20 con 0x7f6a840b3080 2023-05-15T16:40:19.904 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.899+0000 7f6a6bfff640 1 -- 172.21.15.62:0/3710349759 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6a84139b20 con 0x7f6a840b3080 2023-05-15T16:40:19.905 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-05-15T16:40:19.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.903+0000 7f6a89a71640 1 -- 172.21.15.62:0/3710349759 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6a70065380 msgr2=0x7f6a70067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:19.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.903+0000 7f6a89a71640 1 --2- 172.21.15.62:0/3710349759 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6a70065380 0x7f6a70067830 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f6a840b6100 tx=0x7f6a78008040 comp rx=0 tx=0).stop 2023-05-15T16:40:19.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.903+0000 7f6a89a71640 1 -- 172.21.15.62:0/3710349759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a840b3080 msgr2=0x7f6a84139330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:19.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.903+0000 7f6a89a71640 1 --2- 172.21.15.62:0/3710349759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a840b3080 0x7f6a84139330 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6a740ac040 tx=0x7f6a7401ad50 comp rx=0 tx=0).stop 2023-05-15T16:40:19.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.903+0000 7f6a89a71640 1 -- 172.21.15.62:0/3710349759 shutdown_connections 2023-05-15T16:40:19.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.903+0000 7f6a89a71640 1 --2- 172.21.15.62:0/3710349759 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6a841421b0 0x7f6a841e0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.903+0000 7f6a89a71640 1 --2- 172.21.15.62:0/3710349759 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6a840b4100 0x7f6a84135ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.903+0000 7f6a89a71640 1 --2- 172.21.15.62:0/3710349759 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6a70065380 0x7f6a70067830 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.903+0000 7f6a89a71640 1 --2- 172.21.15.62:0/3710349759 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6a840b3080 0x7f6a84139330 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:19.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.903+0000 7f6a89a71640 1 -- 172.21.15.62:0/3710349759 >> 172.21.15.62:0/3710349759 conn(0x7f6a840697b0 msgr2=0x7f6a8413d750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:19.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.903+0000 7f6a89a71640 1 -- 172.21.15.62:0/3710349759 shutdown_connections 2023-05-15T16:40:19.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:19.903+0000 7f6a89a71640 1 -- 172.21.15.62:0/3710349759 wait complete. 2023-05-15T16:40:19.924 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-15T16:40:20.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.043+0000 7efcad746640 1 Processor -- start 2023-05-15T16:40:20.046 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.043+0000 7efcad746640 1 -- start start 2023-05-15T16:40:20.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.043+0000 7efcad746640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca8069a10 0x7efca8070fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.043+0000 7efcad746640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efca814dcb0 0x7efca8143870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.043+0000 7efcad746640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efca8070c30 con 0x7efca806f980 2023-05-15T16:40:20.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.043+0000 7efcad746640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efca80716a0 con 0x7efca814dcb0 2023-05-15T16:40:20.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.043+0000 7efcad746640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca8071980 con 0x7efca8069a10 2023-05-15T16:40:20.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.043+0000 7efca6ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca8069a10 0x7efca8070fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.043+0000 7efca77fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efca814dcb0 0x7efca8143870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.043+0000 7efca67fc640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7efca806f980 0x7efca814d5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.62:53366/0 (socket says 172.21.15.62:53366) 2023-05-15T16:40:20.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.043+0000 7efca77fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7efca814dcb0 0x7efca8143870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.62:39150/0 (socket says 172.21.15.62:39150) 2023-05-15T16:40:20.048 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.043+0000 7efca6ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca8069a10 0x7efca8070fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.62:60136/0 (socket says 172.21.15.62:60136) 2023-05-15T16:40:20.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.043+0000 7efca67fc640 1 -- 172.21.15.62:0/1052650635 learned_addr learned my addr 172.21.15.62:0/1052650635 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:20.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.043+0000 7efca6ffd640 1 -- 172.21.15.62:0/1052650635 >> v2:172.21.15.161:3300/0 conn(0x7efca814dcb0 msgr2=0x7efca8143870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:20.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.043+0000 7efca6ffd640 1 --2- 172.21.15.62:0/1052650635 >> v2:172.21.15.161:3300/0 conn(0x7efca814dcb0 0x7efca8143870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.043+0000 7efca6ffd640 1 -- 172.21.15.62:0/1052650635 >> v1:172.21.15.161:6789/0 conn(0x7efca806f980 legacy=0x7efca814d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.043+0000 7efca6ffd640 1 -- 172.21.15.62:0/1052650635 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca8071c60 con 0x7efca8069a10 2023-05-15T16:40:20.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.047+0000 7efca6ffd640 1 --2- 172.21.15.62:0/1052650635 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca8069a10 0x7efca8070fe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efc980097c0 tx=0x7efc9801ec70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=55ebd81c85c46c78 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:20.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.047+0000 7efca5ffb640 1 -- 172.21.15.62:0/1052650635 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc980a8970 con 0x7efca8069a10 2023-05-15T16:40:20.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.047+0000 7efca5ffb640 1 -- 172.21.15.62:0/1052650635 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc980a8ad0 con 0x7efca8069a10 2023-05-15T16:40:20.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.047+0000 7efca5ffb640 1 -- 172.21.15.62:0/1052650635 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc980a8e60 con 0x7efca8069a10 2023-05-15T16:40:20.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.047+0000 7efcad746640 1 -- 172.21.15.62:0/1052650635 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca8069a10 msgr2=0x7efca8070fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.047+0000 7efcad746640 1 --2- 172.21.15.62:0/1052650635 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca8069a10 0x7efca8070fe0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efc980097c0 tx=0x7efc9801ec70 comp rx=0 tx=0).stop 2023-05-15T16:40:20.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.047+0000 7efcad746640 1 -- 172.21.15.62:0/1052650635 shutdown_connections 2023-05-15T16:40:20.052 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.047+0000 7efcad746640 1 --2- 172.21.15.62:0/1052650635 >> v2:172.21.15.161:3300/0 conn(0x7efca814dcb0 0x7efca8143870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.047+0000 7efcad746640 1 --2- 172.21.15.62:0/1052650635 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca8069a10 0x7efca8070fe0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.047+0000 7efcad746640 1 -- 172.21.15.62:0/1052650635 >> 172.21.15.62:0/1052650635 conn(0x7efca806a8c0 msgr2=0x7efca806acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:20.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.047+0000 7efcad746640 1 -- 172.21.15.62:0/1052650635 shutdown_connections 2023-05-15T16:40:20.053 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.047+0000 7efcad746640 1 -- 172.21.15.62:0/1052650635 wait complete. 2023-05-15T16:40:20.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.047+0000 7efcad746640 1 Processor -- start 2023-05-15T16:40:20.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.047+0000 7efcad746640 1 -- start start 2023-05-15T16:40:20.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efcad746640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca8069a10 0x7efca813c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.055 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efcad746640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efca814dcb0 0x7efca80b4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efcad746640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efca80b5210 0x7efca80b6390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efcad746640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca81df780 con 0x7efca814dcb0 2023-05-15T16:40:20.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efcad746640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efca81e0500 con 0x7efca80b5210 2023-05-15T16:40:20.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efcad746640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efca81dfa20 con 0x7efca8069a10 2023-05-15T16:40:20.056 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efca67fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efca814dcb0 0x7efca80b4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efca67fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efca814dcb0 0x7efca80b4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48634/0 (socket says 172.21.15.62:48634) 2023-05-15T16:40:20.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efca67fc640 1 -- 172.21.15.62:0/2514303871 learned_addr learned my addr 172.21.15.62:0/2514303871 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:20.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efca6ffd640 1 --2- 172.21.15.62:0/2514303871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca8069a10 0x7efca813c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efca77fe640 1 --2- 172.21.15.62:0/2514303871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efca80b5210 0x7efca80b6390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.057 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efca67fc640 1 -- 172.21.15.62:0/2514303871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca8069a10 msgr2=0x7efca813c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efca67fc640 1 --2- 172.21.15.62:0/2514303871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca8069a10 0x7efca813c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efca67fc640 1 -- 172.21.15.62:0/2514303871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efca80b5210 msgr2=0x7efca80b6390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efca67fc640 1 --2- 172.21.15.62:0/2514303871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efca80b5210 0x7efca80b6390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efca67fc640 1 -- 172.21.15.62:0/2514303871 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc98009420 con 0x7efca814dcb0 2023-05-15T16:40:20.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efca67fc640 1 --2- 172.21.15.62:0/2514303871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efca814dcb0 0x7efca80b4cd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00c420 tx=0x7efc9c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:20.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efc8f7fe640 1 -- 172.21.15.62:0/2514303871 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c005cf0 con 0x7efca814dcb0 2023-05-15T16:40:20.059 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efc8f7fe640 1 -- 172.21.15.62:0/2514303871 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc9c005e50 con 0x7efca814dcb0 2023-05-15T16:40:20.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efc8f7fe640 1 -- 172.21.15.62:0/2514303871 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc9c0072f0 con 0x7efca814dcb0 2023-05-15T16:40:20.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efcad746640 1 -- 172.21.15.62:0/2514303871 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efca8143db0 con 0x7efca814dcb0 2023-05-15T16:40:20.060 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efcad746640 1 -- 172.21.15.62:0/2514303871 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efca8069de0 con 0x7efca814dcb0 2023-05-15T16:40:20.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efcad746640 1 -- 172.21.15.62:0/2514303871 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efca8143f40 con 0x7efca814dcb0 2023-05-15T16:40:20.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efc8f7fe640 1 -- 172.21.15.62:0/2514303871 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7efc9c007450 con 0x7efca814dcb0 2023-05-15T16:40:20.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efc8f7fe640 1 --2- 172.21.15.62:0/2514303871 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7efc94065380 0x7efc94067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efc8f7fe640 1 -- 172.21.15.62:0/2514303871 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efc9c081db0 con 0x7efca814dcb0 2023-05-15T16:40:20.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.051+0000 7efca6ffd640 1 --2- 172.21.15.62:0/2514303871 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7efc94065380 0x7efc94067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.055+0000 7efca6ffd640 1 --2- 172.21.15.62:0/2514303871 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7efc94065380 0x7efc94067830 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efc980b2000 tx=0x7efc980aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:20.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.055+0000 7efc8f7fe640 1 -- 172.21.15.62:0/2514303871 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7efc9c04fac0 con 0x7efca814dcb0 2023-05-15T16:40:20.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.203+0000 7efcad746640 1 -- 172.21.15.62:0/2514303871 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efca80706b0 con 0x7efca814dcb0 2023-05-15T16:40:20.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.207+0000 7efc8f7fe640 1 -- 172.21.15.62:0/2514303871 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17811 (secure 0 0 0) 0x7efc9c017020 con 0x7efca814dcb0 2023-05-15T16:40:20.212 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:20.213 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:40:02.088078+0000","last_up_change":"2023-05-15T16:39:48.597049+0000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-15T16:39:49.394028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-15T16:39:55.208679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-15T16:39:59.547414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-15T16:40:00.055526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37594},{"type":"v1","addr":"172.21.15.62:6825","nonce":37594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37594},{"type":"v1","addr":"172.21.15.62:6827","nonce":37594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37594},{"type":"v1","addr":"172.21.15.62:6831","nonce":37594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37594},{"type":"v1","addr":"172.21.15.62:6829","nonce":37594}]},"public_addr":"172.21.15.62:6825/37594","cluster_addr":"172.21.15.62:6827/37594","heartbeat_back_addr":"172.21.15.62:6831/37594","heartbeat_front_addr":"172.21.15.62:6829/37594","state":["exists","up"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37592},{"type":"v1","addr":"172.21.15.62:6808","nonce":37592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":37592},{"type":"v1","addr":"172.21.15.62:6814","nonce":37592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6821","nonce":37592},{"type":"v1","addr":"172.21.15.62:6823","nonce":37592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37592},{"type":"v1","addr":"172.21.15.62:6818","nonce":37592}]},"public_addr":"172.21.15.62:6808/37592","cluster_addr":"172.21.15.62:6814/37592","heartbeat_back_addr":"172.21.15.62:6823/37592","heartbeat_front_addr":"172.21.15.62:6818/37592","state":["exists","up"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":37591},{"type":"v1","addr":"172.21.15.62:6810","nonce":37591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":37591},{"type":"v1","addr":"172.21.15.62:6815","nonce":37591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37591},{"type":"v1","addr":"172.21.15.62:6822","nonce":37591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":37591},{"type":"v1","addr":"172.21.15.62:6819","nonce":37591}]},"public_addr":"172.21.15.62:6810/37591","cluster_addr":"172.21.15.62:6815/37591","heartbeat_back_addr":"172.21.15.62:6822/37591","heartbeat_front_addr":"172.21.15.62:6819/37591","state":["exists","up"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37593},{"type":"v1","addr":"172.21.15.62:6801","nonce":37593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37593},{"type":"v1","addr":"172.21.15.62:6803","nonce":37593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":37593},{"type":"v1","addr":"172.21.15.62:6812","nonce":37593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37593},{"type":"v1","addr":"172.21.15.62:6805","nonce":37593}]},"public_addr":"172.21.15.62:6801/37593","cluster_addr":"172.21.15.62:6803/37593","heartbeat_back_addr":"172.21.15.62:6812/37593","heartbeat_front_addr":"172.21.15.62:6805/37593","state":["exists","up"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37854},{"type":"v1","addr":"172.21.15.161:6801","nonce":37854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37854},{"type":"v1","addr":"172.21.15.161:6803","nonce":37854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37854},{"type":"v1","addr":"172.21.15.161:6807","nonce":37854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37854},{"type":"v1","addr":"172.21.15.161:6805","nonce":37854}]},"public_addr":"172.21.15.161:6801/37854","cluster_addr":"172.21.15.161:6803/37854","heartbeat_back_addr":"172.21.15.161:6807/37854","heartbeat_front_addr":"172.21.15.161:6805/37854","state":["exists","up"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37855},{"type":"v1","addr":"172.21.15.161:6810","nonce":37855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37855},{"type":"v1","addr":"172.21.15.161:6815","nonce":37855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37855},{"type":"v1","addr":"172.21.15.161:6824","nonce":37855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37855},{"type":"v1","addr":"172.21.15.161:6820","nonce":37855}]},"public_addr":"172.21.15.161:6810/37855","cluster_addr":"172.21.15.161:6815/37855","heartbeat_back_addr":"172.21.15.161:6824/37855","heartbeat_front_addr":"172.21.15.161:6820/37855","state":["exists","up"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":37856},{"type":"v1","addr":"172.21.15.161:6814","nonce":37856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37856},{"type":"v1","addr":"172.21.15.161:6819","nonce":37856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":37856},{"type":"v1","addr":"172.21.15.161:6830","nonce":37856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37856},{"type":"v1","addr":"172.21.15.161:6826","nonce":37856}]},"public_addr":"172.21.15.161:6814/37856","cluster_addr":"172.21.15.161:6819/37856","heartbeat_back_addr":"172.21.15.161:6830/37856","heartbeat_front_addr":"172.21.15.161:6826/37856","state":["exists","up"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":37857},{"type":"v1","addr":"172.21.15.161:6813","nonce":37857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":37857},{"type":"v1","addr":"172.21.15.161:6821","nonce":37857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":37857},{"type":"v1","addr":"172.21.15.161:6831","nonce":37857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":37857},{"type":"v1","addr":"172.21.15.161:6827","nonce":37857}]},"public_addr":"172.21.15.161:6813/37857","cluster_addr":"172.21.15.161:6821/37857","heartbeat_back_addr":"172.21.15.161:6831/37857","heartbeat_front_addr":"172.21.15.161:6827/37857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.592907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.618143+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.641533+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.614355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.579293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.718353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.730135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.792887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:40:20.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.207+0000 7efcad746640 1 -- 172.21.15.62:0/2514303871 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7efc94065380 msgr2=0x7efc94067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.207+0000 7efcad746640 1 --2- 172.21.15.62:0/2514303871 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7efc94065380 0x7efc94067830 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7efc980b2000 tx=0x7efc980aa070 comp rx=0 tx=0).stop 2023-05-15T16:40:20.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.207+0000 7efcad746640 1 -- 172.21.15.62:0/2514303871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efca814dcb0 msgr2=0x7efca80b4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.207+0000 7efcad746640 1 --2- 172.21.15.62:0/2514303871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efca814dcb0 0x7efca80b4cd0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7efc9c00c420 tx=0x7efc9c00c8e0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.207+0000 7efcad746640 1 -- 172.21.15.62:0/2514303871 shutdown_connections 2023-05-15T16:40:20.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.207+0000 7efcad746640 1 --2- 172.21.15.62:0/2514303871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7efca80b5210 0x7efca80b6390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.217 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.207+0000 7efcad746640 1 --2- 172.21.15.62:0/2514303871 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7efc94065380 0x7efc94067830 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.207+0000 7efcad746640 1 --2- 172.21.15.62:0/2514303871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7efca814dcb0 0x7efca80b4cd0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.207+0000 7efcad746640 1 --2- 172.21.15.62:0/2514303871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7efca8069a10 0x7efca813c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.207+0000 7efcad746640 1 -- 172.21.15.62:0/2514303871 >> 172.21.15.62:0/2514303871 conn(0x7efca806a8c0 msgr2=0x7efca813feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:20.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.207+0000 7efcad746640 1 -- 172.21.15.62:0/2514303871 shutdown_connections 2023-05-15T16:40:20.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.207+0000 7efcad746640 1 -- 172.21.15.62:0/2514303871 wait complete. 2023-05-15T16:40:20.227 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-15T16:39:49.394028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-15T16:39:55.208679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-15T16:39:59.547414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-15T16:40:00.055526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-15T16:40:20.228 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-15T16:40:20.356 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.351+0000 7f9cc0658640 1 Processor -- start 2023-05-15T16:40:20.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.351+0000 7f9cc0658640 1 -- start start 2023-05-15T16:40:20.357 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cc0658640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f9cb80703f0 0x7f9cb8070e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cc0658640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb8071d10 con 0x7f9cb8069a10 2023-05-15T16:40:20.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cc0658640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cb8071470 con 0x7f9cb80b7e30 2023-05-15T16:40:20.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cc0658640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cb8071750 con 0x7f9cb80703f0 2023-05-15T16:40:20.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbe3f4640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f9cb8069a10 0x7f9cb8143a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58168/0 (socket says 172.21.15.62:58168) 2023-05-15T16:40:20.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbe3f4640 1 -- 172.21.15.62:0/2049262538 learned_addr learned my addr 172.21.15.62:0/2049262538 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:20.358 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbdbf3640 1 --2- 172.21.15.62:0/2049262538 >> v2:172.21.15.161:3300/0 conn(0x7f9cb80703f0 0x7f9cb8070e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbd3f2640 1 -- 172.21.15.62:0/2049262538 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 824961858 0 0) 0x7f9cb8071d10 con 0x7f9cb8069a10 2023-05-15T16:40:20.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbd3f2640 1 -- 172.21.15.62:0/2049262538 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ca4003530 con 0x7f9cb8069a10 2023-05-15T16:40:20.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbd3f2640 1 -- 172.21.15.62:0/2049262538 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 690485472 0 0) 0x7f9ca4003530 con 0x7f9cb8069a10 2023-05-15T16:40:20.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbd3f2640 1 -- 172.21.15.62:0/2049262538 >> v2:172.21.15.161:3300/0 conn(0x7f9cb80703f0 msgr2=0x7f9cb8070e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:20.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbd3f2640 1 --2- 172.21.15.62:0/2049262538 >> v2:172.21.15.161:3300/0 conn(0x7f9cb80703f0 0x7f9cb8070e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbd3f2640 1 -- 172.21.15.62:0/2049262538 >> v1:172.21.15.161:6789/0 conn(0x7f9cb80b7e30 legacy=0x7f9cb80b8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbd3f2640 1 -- 172.21.15.62:0/2049262538 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb8071a30 con 0x7f9cb8069a10 2023-05-15T16:40:20.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbd3f2640 1 -- 172.21.15.62:0/2049262538 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7f9cac0016a0 con 0x7f9cb8069a10 2023-05-15T16:40:20.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbd3f2640 1 -- 172.21.15.62:0/2049262538 >> v1:172.21.15.62:6789/0 conn(0x7f9cb8069a10 legacy=0x7f9cb8143a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbd3f2640 1 --2- 172.21.15.62:0/2049262538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ca4003980 0x7f9ca4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbd3f2640 1 --2- 172.21.15.62:0/2049262538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca40047d0 0x7f9ca4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbd3f2640 1 --2- 172.21.15.62:0/2049262538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ca4005180 0x7f9ca400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbd3f2640 1 -- 172.21.15.62:0/2049262538 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb8071750 con 0x7f9ca4005180 2023-05-15T16:40:20.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbd3f2640 1 -- 172.21.15.62:0/2049262538 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca400c090 con 0x7f9ca40047d0 2023-05-15T16:40:20.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbd3f2640 1 -- 172.21.15.62:0/2049262538 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ca400c250 con 0x7f9ca4003980 2023-05-15T16:40:20.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbebf5640 1 --2- 172.21.15.62:0/2049262538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ca4005180 0x7f9ca400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbdbf3640 1 --2- 172.21.15.62:0/2049262538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca40047d0 0x7f9ca4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbe3f4640 1 --2- 172.21.15.62:0/2049262538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ca4003980 0x7f9ca4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbebf5640 1 -- 172.21.15.62:0/2049262538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ca4003980 msgr2=0x7f9ca4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:20.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbebf5640 1 --2- 172.21.15.62:0/2049262538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ca4003980 0x7f9ca4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbebf5640 1 -- 172.21.15.62:0/2049262538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca40047d0 msgr2=0x7f9ca4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:20.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbebf5640 1 --2- 172.21.15.62:0/2049262538 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca40047d0 0x7f9ca4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbebf5640 1 -- 172.21.15.62:0/2049262538 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ca4003530 con 0x7f9ca4005180 2023-05-15T16:40:20.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbe3f4640 1 --2- 172.21.15.62:0/2049262538 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9ca4003980 0x7f9ca4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:20.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbebf5640 1 -- 172.21.15.62:0/2049262538 reap_dead start 2023-05-15T16:40:20.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbebf5640 1 --2- 172.21.15.62:0/2049262538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ca4005180 0x7f9ca400b990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0001e40 tx=0x7f9cb001c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e6f5de2493e7908 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:20.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.355+0000 7f9cbd3f2640 1 -- 172.21.15.62:0/2049262538 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0003b80 con 0x7f9ca4005180 2023-05-15T16:40:20.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cbd3f2640 1 -- 172.21.15.62:0/2049262538 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cac001d80 con 0x7f9ca4005180 2023-05-15T16:40:20.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cbd3f2640 1 -- 172.21.15.62:0/2049262538 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0005020 con 0x7f9ca4005180 2023-05-15T16:40:20.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cc0658640 1 -- 172.21.15.62:0/2049262538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ca4005180 msgr2=0x7f9ca400b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cc0658640 1 --2- 172.21.15.62:0/2049262538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ca4005180 0x7f9ca400b990 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9cb0001e40 tx=0x7f9cb001c740 comp rx=0 tx=0).stop 2023-05-15T16:40:20.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cc0658640 1 -- 172.21.15.62:0/2049262538 shutdown_connections 2023-05-15T16:40:20.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cc0658640 1 --2- 172.21.15.62:0/2049262538 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9ca4005180 0x7f9ca400b990 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cc0658640 1 -- 172.21.15.62:0/2049262538 >> 172.21.15.62:0/2049262538 conn(0x7f9cb806a8c0 msgr2=0x7f9cb806acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:20.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cc0658640 1 -- 172.21.15.62:0/2049262538 shutdown_connections 2023-05-15T16:40:20.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cc0658640 1 -- 172.21.15.62:0/2049262538 wait complete. 2023-05-15T16:40:20.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cc0658640 1 Processor -- start 2023-05-15T16:40:20.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cc0658640 1 -- start start 2023-05-15T16:40:20.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cc0658640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca4005180 0x7f9cb8146110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cc0658640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb80b3f20 0x7f9cb8137700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cc0658640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cb8137c40 0x7f9cb81e2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cc0658640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb8146650 con 0x7f9cb8137c40 2023-05-15T16:40:20.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cc0658640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb80b64c0 con 0x7f9ca4005180 2023-05-15T16:40:20.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cc0658640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cb80b6f10 con 0x7f9cb80b3f20 2023-05-15T16:40:20.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cbebf5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cb8137c40 0x7f9cb81e2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cbebf5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cb8137c40 0x7f9cb81e2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48646/0 (socket says 172.21.15.62:48646) 2023-05-15T16:40:20.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cbebf5640 1 -- 172.21.15.62:0/3718686418 learned_addr learned my addr 172.21.15.62:0/3718686418 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:20.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cbe3f4640 1 --2- 172.21.15.62:0/3718686418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca4005180 0x7f9cb8146110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cbdbf3640 1 --2- 172.21.15.62:0/3718686418 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb80b3f20 0x7f9cb8137700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cbebf5640 1 -- 172.21.15.62:0/3718686418 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb80b3f20 msgr2=0x7f9cb8137700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cbebf5640 1 --2- 172.21.15.62:0/3718686418 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb80b3f20 0x7f9cb8137700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cbebf5640 1 -- 172.21.15.62:0/3718686418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca4005180 msgr2=0x7f9cb8146110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cbebf5640 1 --2- 172.21.15.62:0/3718686418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca4005180 0x7f9cb8146110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cbebf5640 1 -- 172.21.15.62:0/3718686418 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cb80b9320 con 0x7f9cb8137c40 2023-05-15T16:40:20.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cbe3f4640 1 --2- 172.21.15.62:0/3718686418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca4005180 0x7f9cb8146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:20.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cbebf5640 1 --2- 172.21.15.62:0/3718686418 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cb8137c40 0x7f9cb81e2650 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9cb001cfe0 tx=0x7f9cb00194e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:20.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9caaffd640 1 -- 172.21.15.62:0/3718686418 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0003d90 con 0x7f9cb8137c40 2023-05-15T16:40:20.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9caaffd640 1 -- 172.21.15.62:0/3718686418 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cb0005070 con 0x7f9cb8137c40 2023-05-15T16:40:20.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9caaffd640 1 -- 172.21.15.62:0/3718686418 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cb0005400 con 0x7f9cb8137c40 2023-05-15T16:40:20.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cc0658640 1 -- 172.21.15.62:0/3718686418 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cb8069de0 con 0x7f9cb8137c40 2023-05-15T16:40:20.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.359+0000 7f9cc0658640 1 -- 172.21.15.62:0/3718686418 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cb8070e70 con 0x7f9cb8137c40 2023-05-15T16:40:20.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.363+0000 7f9cc0658640 1 -- 172.21.15.62:0/3718686418 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cb8067960 con 0x7f9cb8137c40 2023-05-15T16:40:20.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.363+0000 7f9caaffd640 1 -- 172.21.15.62:0/3718686418 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f9cb0005560 con 0x7f9cb8137c40 2023-05-15T16:40:20.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.363+0000 7f9caaffd640 1 --2- 172.21.15.62:0/3718686418 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9c9c065380 0x7f9c9c067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.363+0000 7f9caaffd640 1 -- 172.21.15.62:0/3718686418 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9cb011afb0 con 0x7f9cb8137c40 2023-05-15T16:40:20.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.363+0000 7f9cbe3f4640 1 --2- 172.21.15.62:0/3718686418 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9c9c065380 0x7f9c9c067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.363+0000 7f9cbe3f4640 1 --2- 172.21.15.62:0/3718686418 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9c9c065380 0x7f9c9c067830 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9cac001230 tx=0x7f9cac000ee0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:20.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.367+0000 7f9caaffd640 1 -- 172.21.15.62:0/3718686418 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f9cb00e8bc0 con 0x7f9cb8137c40 2023-05-15T16:40:20.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.519+0000 7f9cc0658640 1 -- 172.21.15.62:0/3718686418 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f9cb804dc10 con 0x7f9cb8137c40 2023-05-15T16:40:20.524 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.519+0000 7f9caaffd640 1 -- 172.21.15.62:0/3718686418 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f9cb00b6020 con 0x7f9cb8137c40 2023-05-15T16:40:20.525 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-05-15T16:40:20.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.523+0000 7f9cc0658640 1 -- 172.21.15.62:0/3718686418 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9c9c065380 msgr2=0x7f9c9c067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.523+0000 7f9cc0658640 1 --2- 172.21.15.62:0/3718686418 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9c9c065380 0x7f9c9c067830 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9cac001230 tx=0x7f9cac000ee0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.523+0000 7f9cc0658640 1 -- 172.21.15.62:0/3718686418 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cb8137c40 msgr2=0x7f9cb81e2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.523+0000 7f9cc0658640 1 --2- 172.21.15.62:0/3718686418 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cb8137c40 0x7f9cb81e2650 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f9cb001cfe0 tx=0x7f9cb00194e0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.523+0000 7f9cc0658640 1 -- 172.21.15.62:0/3718686418 shutdown_connections 2023-05-15T16:40:20.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.523+0000 7f9cc0658640 1 --2- 172.21.15.62:0/3718686418 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9c9c065380 0x7f9c9c067830 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.523+0000 7f9cc0658640 1 --2- 172.21.15.62:0/3718686418 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9cb8137c40 0x7f9cb81e2650 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.523+0000 7f9cc0658640 1 --2- 172.21.15.62:0/3718686418 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9cb80b3f20 0x7f9cb8137700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.523+0000 7f9cc0658640 1 --2- 172.21.15.62:0/3718686418 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f9ca4005180 0x7f9cb8146110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.523+0000 7f9cc0658640 1 -- 172.21.15.62:0/3718686418 >> 172.21.15.62:0/3718686418 conn(0x7f9cb806a8c0 msgr2=0x7f9cb80b8290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:20.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.523+0000 7f9cc0658640 1 -- 172.21.15.62:0/3718686418 shutdown_connections 2023-05-15T16:40:20.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.523+0000 7f9cc0658640 1 -- 172.21.15.62:0/3718686418 wait complete. 2023-05-15T16:40:20.543 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-15T16:40:20.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.667+0000 7f56115b1640 1 Processor -- start 2023-05-15T16:40:20.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.667+0000 7f56115b1640 1 -- start start 2023-05-15T16:40:20.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.667+0000 7f56115b1640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f560c0be280 0x7f560c143c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.667+0000 7f56115b1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f560c06c4f0 0x7f560c144160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.667+0000 7f56115b1640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560c0b8a50 con 0x7f560c0b9860 2023-05-15T16:40:20.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.667+0000 7f56115b1640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560c0ba4e0 con 0x7f560c06c4f0 2023-05-15T16:40:20.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.667+0000 7f56115b1640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560c0b9e20 con 0x7f560c0be280 2023-05-15T16:40:20.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.667+0000 7f560b7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f560c06c4f0 0x7f560c144160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.667+0000 7f560a7fc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f560c0b9860 0x7f560c06bde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58182/0 (socket says 172.21.15.62:58182) 2023-05-15T16:40:20.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.667+0000 7f560a7fc640 1 -- 172.21.15.62:0/4109500774 learned_addr learned my addr 172.21.15.62:0/4109500774 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:20.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.667+0000 7f560affd640 1 --2- 172.21.15.62:0/4109500774 >> v2:172.21.15.161:3300/0 conn(0x7f560c0be280 0x7f560c143c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.667+0000 7f560b7fe640 1 -- 172.21.15.62:0/4109500774 >> v2:172.21.15.161:3300/0 conn(0x7f560c0be280 msgr2=0x7f560c143c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:20.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.667+0000 7f560b7fe640 1 --2- 172.21.15.62:0/4109500774 >> v2:172.21.15.161:3300/0 conn(0x7f560c0be280 0x7f560c143c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.667+0000 7f560b7fe640 1 -- 172.21.15.62:0/4109500774 >> v1:172.21.15.62:6789/0 conn(0x7f560c0b9860 legacy=0x7f560c06bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.667+0000 7f560b7fe640 1 -- 172.21.15.62:0/4109500774 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c0ba100 con 0x7f560c06c4f0 2023-05-15T16:40:20.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.667+0000 7f5609ffb640 1 -- 172.21.15.62:0/4109500774 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639954853 0 0) 0x7f560c0b8a50 con 0x7f560c0b9860 2023-05-15T16:40:20.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.671+0000 7f560b7fe640 1 --2- 172.21.15.62:0/4109500774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f560c06c4f0 0x7f560c144160 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f560c071410 tx=0x7f55fc01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99ea9cac8bfff8c9 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:20.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.671+0000 7f5609ffb640 1 -- 172.21.15.62:0/4109500774 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc0ab600 con 0x7f560c06c4f0 2023-05-15T16:40:20.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.671+0000 7f5609ffb640 1 -- 172.21.15.62:0/4109500774 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55fc0a7050 con 0x7f560c06c4f0 2023-05-15T16:40:20.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.671+0000 7f5609ffb640 1 -- 172.21.15.62:0/4109500774 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc0ab980 con 0x7f560c06c4f0 2023-05-15T16:40:20.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.671+0000 7f56115b1640 1 -- 172.21.15.62:0/4109500774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f560c06c4f0 msgr2=0x7f560c144160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.671+0000 7f56115b1640 1 --2- 172.21.15.62:0/4109500774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f560c06c4f0 0x7f560c144160 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f560c071410 tx=0x7f55fc01c340 comp rx=0 tx=0).stop 2023-05-15T16:40:20.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.671+0000 7f56115b1640 1 -- 172.21.15.62:0/4109500774 shutdown_connections 2023-05-15T16:40:20.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.671+0000 7f56115b1640 1 --2- 172.21.15.62:0/4109500774 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f560c06c4f0 0x7f560c144160 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.671+0000 7f56115b1640 1 --2- 172.21.15.62:0/4109500774 >> v2:172.21.15.161:3300/0 conn(0x7f560c0be280 0x7f560c143c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.671+0000 7f56115b1640 1 -- 172.21.15.62:0/4109500774 >> 172.21.15.62:0/4109500774 conn(0x7f560c06e480 msgr2=0x7f560c06e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:20.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.671+0000 7f56115b1640 1 -- 172.21.15.62:0/4109500774 shutdown_connections 2023-05-15T16:40:20.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.671+0000 7f56115b1640 1 -- 172.21.15.62:0/4109500774 wait complete. 2023-05-15T16:40:20.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.671+0000 7f56115b1640 1 Processor -- start 2023-05-15T16:40:20.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.671+0000 7f56115b1640 1 -- start start 2023-05-15T16:40:20.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f56115b1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f560c06c4f0 0x7f560c153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f56115b1640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f560c0b9860 0x7f560c146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f56115b1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f560c0be280 0x7f560c1e64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f56115b1640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c154170 con 0x7f560c0be280 2023-05-15T16:40:20.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f56115b1640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c13cd50 con 0x7f560c06c4f0 2023-05-15T16:40:20.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f56115b1640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560c13b590 con 0x7f560c0b9860 2023-05-15T16:40:20.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f560b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f560c0be280 0x7f560c1e64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f560b7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f560c0be280 0x7f560c1e64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48658/0 (socket says 172.21.15.62:48658) 2023-05-15T16:40:20.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f560b7fe640 1 -- 172.21.15.62:0/2383215456 learned_addr learned my addr 172.21.15.62:0/2383215456 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:20.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f560affd640 1 --2- 172.21.15.62:0/2383215456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f560c06c4f0 0x7f560c153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f560a7fc640 1 --2- 172.21.15.62:0/2383215456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f560c0b9860 0x7f560c146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f560b7fe640 1 -- 172.21.15.62:0/2383215456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f560c0b9860 msgr2=0x7f560c146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f560b7fe640 1 --2- 172.21.15.62:0/2383215456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f560c0b9860 0x7f560c146e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f560b7fe640 1 -- 172.21.15.62:0/2383215456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f560c06c4f0 msgr2=0x7f560c153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f560b7fe640 1 --2- 172.21.15.62:0/2383215456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f560c06c4f0 0x7f560c153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f560b7fe640 1 -- 172.21.15.62:0/2383215456 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55fc009420 con 0x7f560c0be280 2023-05-15T16:40:20.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f560b7fe640 1 --2- 172.21.15.62:0/2383215456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f560c0be280 0x7f560c1e64b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0ae040 tx=0x7f55fc0190e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:20.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f55f37fe640 1 -- 172.21.15.62:0/2383215456 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc0b4430 con 0x7f560c0be280 2023-05-15T16:40:20.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f55f37fe640 1 -- 172.21.15.62:0/2383215456 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55fc0b4590 con 0x7f560c0be280 2023-05-15T16:40:20.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f56115b1640 1 -- 172.21.15.62:0/2383215456 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560c06b070 con 0x7f560c0be280 2023-05-15T16:40:20.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f55f37fe640 1 -- 172.21.15.62:0/2383215456 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc0b4920 con 0x7f560c0be280 2023-05-15T16:40:20.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f56115b1640 1 -- 172.21.15.62:0/2383215456 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560c06b440 con 0x7f560c0be280 2023-05-15T16:40:20.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f56115b1640 1 -- 172.21.15.62:0/2383215456 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560c06b200 con 0x7f560c0be280 2023-05-15T16:40:20.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f55f37fe640 1 -- 172.21.15.62:0/2383215456 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f55fc0b2040 con 0x7f560c0be280 2023-05-15T16:40:20.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.675+0000 7f55f37fe640 1 --2- 172.21.15.62:0/2383215456 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f55f8065380 0x7f55f8067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.679+0000 7f55f37fe640 1 -- 172.21.15.62:0/2383215456 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f55fc11c7d0 con 0x7f560c0be280 2023-05-15T16:40:20.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.679+0000 7f560affd640 1 --2- 172.21.15.62:0/2383215456 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f55f8065380 0x7f55f8067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.679+0000 7f560affd640 1 --2- 172.21.15.62:0/2383215456 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f55f8065380 0x7f55f8067830 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5604003fd0 tx=0x7f56040039a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:20.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.679+0000 7f55f37fe640 1 -- 172.21.15.62:0/2383215456 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f55fc0ea460 con 0x7f560c0be280 2023-05-15T16:40:20.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.827+0000 7f56115b1640 1 -- 172.21.15.62:0/2383215456 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f560c067960 con 0x7f560c0be280 2023-05-15T16:40:20.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.827+0000 7f55f37fe640 1 -- 172.21.15.62:0/2383215456 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f55fc0eda80 con 0x7f560c0be280 2023-05-15T16:40:20.833 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-05-15T16:40:20.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.831+0000 7f56115b1640 1 -- 172.21.15.62:0/2383215456 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f55f8065380 msgr2=0x7f55f8067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.831+0000 7f56115b1640 1 --2- 172.21.15.62:0/2383215456 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f55f8065380 0x7f55f8067830 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f5604003fd0 tx=0x7f56040039a0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.831+0000 7f56115b1640 1 -- 172.21.15.62:0/2383215456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f560c0be280 msgr2=0x7f560c1e64b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.831+0000 7f56115b1640 1 --2- 172.21.15.62:0/2383215456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f560c0be280 0x7f560c1e64b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f55fc0ae040 tx=0x7f55fc0190e0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.831+0000 7f56115b1640 1 -- 172.21.15.62:0/2383215456 shutdown_connections 2023-05-15T16:40:20.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.831+0000 7f56115b1640 1 --2- 172.21.15.62:0/2383215456 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f55f8065380 0x7f55f8067830 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.831+0000 7f56115b1640 1 --2- 172.21.15.62:0/2383215456 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f560c0be280 0x7f560c1e64b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.831+0000 7f56115b1640 1 --2- 172.21.15.62:0/2383215456 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f560c0b9860 0x7f560c146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.831+0000 7f56115b1640 1 --2- 172.21.15.62:0/2383215456 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f560c06c4f0 0x7f560c153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.831+0000 7f56115b1640 1 -- 172.21.15.62:0/2383215456 >> 172.21.15.62:0/2383215456 conn(0x7f560c06e480 msgr2=0x7f560c140320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:20.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.831+0000 7f56115b1640 1 -- 172.21.15.62:0/2383215456 shutdown_connections 2023-05-15T16:40:20.837 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.831+0000 7f56115b1640 1 -- 172.21.15.62:0/2383215456 wait complete. 2023-05-15T16:40:20.850 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-15T16:40:20.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c88cc3640 1 Processor -- start 2023-05-15T16:40:20.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c88cc3640 1 -- start start 2023-05-15T16:40:20.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c88cc3640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c840bac50 0x7f0c84155680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c88cc3640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c840bc820 con 0x7f0c8406a730 2023-05-15T16:40:20.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c88cc3640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c84144530 con 0x7f0c840a2160 2023-05-15T16:40:20.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c88cc3640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c840bbd40 con 0x7f0c840bac50 2023-05-15T16:40:20.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c81d9b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f0c8406a730 0x7f0c8406b0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58188/0 (socket says 172.21.15.62:58188) 2023-05-15T16:40:20.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c81d9b640 1 -- 172.21.15.62:0/2946695441 learned_addr learned my addr 172.21.15.62:0/2946695441 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:20.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c82d9d640 1 --2- 172.21.15.62:0/2946695441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c840bac50 0x7f0c84155680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c8159a640 1 -- 172.21.15.62:0/2946695441 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2533879350 0 0) 0x7f0c840bc820 con 0x7f0c8406a730 2023-05-15T16:40:20.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c8159a640 1 -- 172.21.15.62:0/2946695441 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c6c003530 con 0x7f0c8406a730 2023-05-15T16:40:20.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c8159a640 1 -- 172.21.15.62:0/2946695441 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1289349968 0 0) 0x7f0c6c003530 con 0x7f0c8406a730 2023-05-15T16:40:20.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c8159a640 1 -- 172.21.15.62:0/2946695441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c840bac50 msgr2=0x7f0c84155680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:20.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c8159a640 1 --2- 172.21.15.62:0/2946695441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c840bac50 0x7f0c84155680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c8159a640 1 -- 172.21.15.62:0/2946695441 >> v1:172.21.15.161:6789/0 conn(0x7f0c840a2160 legacy=0x7f0c84143e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c8159a640 1 -- 172.21.15.62:0/2946695441 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c840bc260 con 0x7f0c8406a730 2023-05-15T16:40:20.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c8159a640 1 -- 172.21.15.62:0/2946695441 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7f0c78001680 con 0x7f0c8406a730 2023-05-15T16:40:20.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c8159a640 1 -- 172.21.15.62:0/2946695441 >> v1:172.21.15.62:6789/0 conn(0x7f0c8406a730 legacy=0x7f0c8406b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c8159a640 1 --2- 172.21.15.62:0/2946695441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c6c0039b0 0x7f0c6c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c8159a640 1 --2- 172.21.15.62:0/2946695441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c840bac50 0x7f0c6c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c8159a640 1 --2- 172.21.15.62:0/2946695441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c6c004d10 0x7f0c6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c8159a640 1 -- 172.21.15.62:0/2946695441 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c840bbd40 con 0x7f0c6c0039b0 2023-05-15T16:40:20.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c8159a640 1 -- 172.21.15.62:0/2946695441 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c00ba40 con 0x7f0c6c004d10 2023-05-15T16:40:20.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c8159a640 1 -- 172.21.15.62:0/2946695441 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c6c00bbd0 con 0x7f0c840bac50 2023-05-15T16:40:20.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c8259c640 1 --2- 172.21.15.62:0/2946695441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c6c0039b0 0x7f0c6c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c81d9b640 1 --2- 172.21.15.62:0/2946695441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c840bac50 0x7f0c6c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c82d9d640 1 --2- 172.21.15.62:0/2946695441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c6c004d10 0x7f0c6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c8259c640 1 -- 172.21.15.62:0/2946695441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c840bac50 msgr2=0x7f0c6c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:20.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c8259c640 1 --2- 172.21.15.62:0/2946695441 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c840bac50 0x7f0c6c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c8259c640 1 -- 172.21.15.62:0/2946695441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c6c004d10 msgr2=0x7f0c6c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:20.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c8259c640 1 --2- 172.21.15.62:0/2946695441 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c6c004d10 0x7f0c6c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.963+0000 7f0c8259c640 1 -- 172.21.15.62:0/2946695441 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c6c003530 con 0x7f0c6c0039b0 2023-05-15T16:40:20.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c8259c640 1 --2- 172.21.15.62:0/2946695441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c6c0039b0 0x7f0c6c003dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0c74001780 tx=0x7f0c7401c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b15da44e30282bab server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:20.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c8159a640 1 -- 172.21.15.62:0/2946695441 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c740052d0 con 0x7f0c6c0039b0 2023-05-15T16:40:20.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c8159a640 1 -- 172.21.15.62:0/2946695441 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c740a7050 con 0x7f0c6c0039b0 2023-05-15T16:40:20.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c8159a640 1 -- 172.21.15.62:0/2946695441 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c74003600 con 0x7f0c6c0039b0 2023-05-15T16:40:20.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c88cc3640 1 -- 172.21.15.62:0/2946695441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c6c0039b0 msgr2=0x7f0c6c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c88cc3640 1 --2- 172.21.15.62:0/2946695441 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c6c0039b0 0x7f0c6c003dc0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0c74001780 tx=0x7f0c7401c3d0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c82d9d640 1 -- 172.21.15.62:0/2946695441 reap_dead start 2023-05-15T16:40:20.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c88cc3640 1 -- 172.21.15.62:0/2946695441 shutdown_connections 2023-05-15T16:40:20.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c88cc3640 1 -- 172.21.15.62:0/2946695441 >> 172.21.15.62:0/2946695441 conn(0x7f0c840bffb0 msgr2=0x7f0c840c03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:20.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c88cc3640 1 -- 172.21.15.62:0/2946695441 shutdown_connections 2023-05-15T16:40:20.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c88cc3640 1 -- 172.21.15.62:0/2946695441 wait complete. 2023-05-15T16:40:20.977 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c88cc3640 1 Processor -- start 2023-05-15T16:40:20.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c88cc3640 1 -- start start 2023-05-15T16:40:20.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c88cc3640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c840b7510 0x7f0c840b93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.978 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c88cc3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c840b9ea0 0x7f0c841e1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c88cc3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c841e2470 0x7f0c840b07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c88cc3640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c840b8970 con 0x7f0c840b9ea0 2023-05-15T16:40:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c88cc3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c841e28f0 con 0x7f0c841e2470 2023-05-15T16:40:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c88cc3640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c8413c840 con 0x7f0c840b7510 2023-05-15T16:40:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c81d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c840b9ea0 0x7f0c841e1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c81d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c840b9ea0 0x7f0c841e1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48682/0 (socket says 172.21.15.62:48682) 2023-05-15T16:40:20.979 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c81d9b640 1 -- 172.21.15.62:0/3808263094 learned_addr learned my addr 172.21.15.62:0/3808263094 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:20.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c8259c640 1 --2- 172.21.15.62:0/3808263094 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c840b7510 0x7f0c840b93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.967+0000 7f0c82d9d640 1 --2- 172.21.15.62:0/3808263094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c841e2470 0x7f0c840b07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.971+0000 7f0c81d9b640 1 -- 172.21.15.62:0/3808263094 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c840b7510 msgr2=0x7f0c840b93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.971+0000 7f0c81d9b640 1 --2- 172.21.15.62:0/3808263094 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c840b7510 0x7f0c840b93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.971+0000 7f0c81d9b640 1 -- 172.21.15.62:0/3808263094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c841e2470 msgr2=0x7f0c840b07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:20.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.971+0000 7f0c81d9b640 1 --2- 172.21.15.62:0/3808263094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c841e2470 0x7f0c840b07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:20.980 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.971+0000 7f0c81d9b640 1 -- 172.21.15.62:0/3808263094 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c840ba930 con 0x7f0c840b9ea0 2023-05-15T16:40:20.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.971+0000 7f0c81d9b640 1 --2- 172.21.15.62:0/3808263094 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c840b9ea0 0x7f0c841e1f30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0c7800ea70 tx=0x7f0c7800ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:20.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.971+0000 7f0c72ffd640 1 -- 172.21.15.62:0/3808263094 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7800c870 con 0x7f0c840b9ea0 2023-05-15T16:40:20.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.971+0000 7f0c72ffd640 1 -- 172.21.15.62:0/3808263094 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7800c9d0 con 0x7f0c840b9ea0 2023-05-15T16:40:20.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.971+0000 7f0c88cc3640 1 -- 172.21.15.62:0/3808263094 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c840a2530 con 0x7f0c840b9ea0 2023-05-15T16:40:20.981 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.971+0000 7f0c72ffd640 1 -- 172.21.15.62:0/3808263094 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7800cd80 con 0x7f0c840b9ea0 2023-05-15T16:40:20.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.971+0000 7f0c88cc3640 1 -- 172.21.15.62:0/3808263094 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c8406b7b0 con 0x7f0c840b9ea0 2023-05-15T16:40:20.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.971+0000 7f0c88cc3640 1 -- 172.21.15.62:0/3808263094 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c84067960 con 0x7f0c840b9ea0 2023-05-15T16:40:20.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.971+0000 7f0c72ffd640 1 -- 172.21.15.62:0/3808263094 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f0c7801d460 con 0x7f0c840b9ea0 2023-05-15T16:40:20.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.971+0000 7f0c72ffd640 1 --2- 172.21.15.62:0/3808263094 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0c64065380 0x7f0c64067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:20.982 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.971+0000 7f0c72ffd640 1 -- 172.21.15.62:0/3808263094 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0c78082850 con 0x7f0c840b9ea0 2023-05-15T16:40:20.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.971+0000 7f0c8259c640 1 --2- 172.21.15.62:0/3808263094 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0c64065380 0x7f0c64067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:20.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.971+0000 7f0c8259c640 1 --2- 172.21.15.62:0/3808263094 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0c64065380 0x7f0c64067830 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0c74001750 tx=0x7f0c740011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:20.983 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:20.975+0000 7f0c72ffd640 1 -- 172.21.15.62:0/3808263094 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f0c78050500 con 0x7f0c840b9ea0 2023-05-15T16:40:21.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.123+0000 7f0c88cc3640 1 -- 172.21.15.62:0/3808263094 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0c8404dbe0 con 0x7f0c840b9ea0 2023-05-15T16:40:21.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.123+0000 7f0c72ffd640 1 -- 172.21.15.62:0/3808263094 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0c78053b20 con 0x7f0c840b9ea0 2023-05-15T16:40:21.126 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-05-15T16:40:21.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.123+0000 7f0c88cc3640 1 -- 172.21.15.62:0/3808263094 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0c64065380 msgr2=0x7f0c64067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:21.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.123+0000 7f0c88cc3640 1 --2- 172.21.15.62:0/3808263094 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0c64065380 0x7f0c64067830 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0c74001750 tx=0x7f0c740011a0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.123+0000 7f0c88cc3640 1 -- 172.21.15.62:0/3808263094 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c840b9ea0 msgr2=0x7f0c841e1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:21.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.123+0000 7f0c88cc3640 1 --2- 172.21.15.62:0/3808263094 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c840b9ea0 0x7f0c841e1f30 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0c7800ea70 tx=0x7f0c7800ef30 comp rx=0 tx=0).stop 2023-05-15T16:40:21.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.123+0000 7f0c88cc3640 1 -- 172.21.15.62:0/3808263094 shutdown_connections 2023-05-15T16:40:21.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.123+0000 7f0c88cc3640 1 --2- 172.21.15.62:0/3808263094 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0c841e2470 0x7f0c840b07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.123+0000 7f0c88cc3640 1 --2- 172.21.15.62:0/3808263094 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0c64065380 0x7f0c64067830 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.123+0000 7f0c88cc3640 1 --2- 172.21.15.62:0/3808263094 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0c840b9ea0 0x7f0c841e1f30 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.123+0000 7f0c88cc3640 1 --2- 172.21.15.62:0/3808263094 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0c840b7510 0x7f0c840b93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.123+0000 7f0c88cc3640 1 -- 172.21.15.62:0/3808263094 >> 172.21.15.62:0/3808263094 conn(0x7f0c840bffb0 msgr2=0x7f0c841430c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:21.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.123+0000 7f0c88cc3640 1 -- 172.21.15.62:0/3808263094 shutdown_connections 2023-05-15T16:40:21.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.123+0000 7f0c88cc3640 1 -- 172.21.15.62:0/3808263094 wait complete. 2023-05-15T16:40:21.145 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-15T16:40:21.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.255+0000 7f1deeb0f640 1 Processor -- start 2023-05-15T16:40:21.261 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.255+0000 7f1deeb0f640 1 -- start start 2023-05-15T16:40:21.263 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1deeb0f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1de80a2160 0x7f1de8143e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:21.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1deeb0f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1de8144360 0x7f1de806b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:21.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1deeb0f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1de80bc820 con 0x7f1de806a730 2023-05-15T16:40:21.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1deeb0f640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de80bbd40 con 0x7f1de8144360 2023-05-15T16:40:21.264 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1deeb0f640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1de80bc260 con 0x7f1de80a2160 2023-05-15T16:40:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1ddffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1de8144360 0x7f1de806b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1ddffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1de8144360 0x7f1de806b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48696/0 (socket says 172.21.15.62:48696) 2023-05-15T16:40:21.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1ddffff640 1 -- 172.21.15.62:0/2075686144 learned_addr learned my addr 172.21.15.62:0/2075686144 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:21.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1dec8ab640 1 --2- 172.21.15.62:0/2075686144 >> v2:172.21.15.161:3300/0 conn(0x7f1de80a2160 0x7f1de8143e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:21.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1ddffff640 1 -- 172.21.15.62:0/2075686144 >> v2:172.21.15.161:3300/0 conn(0x7f1de80a2160 msgr2=0x7f1de8143e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:21.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1ddffff640 1 --2- 172.21.15.62:0/2075686144 >> v2:172.21.15.161:3300/0 conn(0x7f1de80a2160 0x7f1de8143e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1ddffff640 1 -- 172.21.15.62:0/2075686144 >> v1:172.21.15.161:6789/0 conn(0x7f1de806a730 legacy=0x7f1de814d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:21.267 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1ddffff640 1 -- 172.21.15.62:0/2075686144 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1de80bc540 con 0x7f1de8144360 2023-05-15T16:40:21.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1ddffff640 1 --2- 172.21.15.62:0/2075686144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de8144360 0x7f1de806b0a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1de804ded0 tx=0x7f1dd801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05686f880179386 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:21.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1ddf7fe640 1 -- 172.21.15.62:0/2075686144 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd80aa610 con 0x7f1de8144360 2023-05-15T16:40:21.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1ddf7fe640 1 -- 172.21.15.62:0/2075686144 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dd80a6040 con 0x7f1de8144360 2023-05-15T16:40:21.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1ddf7fe640 1 -- 172.21.15.62:0/2075686144 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dd80aa990 con 0x7f1de8144360 2023-05-15T16:40:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1deeb0f640 1 -- 172.21.15.62:0/2075686144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de8144360 msgr2=0x7f1de806b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:21.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1deeb0f640 1 --2- 172.21.15.62:0/2075686144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de8144360 0x7f1de806b0a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1de804ded0 tx=0x7f1dd801c490 comp rx=0 tx=0).stop 2023-05-15T16:40:21.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1deeb0f640 1 -- 172.21.15.62:0/2075686144 shutdown_connections 2023-05-15T16:40:21.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1deeb0f640 1 --2- 172.21.15.62:0/2075686144 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de8144360 0x7f1de806b0a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1deeb0f640 1 --2- 172.21.15.62:0/2075686144 >> v2:172.21.15.161:3300/0 conn(0x7f1de80a2160 0x7f1de8143e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1deeb0f640 1 -- 172.21.15.62:0/2075686144 >> 172.21.15.62:0/2075686144 conn(0x7f1de80bffb0 msgr2=0x7f1de80c03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:21.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1deeb0f640 1 -- 172.21.15.62:0/2075686144 shutdown_connections 2023-05-15T16:40:21.277 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.259+0000 7f1deeb0f640 1 -- 172.21.15.62:0/2075686144 wait complete. 2023-05-15T16:40:21.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1deeb0f640 1 Processor -- start 2023-05-15T16:40:21.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1deeb0f640 1 -- start start 2023-05-15T16:40:21.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1deeb0f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de806a730 0x7f1de8147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:21.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1deeb0f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1de80a2160 0x7f1de80b9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:21.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1deeb0f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1de81462a0 0x7f1de8140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:21.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1deeb0f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de8147770 con 0x7f1de806a730 2023-05-15T16:40:21.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1deeb0f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1de8145e80 con 0x7f1de80a2160 2023-05-15T16:40:21.278 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1deeb0f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1de81553e0 con 0x7f1de81462a0 2023-05-15T16:40:21.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1dec8ab640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de806a730 0x7f1de8147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:21.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1dec8ab640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de806a730 0x7f1de8147230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48698/0 (socket says 172.21.15.62:48698) 2023-05-15T16:40:21.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1dec8ab640 1 -- 172.21.15.62:0/3453290274 learned_addr learned my addr 172.21.15.62:0/3453290274 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:21.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1ddffff640 1 --2- 172.21.15.62:0/3453290274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1de80a2160 0x7f1de80b9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:21.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1ded0ac640 1 --2- 172.21.15.62:0/3453290274 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1de81462a0 0x7f1de8140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:21.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1dec8ab640 1 -- 172.21.15.62:0/3453290274 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1de81462a0 msgr2=0x7f1de8140bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:21.279 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1dec8ab640 1 --2- 172.21.15.62:0/3453290274 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1de81462a0 0x7f1de8140bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1dec8ab640 1 -- 172.21.15.62:0/3453290274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1de80a2160 msgr2=0x7f1de80b9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:21.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1dec8ab640 1 --2- 172.21.15.62:0/3453290274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1de80a2160 0x7f1de80b9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1dec8ab640 1 -- 172.21.15.62:0/3453290274 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dd80094d0 con 0x7f1de806a730 2023-05-15T16:40:21.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1ded0ac640 1 --2- 172.21.15.62:0/3453290274 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1de81462a0 0x7f1de8140bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:21.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1dec8ab640 1 --2- 172.21.15.62:0/3453290274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de806a730 0x7f1de8147230 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1de400d800 tx=0x7f1de400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:21.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1ddd7fa640 1 -- 172.21.15.62:0/3453290274 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de400b6c0 con 0x7f1de806a730 2023-05-15T16:40:21.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1ddd7fa640 1 -- 172.21.15.62:0/3453290274 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1de400b820 con 0x7f1de806a730 2023-05-15T16:40:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1deeb0f640 1 -- 172.21.15.62:0/3453290274 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1de8157690 con 0x7f1de806a730 2023-05-15T16:40:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1ddd7fa640 1 -- 172.21.15.62:0/3453290274 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1de400bb90 con 0x7f1de806a730 2023-05-15T16:40:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1deeb0f640 1 -- 172.21.15.62:0/3453290274 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1de80ba930 con 0x7f1de806a730 2023-05-15T16:40:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1deeb0f640 1 -- 172.21.15.62:0/3453290274 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1de8157820 con 0x7f1de806a730 2023-05-15T16:40:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1ddd7fa640 1 -- 172.21.15.62:0/3453290274 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f1de400bcf0 con 0x7f1de806a730 2023-05-15T16:40:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.263+0000 7f1ddd7fa640 1 --2- 172.21.15.62:0/3453290274 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1dd4065380 0x7f1dd4067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:21.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.267+0000 7f1ddd7fa640 1 -- 172.21.15.62:0/3453290274 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1de4082e60 con 0x7f1de806a730 2023-05-15T16:40:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.267+0000 7f1ddffff640 1 --2- 172.21.15.62:0/3453290274 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1dd4065380 0x7f1dd4067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.267+0000 7f1ddffff640 1 --2- 172.21.15.62:0/3453290274 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1dd4065380 0x7f1dd4067830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80ae000 tx=0x7f1dd80a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:21.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.271+0000 7f1ddd7fa640 1 -- 172.21.15.62:0/3453290274 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f1de4054510 con 0x7f1de806a730 2023-05-15T16:40:21.420 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.415+0000 7f1deeb0f640 1 -- 172.21.15.62:0/3453290274 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1de8067960 con 0x7f1de806a730 2023-05-15T16:40:21.421 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.415+0000 7f1ddd7fa640 1 -- 172.21.15.62:0/3453290274 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1de4054100 con 0x7f1de806a730 2023-05-15T16:40:21.421 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-05-15T16:40:21.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.419+0000 7f1deeb0f640 1 -- 172.21.15.62:0/3453290274 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1dd4065380 msgr2=0x7f1dd4067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:21.424 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.419+0000 7f1deeb0f640 1 --2- 172.21.15.62:0/3453290274 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1dd4065380 0x7f1dd4067830 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1dd80ae000 tx=0x7f1dd80a7000 comp rx=0 tx=0).stop 2023-05-15T16:40:21.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.419+0000 7f1deeb0f640 1 -- 172.21.15.62:0/3453290274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de806a730 msgr2=0x7f1de8147230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:21.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.419+0000 7f1deeb0f640 1 --2- 172.21.15.62:0/3453290274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de806a730 0x7f1de8147230 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1de400d800 tx=0x7f1de400dcc0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.419+0000 7f1deeb0f640 1 -- 172.21.15.62:0/3453290274 shutdown_connections 2023-05-15T16:40:21.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.419+0000 7f1deeb0f640 1 --2- 172.21.15.62:0/3453290274 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1de81462a0 0x7f1de8140bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.419+0000 7f1deeb0f640 1 --2- 172.21.15.62:0/3453290274 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1de80a2160 0x7f1de80b9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.419+0000 7f1deeb0f640 1 --2- 172.21.15.62:0/3453290274 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1dd4065380 0x7f1dd4067830 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.419+0000 7f1deeb0f640 1 --2- 172.21.15.62:0/3453290274 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1de806a730 0x7f1de8147230 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.419+0000 7f1deeb0f640 1 -- 172.21.15.62:0/3453290274 >> 172.21.15.62:0/3453290274 conn(0x7f1de80bffb0 msgr2=0x7f1de80bd180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:21.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.419+0000 7f1deeb0f640 1 -- 172.21.15.62:0/3453290274 shutdown_connections 2023-05-15T16:40:21.427 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.419+0000 7f1deeb0f640 1 -- 172.21.15.62:0/3453290274 wait complete. 2023-05-15T16:40:21.439 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-15T16:40:21.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.559+0000 7fc6f826b640 1 Processor -- start 2023-05-15T16:40:21.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.559+0000 7fc6f826b640 1 -- start start 2023-05-15T16:40:21.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.559+0000 7fc6f826b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6f00bcd90 0x7fc6f014a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:21.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.559+0000 7fc6f826b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc6f006b050 0x7fc6f014a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:21.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.559+0000 7fc6f826b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6f0149c50 con 0x7fc6f00ba900 2023-05-15T16:40:21.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.559+0000 7fc6f826b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6f006aca0 con 0x7fc6f006b050 2023-05-15T16:40:21.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.559+0000 7fc6f826b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f006b530 con 0x7fc6f00bcd90 2023-05-15T16:40:21.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.559+0000 7fc6f5806640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc6f006b050 0x7fc6f014a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:21.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.559+0000 7fc6f5806640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc6f006b050 0x7fc6f014a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48700/0 (socket says 172.21.15.62:48700) 2023-05-15T16:40:21.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.559+0000 7fc6f5806640 1 -- 172.21.15.62:0/997168640 learned_addr learned my addr 172.21.15.62:0/997168640 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:21.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.559+0000 7fc6f6007640 1 --2- 172.21.15.62:0/997168640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6f00bcd90 0x7fc6f014a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:21.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.559+0000 7fc6f5806640 1 -- 172.21.15.62:0/997168640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6f00bcd90 msgr2=0x7fc6f014a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:21.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.559+0000 7fc6f5806640 1 --2- 172.21.15.62:0/997168640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6f00bcd90 0x7fc6f014a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.559+0000 7fc6f5806640 1 -- 172.21.15.62:0/997168640 >> v1:172.21.15.62:6789/0 conn(0x7fc6f00ba900 legacy=0x7fc6f014d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:21.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.559+0000 7fc6f5005640 1 -- 172.21.15.62:0/997168640 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3364531750 0 0) 0x7fc6f0149c50 con 0x7fc6f00ba900 2023-05-15T16:40:21.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.559+0000 7fc6f5806640 1 -- 172.21.15.62:0/997168640 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f006b810 con 0x7fc6f006b050 2023-05-15T16:40:21.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.563+0000 7fc6f5806640 1 --2- 172.21.15.62:0/997168640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f006b050 0x7fc6f014a630 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec009e50 tx=0x7fc6ec01ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a78db9cdf6e191 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:21.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.563+0000 7fc6f5005640 1 -- 172.21.15.62:0/997168640 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec0a56e0 con 0x7fc6f006b050 2023-05-15T16:40:21.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.563+0000 7fc6f5005640 1 -- 172.21.15.62:0/997168640 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6ec0a5840 con 0x7fc6f006b050 2023-05-15T16:40:21.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.563+0000 7fc6f5005640 1 -- 172.21.15.62:0/997168640 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6ec0a5bd0 con 0x7fc6f006b050 2023-05-15T16:40:21.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.563+0000 7fc6f826b640 1 -- 172.21.15.62:0/997168640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f006b050 msgr2=0x7fc6f014a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:21.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.563+0000 7fc6f826b640 1 --2- 172.21.15.62:0/997168640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f006b050 0x7fc6f014a630 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc6ec009e50 tx=0x7fc6ec01ca10 comp rx=0 tx=0).stop 2023-05-15T16:40:21.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.563+0000 7fc6f826b640 1 -- 172.21.15.62:0/997168640 shutdown_connections 2023-05-15T16:40:21.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.563+0000 7fc6f826b640 1 --2- 172.21.15.62:0/997168640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f006b050 0x7fc6f014a630 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.563+0000 7fc6f826b640 1 --2- 172.21.15.62:0/997168640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6f00bcd90 0x7fc6f014a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.563+0000 7fc6f826b640 1 -- 172.21.15.62:0/997168640 >> 172.21.15.62:0/997168640 conn(0x7fc6f00bff80 msgr2=0x7fc6f00c0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:21.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.563+0000 7fc6f826b640 1 -- 172.21.15.62:0/997168640 shutdown_connections 2023-05-15T16:40:21.569 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.563+0000 7fc6f826b640 1 -- 172.21.15.62:0/997168640 wait complete. 2023-05-15T16:40:21.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.563+0000 7fc6f826b640 1 Processor -- start 2023-05-15T16:40:21.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.563+0000 7fc6f826b640 1 -- start start 2023-05-15T16:40:21.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6f826b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6f006b050 0x7fc6f00b9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:21.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6f826b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6f00ba900 0x7fc6f01465c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:21.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6f826b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f00bcd90 0x7fc6f01e2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:21.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6f826b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f01499d0 con 0x7fc6f00bcd90 2023-05-15T16:40:21.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6f826b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f0146b00 con 0x7fc6f006b050 2023-05-15T16:40:21.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6f826b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f01490c0 con 0x7fc6f00ba900 2023-05-15T16:40:21.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6f6808640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f00bcd90 0x7fc6f01e2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:21.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6f6808640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f00bcd90 0x7fc6f01e2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48716/0 (socket says 172.21.15.62:48716) 2023-05-15T16:40:21.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6f6808640 1 -- 172.21.15.62:0/4292331174 learned_addr learned my addr 172.21.15.62:0/4292331174 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:21.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6f6808640 1 -- 172.21.15.62:0/4292331174 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6f00ba900 msgr2=0x7fc6f01465c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:21.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6f6808640 1 --2- 172.21.15.62:0/4292331174 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6f00ba900 0x7fc6f01465c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6f6808640 1 -- 172.21.15.62:0/4292331174 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6f006b050 msgr2=0x7fc6f00b9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6f6808640 1 --2- 172.21.15.62:0/4292331174 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6f006b050 0x7fc6f00b9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6f6808640 1 -- 172.21.15.62:0/4292331174 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ec009b30 con 0x7fc6f00bcd90 2023-05-15T16:40:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6f6808640 1 --2- 172.21.15.62:0/4292331174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f00bcd90 0x7fc6f01e2710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800c480 tx=0x7fc6e800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6e6ffd640 1 -- 172.21.15.62:0/4292331174 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e8005480 con 0x7fc6f00bcd90 2023-05-15T16:40:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6e6ffd640 1 -- 172.21.15.62:0/4292331174 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6e8003600 con 0x7fc6f00bcd90 2023-05-15T16:40:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6f826b640 1 -- 172.21.15.62:0/4292331174 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f0157510 con 0x7fc6f00bcd90 2023-05-15T16:40:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6e6ffd640 1 -- 172.21.15.62:0/4292331174 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6e80039b0 con 0x7fc6f00bcd90 2023-05-15T16:40:21.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6f826b640 1 -- 172.21.15.62:0/4292331174 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f009f5f0 con 0x7fc6f00bcd90 2023-05-15T16:40:21.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6f826b640 1 -- 172.21.15.62:0/4292331174 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f01576a0 con 0x7fc6f00bcd90 2023-05-15T16:40:21.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6e6ffd640 1 -- 172.21.15.62:0/4292331174 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fc6e8003b10 con 0x7fc6f00bcd90 2023-05-15T16:40:21.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6e6ffd640 1 --2- 172.21.15.62:0/4292331174 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc6d4065380 0x7fc6d4067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:21.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6e6ffd640 1 -- 172.21.15.62:0/4292331174 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc6e80823c0 con 0x7fc6f00bcd90 2023-05-15T16:40:21.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.567+0000 7fc6f6007640 1 --2- 172.21.15.62:0/4292331174 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc6d4065380 0x7fc6d4067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:21.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.571+0000 7fc6f6007640 1 --2- 172.21.15.62:0/4292331174 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc6d4065380 0x7fc6d4067830 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000b850 tx=0x7fc6e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:21.576 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.571+0000 7fc6e6ffd640 1 -- 172.21.15.62:0/4292331174 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fc6e8050040 con 0x7fc6f00bcd90 2023-05-15T16:40:21.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.723+0000 7fc6f826b640 1 -- 172.21.15.62:0/4292331174 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc6f0067960 con 0x7fc6f00bcd90 2023-05-15T16:40:21.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.727+0000 7fc6e6ffd640 1 -- 172.21.15.62:0/4292331174 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17811 (secure 0 0 0) 0x7fc6e8053660 con 0x7fc6f00bcd90 2023-05-15T16:40:21.731 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:21.731 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:40:02.088078+0000","last_up_change":"2023-05-15T16:39:48.597049+0000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-15T16:39:49.394028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-15T16:39:55.208679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-15T16:39:59.547414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-15T16:40:00.055526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37594},{"type":"v1","addr":"172.21.15.62:6825","nonce":37594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37594},{"type":"v1","addr":"172.21.15.62:6827","nonce":37594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37594},{"type":"v1","addr":"172.21.15.62:6831","nonce":37594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37594},{"type":"v1","addr":"172.21.15.62:6829","nonce":37594}]},"public_addr":"172.21.15.62:6825/37594","cluster_addr":"172.21.15.62:6827/37594","heartbeat_back_addr":"172.21.15.62:6831/37594","heartbeat_front_addr":"172.21.15.62:6829/37594","state":["exists","up"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37592},{"type":"v1","addr":"172.21.15.62:6808","nonce":37592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":37592},{"type":"v1","addr":"172.21.15.62:6814","nonce":37592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6821","nonce":37592},{"type":"v1","addr":"172.21.15.62:6823","nonce":37592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37592},{"type":"v1","addr":"172.21.15.62:6818","nonce":37592}]},"public_addr":"172.21.15.62:6808/37592","cluster_addr":"172.21.15.62:6814/37592","heartbeat_back_addr":"172.21.15.62:6823/37592","heartbeat_front_addr":"172.21.15.62:6818/37592","state":["exists","up"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":37591},{"type":"v1","addr":"172.21.15.62:6810","nonce":37591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":37591},{"type":"v1","addr":"172.21.15.62:6815","nonce":37591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37591},{"type":"v1","addr":"172.21.15.62:6822","nonce":37591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":37591},{"type":"v1","addr":"172.21.15.62:6819","nonce":37591}]},"public_addr":"172.21.15.62:6810/37591","cluster_addr":"172.21.15.62:6815/37591","heartbeat_back_addr":"172.21.15.62:6822/37591","heartbeat_front_addr":"172.21.15.62:6819/37591","state":["exists","up"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37593},{"type":"v1","addr":"172.21.15.62:6801","nonce":37593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37593},{"type":"v1","addr":"172.21.15.62:6803","nonce":37593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":37593},{"type":"v1","addr":"172.21.15.62:6812","nonce":37593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37593},{"type":"v1","addr":"172.21.15.62:6805","nonce":37593}]},"public_addr":"172.21.15.62:6801/37593","cluster_addr":"172.21.15.62:6803/37593","heartbeat_back_addr":"172.21.15.62:6812/37593","heartbeat_front_addr":"172.21.15.62:6805/37593","state":["exists","up"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37854},{"type":"v1","addr":"172.21.15.161:6801","nonce":37854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37854},{"type":"v1","addr":"172.21.15.161:6803","nonce":37854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37854},{"type":"v1","addr":"172.21.15.161:6807","nonce":37854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37854},{"type":"v1","addr":"172.21.15.161:6805","nonce":37854}]},"public_addr":"172.21.15.161:6801/37854","cluster_addr":"172.21.15.161:6803/37854","heartbeat_back_addr":"172.21.15.161:6807/37854","heartbeat_front_addr":"172.21.15.161:6805/37854","state":["exists","up"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37855},{"type":"v1","addr":"172.21.15.161:6810","nonce":37855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37855},{"type":"v1","addr":"172.21.15.161:6815","nonce":37855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37855},{"type":"v1","addr":"172.21.15.161:6824","nonce":37855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37855},{"type":"v1","addr":"172.21.15.161:6820","nonce":37855}]},"public_addr":"172.21.15.161:6810/37855","cluster_addr":"172.21.15.161:6815/37855","heartbeat_back_addr":"172.21.15.161:6824/37855","heartbeat_front_addr":"172.21.15.161:6820/37855","state":["exists","up"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":37856},{"type":"v1","addr":"172.21.15.161:6814","nonce":37856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37856},{"type":"v1","addr":"172.21.15.161:6819","nonce":37856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":37856},{"type":"v1","addr":"172.21.15.161:6830","nonce":37856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37856},{"type":"v1","addr":"172.21.15.161:6826","nonce":37856}]},"public_addr":"172.21.15.161:6814/37856","cluster_addr":"172.21.15.161:6819/37856","heartbeat_back_addr":"172.21.15.161:6830/37856","heartbeat_front_addr":"172.21.15.161:6826/37856","state":["exists","up"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":37857},{"type":"v1","addr":"172.21.15.161:6813","nonce":37857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":37857},{"type":"v1","addr":"172.21.15.161:6821","nonce":37857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":37857},{"type":"v1","addr":"172.21.15.161:6831","nonce":37857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":37857},{"type":"v1","addr":"172.21.15.161:6827","nonce":37857}]},"public_addr":"172.21.15.161:6813/37857","cluster_addr":"172.21.15.161:6821/37857","heartbeat_back_addr":"172.21.15.161:6831/37857","heartbeat_front_addr":"172.21.15.161:6827/37857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.592907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.618143+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.641533+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.614355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.579293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.718353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.730135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.792887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:40:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.727+0000 7fc6f826b640 1 -- 172.21.15.62:0/4292331174 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc6d4065380 msgr2=0x7fc6d4067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.727+0000 7fc6f826b640 1 --2- 172.21.15.62:0/4292331174 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc6d4065380 0x7fc6d4067830 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc6e000b850 tx=0x7fc6e0008040 comp rx=0 tx=0).stop 2023-05-15T16:40:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.727+0000 7fc6f826b640 1 -- 172.21.15.62:0/4292331174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f00bcd90 msgr2=0x7fc6f01e2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.727+0000 7fc6f826b640 1 --2- 172.21.15.62:0/4292331174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f00bcd90 0x7fc6f01e2710 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fc6e800c480 tx=0x7fc6e800c940 comp rx=0 tx=0).stop 2023-05-15T16:40:21.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.727+0000 7fc6f826b640 1 -- 172.21.15.62:0/4292331174 shutdown_connections 2023-05-15T16:40:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.727+0000 7fc6f826b640 1 --2- 172.21.15.62:0/4292331174 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc6d4065380 0x7fc6d4067830 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.727+0000 7fc6f826b640 1 --2- 172.21.15.62:0/4292331174 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc6f00bcd90 0x7fc6f01e2710 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.727+0000 7fc6f826b640 1 --2- 172.21.15.62:0/4292331174 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc6f00ba900 0x7fc6f01465c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.727+0000 7fc6f826b640 1 --2- 172.21.15.62:0/4292331174 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc6f006b050 0x7fc6f00b9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.727+0000 7fc6f826b640 1 -- 172.21.15.62:0/4292331174 >> 172.21.15.62:0/4292331174 conn(0x7fc6f00bff80 msgr2=0x7fc6f00bb760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.731+0000 7fc6f826b640 1 -- 172.21.15.62:0/4292331174 shutdown_connections 2023-05-15T16:40:21.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.731+0000 7fc6f826b640 1 -- 172.21.15.62:0/4292331174 wait complete. 2023-05-15T16:40:21.751 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-15T16:39:49.394028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-15T16:39:55.208679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-15T16:39:59.547414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-15T16:40:00.055526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-15T16:40:21.751 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-15T16:40:21.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.871+0000 7fbbb4e07640 1 Processor -- start 2023-05-15T16:40:21.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.871+0000 7fbbb4e07640 1 -- start start 2023-05-15T16:40:21.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.871+0000 7fbbb4e07640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbbb0141eb0 0x7fbbb00b4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:21.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.871+0000 7fbbb4e07640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fbbb00b7590 0x7fbbb0147ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:21.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.871+0000 7fbbb4e07640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb00b9130 0x7fbbb00bd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:21.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.871+0000 7fbbb4e07640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb0142280 con 0x7fbbb0141eb0 2023-05-15T16:40:21.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.871+0000 7fbbb4e07640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb00b4bd0 con 0x7fbbb00b7590 2023-05-15T16:40:21.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.871+0000 7fbbb4e07640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb00b7020 con 0x7fbbb00b9130 2023-05-15T16:40:21.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.871+0000 7fbbae59c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbbb0141eb0 0x7fbbb00b4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:21.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.871+0000 7fbbae59c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbbb0141eb0 0x7fbbb00b4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48722/0 (socket says 172.21.15.62:48722) 2023-05-15T16:40:21.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.871+0000 7fbbae59c640 1 -- 172.21.15.62:0/883199869 learned_addr learned my addr 172.21.15.62:0/883199869 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:21.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.871+0000 7fbbadd9b640 1 --2- 172.21.15.62:0/883199869 >> v2:172.21.15.161:3300/0 conn(0x7fbbb00b7590 0x7fbbb0147ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:21.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.871+0000 7fbbaed9d640 1 --2- 172.21.15.62:0/883199869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb00b9130 0x7fbbb00bd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:21.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.871+0000 7fbbae59c640 1 -- 172.21.15.62:0/883199869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb00b9130 msgr2=0x7fbbb00bd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:21.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.871+0000 7fbbae59c640 1 --2- 172.21.15.62:0/883199869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb00b9130 0x7fbbb00bd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.871+0000 7fbbae59c640 1 -- 172.21.15.62:0/883199869 >> v2:172.21.15.161:3300/0 conn(0x7fbbb00b7590 msgr2=0x7fbbb0147ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:21.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.871+0000 7fbbae59c640 1 --2- 172.21.15.62:0/883199869 >> v2:172.21.15.161:3300/0 conn(0x7fbbb00b7590 0x7fbbb0147ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.871+0000 7fbbae59c640 1 -- 172.21.15.62:0/883199869 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb00b7a20 con 0x7fbbb0141eb0 2023-05-15T16:40:21.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbae59c640 1 --2- 172.21.15.62:0/883199869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb0141eb0 0x7fbbb00b4690 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00bdd10 tx=0x7fbba001c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d149d7014861521a server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:21.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbad59a640 1 -- 172.21.15.62:0/883199869 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba00ab600 con 0x7fbbb0141eb0 2023-05-15T16:40:21.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbad59a640 1 -- 172.21.15.62:0/883199869 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba00ab760 con 0x7fbbb0141eb0 2023-05-15T16:40:21.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbad59a640 1 -- 172.21.15.62:0/883199869 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba00abaf0 con 0x7fbbb0141eb0 2023-05-15T16:40:21.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbb4e07640 1 -- 172.21.15.62:0/883199869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb0141eb0 msgr2=0x7fbbb00b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:21.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbb4e07640 1 --2- 172.21.15.62:0/883199869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb0141eb0 0x7fbbb00b4690 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbbb00bdd10 tx=0x7fbba001c440 comp rx=0 tx=0).stop 2023-05-15T16:40:21.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbb4e07640 1 -- 172.21.15.62:0/883199869 shutdown_connections 2023-05-15T16:40:21.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbb4e07640 1 --2- 172.21.15.62:0/883199869 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb00b9130 0x7fbbb00bd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbb4e07640 1 --2- 172.21.15.62:0/883199869 >> v2:172.21.15.161:3300/0 conn(0x7fbbb00b7590 0x7fbbb0147ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbb4e07640 1 --2- 172.21.15.62:0/883199869 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb0141eb0 0x7fbbb00b4690 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbb4e07640 1 -- 172.21.15.62:0/883199869 >> 172.21.15.62:0/883199869 conn(0x7fbbb006d280 msgr2=0x7fbbb006d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:21.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbb4e07640 1 -- 172.21.15.62:0/883199869 shutdown_connections 2023-05-15T16:40:21.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbb4e07640 1 -- 172.21.15.62:0/883199869 wait complete. 2023-05-15T16:40:21.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbb4e07640 1 Processor -- start 2023-05-15T16:40:21.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbb4e07640 1 -- start start 2023-05-15T16:40:21.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbb4e07640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb00b7590 0x7fbbb013d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:21.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbb4e07640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb00b9130 0x7fbbb0148bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:21.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbb4e07640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbb0141eb0 0x7fbbb0149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:21.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbb4e07640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb0149850 con 0x7fbbb00b9130 2023-05-15T16:40:21.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbb4e07640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb013d9f0 con 0x7fbbb0141eb0 2023-05-15T16:40:21.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbb4e07640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb01521b0 con 0x7fbbb00b7590 2023-05-15T16:40:21.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbadd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb00b9130 0x7fbbb0148bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:21.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbadd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb00b9130 0x7fbbb0148bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48724/0 (socket says 172.21.15.62:48724) 2023-05-15T16:40:21.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbadd9b640 1 -- 172.21.15.62:0/2672063029 learned_addr learned my addr 172.21.15.62:0/2672063029 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:21.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbaed9d640 1 --2- 172.21.15.62:0/2672063029 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbb0141eb0 0x7fbbb0149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:21.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbae59c640 1 --2- 172.21.15.62:0/2672063029 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb00b7590 0x7fbbb013d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:21.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbadd9b640 1 -- 172.21.15.62:0/2672063029 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb00b7590 msgr2=0x7fbbb013d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:21.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbadd9b640 1 --2- 172.21.15.62:0/2672063029 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb00b7590 0x7fbbb013d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbadd9b640 1 -- 172.21.15.62:0/2672063029 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbb0141eb0 msgr2=0x7fbbb0149110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:21.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbadd9b640 1 --2- 172.21.15.62:0/2672063029 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbb0141eb0 0x7fbbb0149110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:21.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbadd9b640 1 -- 172.21.15.62:0/2672063029 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbba00094d0 con 0x7fbbb00b9130 2023-05-15T16:40:21.885 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbadd9b640 1 --2- 172.21.15.62:0/2672063029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb00b9130 0x7fbbb0148bd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbba400d800 tx=0x7fbba400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:21.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbb9effd640 1 -- 172.21.15.62:0/2672063029 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba40096a0 con 0x7fbbb00b9130 2023-05-15T16:40:21.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbb9effd640 1 -- 172.21.15.62:0/2672063029 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba4009800 con 0x7fbbb00b9130 2023-05-15T16:40:21.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbbb4e07640 1 -- 172.21.15.62:0/2672063029 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb0148000 con 0x7fbbb00b9130 2023-05-15T16:40:21.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.875+0000 7fbb9effd640 1 -- 172.21.15.62:0/2672063029 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba4009b70 con 0x7fbbb00b9130 2023-05-15T16:40:21.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.879+0000 7fbbb4e07640 1 -- 172.21.15.62:0/2672063029 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb00b8c10 con 0x7fbbb00b9130 2023-05-15T16:40:21.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.879+0000 7fbbb4e07640 1 -- 172.21.15.62:0/2672063029 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb00b8260 con 0x7fbbb00b9130 2023-05-15T16:40:21.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.879+0000 7fbb9effd640 1 -- 172.21.15.62:0/2672063029 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fbba4009cd0 con 0x7fbbb00b9130 2023-05-15T16:40:21.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.879+0000 7fbb9effd640 1 --2- 172.21.15.62:0/2672063029 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbb900653b0 0x7fbb90067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:21.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.879+0000 7fbb9effd640 1 -- 172.21.15.62:0/2672063029 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbba4082f00 con 0x7fbbb00b9130 2023-05-15T16:40:21.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.879+0000 7fbbae59c640 1 --2- 172.21.15.62:0/2672063029 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbb900653b0 0x7fbb90067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:21.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.879+0000 7fbbae59c640 1 --2- 172.21.15.62:0/2672063029 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbb900653b0 0x7fbb90067860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbba00af000 tx=0x7fbba00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:21.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:21.883+0000 7fbb9effd640 1 -- 172.21.15.62:0/2672063029 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fbba4050c10 con 0x7fbbb00b9130 2023-05-15T16:40:22.040 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.035+0000 7fbbb4e07640 1 -- 172.21.15.62:0/2672063029 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbbb0148a30 con 0x7fbbb00b9130 2023-05-15T16:40:22.041 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.039+0000 7fbb9effd640 1 -- 172.21.15.62:0/2672063029 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbbb0148a30 con 0x7fbbb00b9130 2023-05-15T16:40:22.041 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-05-15T16:40:22.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.039+0000 7fbbb4e07640 1 -- 172.21.15.62:0/2672063029 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbb900653b0 msgr2=0x7fbb90067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:22.043 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.039+0000 7fbbb4e07640 1 --2- 172.21.15.62:0/2672063029 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbb900653b0 0x7fbb90067860 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fbba00af000 tx=0x7fbba00a7000 comp rx=0 tx=0).stop 2023-05-15T16:40:22.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.039+0000 7fbbb4e07640 1 -- 172.21.15.62:0/2672063029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb00b9130 msgr2=0x7fbbb0148bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:22.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.039+0000 7fbbb4e07640 1 --2- 172.21.15.62:0/2672063029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb00b9130 0x7fbbb0148bd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fbba400d800 tx=0x7fbba400dcc0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.039+0000 7fbbb4e07640 1 -- 172.21.15.62:0/2672063029 shutdown_connections 2023-05-15T16:40:22.044 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.039+0000 7fbbb4e07640 1 --2- 172.21.15.62:0/2672063029 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbbb0141eb0 0x7fbbb0149110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.039+0000 7fbbb4e07640 1 --2- 172.21.15.62:0/2672063029 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbb900653b0 0x7fbb90067860 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.039+0000 7fbbb4e07640 1 --2- 172.21.15.62:0/2672063029 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbbb00b9130 0x7fbbb0148bd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.039+0000 7fbbb4e07640 1 --2- 172.21.15.62:0/2672063029 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbbb00b7590 0x7fbbb013d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.039+0000 7fbbb4e07640 1 -- 172.21.15.62:0/2672063029 >> 172.21.15.62:0/2672063029 conn(0x7fbbb006d280 msgr2=0x7fbbb006d650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:22.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.039+0000 7fbbb4e07640 1 -- 172.21.15.62:0/2672063029 shutdown_connections 2023-05-15T16:40:22.045 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.039+0000 7fbbb4e07640 1 -- 172.21.15.62:0/2672063029 wait complete. 2023-05-15T16:40:22.060 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-15T16:40:22.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.183+0000 7fc068c8d640 1 Processor -- start 2023-05-15T16:40:22.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.183+0000 7fc068c8d640 1 -- start start 2023-05-15T16:40:22.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.183+0000 7fc068c8d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc06406aa20 0x7fc06406f420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:22.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.183+0000 7fc068c8d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc06406f960 0x7fc06414a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:22.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.183+0000 7fc068c8d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0640b60b0 con 0x7fc0640b6500 2023-05-15T16:40:22.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.183+0000 7fc068c8d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc06406fe00 con 0x7fc06406f960 2023-05-15T16:40:22.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.183+0000 7fc068c8d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc064071600 con 0x7fc06406aa20 2023-05-15T16:40:22.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.183+0000 7fc062d9d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc06406f960 0x7fc06414a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:22.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.183+0000 7fc05bfff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc0640b6500 0x7fc0641498f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58200/0 (socket says 172.21.15.62:58200) 2023-05-15T16:40:22.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.183+0000 7fc05bfff640 1 -- 172.21.15.62:0/3681991857 learned_addr learned my addr 172.21.15.62:0/3681991857 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:22.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.183+0000 7fc06259c640 1 --2- 172.21.15.62:0/3681991857 >> v2:172.21.15.161:3300/0 conn(0x7fc06406aa20 0x7fc06406f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:22.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.183+0000 7fc062d9d640 1 -- 172.21.15.62:0/3681991857 >> v2:172.21.15.161:3300/0 conn(0x7fc06406aa20 msgr2=0x7fc06406f420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:22.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.183+0000 7fc062d9d640 1 --2- 172.21.15.62:0/3681991857 >> v2:172.21.15.161:3300/0 conn(0x7fc06406aa20 0x7fc06406f420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.183+0000 7fc062d9d640 1 -- 172.21.15.62:0/3681991857 >> v1:172.21.15.62:6789/0 conn(0x7fc0640b6500 legacy=0x7fc0641498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:22.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.183+0000 7fc062d9d640 1 -- 172.21.15.62:0/3681991857 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0640718e0 con 0x7fc06406f960 2023-05-15T16:40:22.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.183+0000 7fc061d9b640 1 -- 172.21.15.62:0/3681991857 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3626830726 0 0) 0x7fc0640b60b0 con 0x7fc0640b6500 2023-05-15T16:40:22.190 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.183+0000 7fc06259c640 1 --2- 172.21.15.62:0/3681991857 >> v2:172.21.15.161:3300/0 conn(0x7fc06406aa20 0x7fc06406f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:22.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.183+0000 7fc062d9d640 1 --2- 172.21.15.62:0/3681991857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc06406f960 0x7fc06414a000 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc0640bd4f0 tx=0x7fc05c020210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f279c7c268701094 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:22.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.183+0000 7fc061d9b640 1 -- 172.21.15.62:0/3681991857 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c00a2d0 con 0x7fc06406f960 2023-05-15T16:40:22.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.183+0000 7fc061d9b640 1 -- 172.21.15.62:0/3681991857 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c0ac050 con 0x7fc06406f960 2023-05-15T16:40:22.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.183+0000 7fc061d9b640 1 -- 172.21.15.62:0/3681991857 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c008660 con 0x7fc06406f960 2023-05-15T16:40:22.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc068c8d640 1 -- 172.21.15.62:0/3681991857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc06406f960 msgr2=0x7fc06414a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:22.191 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc068c8d640 1 --2- 172.21.15.62:0/3681991857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc06406f960 0x7fc06414a000 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fc0640bd4f0 tx=0x7fc05c020210 comp rx=0 tx=0).stop 2023-05-15T16:40:22.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc068c8d640 1 -- 172.21.15.62:0/3681991857 shutdown_connections 2023-05-15T16:40:22.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc068c8d640 1 --2- 172.21.15.62:0/3681991857 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc06406f960 0x7fc06414a000 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.192 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc068c8d640 1 --2- 172.21.15.62:0/3681991857 >> v2:172.21.15.161:3300/0 conn(0x7fc06406aa20 0x7fc06406f420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc068c8d640 1 -- 172.21.15.62:0/3681991857 >> 172.21.15.62:0/3681991857 conn(0x7fc0640bd0b0 msgr2=0x7fc0640b8ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:22.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc068c8d640 1 -- 172.21.15.62:0/3681991857 shutdown_connections 2023-05-15T16:40:22.194 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc068c8d640 1 -- 172.21.15.62:0/3681991857 wait complete. 2023-05-15T16:40:22.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc068c8d640 1 Processor -- start 2023-05-15T16:40:22.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc068c8d640 1 -- start start 2023-05-15T16:40:22.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc068c8d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc06406aa20 0x7fc0640bac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:22.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc068c8d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc06406f960 0x7fc06413e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:22.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc068c8d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0640b6500 0x7fc06413d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:22.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc068c8d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06413ebf0 con 0x7fc06406aa20 2023-05-15T16:40:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc068c8d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640bc0c0 con 0x7fc0640b6500 2023-05-15T16:40:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc068c8d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640bb300 con 0x7fc06406f960 2023-05-15T16:40:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc06259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc06406aa20 0x7fc0640bac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc06259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc06406aa20 0x7fc0640bac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48746/0 (socket says 172.21.15.62:48746) 2023-05-15T16:40:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc06259c640 1 -- 172.21.15.62:0/2397268563 learned_addr learned my addr 172.21.15.62:0/2397268563 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc06259c640 1 -- 172.21.15.62:0/2397268563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc06406f960 msgr2=0x7fc06413e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:22.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc06259c640 1 --2- 172.21.15.62:0/2397268563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc06406f960 0x7fc06413e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc06259c640 1 -- 172.21.15.62:0/2397268563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0640b6500 msgr2=0x7fc06413d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc062d9d640 1 --2- 172.21.15.62:0/2397268563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0640b6500 0x7fc06413d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc06259c640 1 --2- 172.21.15.62:0/2397268563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0640b6500 0x7fc06413d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc06259c640 1 -- 172.21.15.62:0/2397268563 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c00ab80 con 0x7fc06406aa20 2023-05-15T16:40:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc06259c640 1 --2- 172.21.15.62:0/2397268563 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc06406aa20 0x7fc0640bac80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc05400c7c0 tx=0x7fc05400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc05affd640 1 -- 172.21.15.62:0/2397268563 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054007a30 con 0x7fc06406aa20 2023-05-15T16:40:22.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc05affd640 1 -- 172.21.15.62:0/2397268563 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc054007b90 con 0x7fc06406aa20 2023-05-15T16:40:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc068c8d640 1 -- 172.21.15.62:0/2397268563 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc06406ef00 con 0x7fc06406aa20 2023-05-15T16:40:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc05affd640 1 -- 172.21.15.62:0/2397268563 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05400ce70 con 0x7fc06406aa20 2023-05-15T16:40:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.187+0000 7fc068c8d640 1 -- 172.21.15.62:0/2397268563 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc06406ec20 con 0x7fc06406aa20 2023-05-15T16:40:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.191+0000 7fc068c8d640 1 -- 172.21.15.62:0/2397268563 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0640712b0 con 0x7fc06406aa20 2023-05-15T16:40:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.191+0000 7fc05affd640 1 -- 172.21.15.62:0/2397268563 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fc0540113f0 con 0x7fc06406aa20 2023-05-15T16:40:22.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.191+0000 7fc05affd640 1 --2- 172.21.15.62:0/2397268563 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc044065380 0x7fc044067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:22.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.191+0000 7fc05affd640 1 -- 172.21.15.62:0/2397268563 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc054082d90 con 0x7fc06406aa20 2023-05-15T16:40:22.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.191+0000 7fc05bfff640 1 --2- 172.21.15.62:0/2397268563 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc044065380 0x7fc044067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:22.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.191+0000 7fc05bfff640 1 --2- 172.21.15.62:0/2397268563 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc044065380 0x7fc044067830 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc064137ca0 tx=0x7fc04c007970 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:22.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.195+0000 7fc05affd640 1 -- 172.21.15.62:0/2397268563 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fc0540509b0 con 0x7fc06406aa20 2023-05-15T16:40:22.346 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.343+0000 7fc068c8d640 1 -- 172.21.15.62:0/2397268563 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc064067960 con 0x7fc06406aa20 2023-05-15T16:40:22.347 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.343+0000 7fc05affd640 1 -- 172.21.15.62:0/2397268563 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc054053fd0 con 0x7fc06406aa20 2023-05-15T16:40:22.347 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-05-15T16:40:22.348 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.343+0000 7fc068c8d640 1 -- 172.21.15.62:0/2397268563 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc044065380 msgr2=0x7fc044067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:22.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.343+0000 7fc068c8d640 1 --2- 172.21.15.62:0/2397268563 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc044065380 0x7fc044067830 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc064137ca0 tx=0x7fc04c007970 comp rx=0 tx=0).stop 2023-05-15T16:40:22.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.343+0000 7fc068c8d640 1 -- 172.21.15.62:0/2397268563 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc06406aa20 msgr2=0x7fc0640bac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:22.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.343+0000 7fc068c8d640 1 --2- 172.21.15.62:0/2397268563 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc06406aa20 0x7fc0640bac80 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc05400c7c0 tx=0x7fc05400cc80 comp rx=0 tx=0).stop 2023-05-15T16:40:22.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.343+0000 7fc068c8d640 1 -- 172.21.15.62:0/2397268563 shutdown_connections 2023-05-15T16:40:22.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.343+0000 7fc068c8d640 1 --2- 172.21.15.62:0/2397268563 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc0640b6500 0x7fc06413d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.343+0000 7fc068c8d640 1 --2- 172.21.15.62:0/2397268563 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc06406f960 0x7fc06413e6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.349 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.343+0000 7fc068c8d640 1 --2- 172.21.15.62:0/2397268563 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc044065380 0x7fc044067830 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.343+0000 7fc068c8d640 1 --2- 172.21.15.62:0/2397268563 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc06406aa20 0x7fc0640bac80 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.343+0000 7fc068c8d640 1 -- 172.21.15.62:0/2397268563 >> 172.21.15.62:0/2397268563 conn(0x7fc0640bd0b0 msgr2=0x7fc0640b3720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:22.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.343+0000 7fc068c8d640 1 -- 172.21.15.62:0/2397268563 shutdown_connections 2023-05-15T16:40:22.350 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.343+0000 7fc068c8d640 1 -- 172.21.15.62:0/2397268563 wait complete. 2023-05-15T16:40:22.364 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-15T16:40:22.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.483+0000 7eff09bc7640 1 Processor -- start 2023-05-15T16:40:22.489 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.483+0000 7eff09bc7640 1 -- start start 2023-05-15T16:40:22.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.487+0000 7eff09bc7640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7eff041504d0 0x7eff041528b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:22.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.487+0000 7eff09bc7640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff040b5240 con 0x7eff040b5e70 2023-05-15T16:40:22.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.487+0000 7eff09bc7640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff04144880 con 0x7eff040b7910 2023-05-15T16:40:22.490 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.487+0000 7eff09bc7640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff040b5a50 con 0x7eff041504d0 2023-05-15T16:40:22.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.487+0000 7eff03fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7eff041504d0 0x7eff041528b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:22.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.487+0000 7eff02ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7eff040b5e70 0x7eff04144170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58204/0 (socket says 172.21.15.62:58204) 2023-05-15T16:40:22.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.487+0000 7eff02ffd640 1 -- 172.21.15.62:0/682443874 learned_addr learned my addr 172.21.15.62:0/682443874 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:22.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.487+0000 7eff03fff640 1 -- 172.21.15.62:0/682443874 >> v1:172.21.15.161:6789/0 conn(0x7eff040b7910 legacy=0x7eff040b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:22.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.487+0000 7eff03fff640 1 -- 172.21.15.62:0/682443874 >> v1:172.21.15.62:6789/0 conn(0x7eff040b5e70 legacy=0x7eff04144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:22.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.487+0000 7eff03fff640 1 -- 172.21.15.62:0/682443874 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff040b3220 con 0x7eff041504d0 2023-05-15T16:40:22.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.487+0000 7eff027fc640 1 -- 172.21.15.62:0/682443874 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 612563609 0 0) 0x7eff040b5240 con 0x7eff040b5e70 2023-05-15T16:40:22.492 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.487+0000 7eff03fff640 1 --2- 172.21.15.62:0/682443874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff041504d0 0x7eff041528b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efef4009d90 tx=0x7efef401f100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa4c554569ca038 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:22.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.487+0000 7eff027fc640 1 -- 172.21.15.62:0/682443874 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef40af600 con 0x7eff041504d0 2023-05-15T16:40:22.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.487+0000 7eff027fc640 1 -- 172.21.15.62:0/682443874 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef40ab050 con 0x7eff041504d0 2023-05-15T16:40:22.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.487+0000 7eff027fc640 1 -- 172.21.15.62:0/682443874 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef40af980 con 0x7eff041504d0 2023-05-15T16:40:22.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff09bc7640 1 -- 172.21.15.62:0/682443874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff041504d0 msgr2=0x7eff041528b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:22.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff09bc7640 1 --2- 172.21.15.62:0/682443874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff041504d0 0x7eff041528b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efef4009d90 tx=0x7efef401f100 comp rx=0 tx=0).stop 2023-05-15T16:40:22.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff09bc7640 1 -- 172.21.15.62:0/682443874 shutdown_connections 2023-05-15T16:40:22.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff09bc7640 1 --2- 172.21.15.62:0/682443874 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff041504d0 0x7eff041528b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff09bc7640 1 -- 172.21.15.62:0/682443874 >> 172.21.15.62:0/682443874 conn(0x7eff040697b0 msgr2=0x7eff04069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:22.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff09bc7640 1 -- 172.21.15.62:0/682443874 shutdown_connections 2023-05-15T16:40:22.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff09bc7640 1 -- 172.21.15.62:0/682443874 wait complete. 2023-05-15T16:40:22.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff09bc7640 1 Processor -- start 2023-05-15T16:40:22.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff09bc7640 1 -- start start 2023-05-15T16:40:22.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff09bc7640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff040b5e70 0x7eff041425c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:22.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff09bc7640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff040b7910 0x7eff040b9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:22.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff09bc7640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff041504d0 0x7eff04137c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:22.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff09bc7640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff040ba2c0 con 0x7eff040b7910 2023-05-15T16:40:22.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff09bc7640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff04137800 con 0x7eff040b5e70 2023-05-15T16:40:22.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff09bc7640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff04142c30 con 0x7eff041504d0 2023-05-15T16:40:22.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff02ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff040b7910 0x7eff040b9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:22.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff02ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff040b7910 0x7eff040b9d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48760/0 (socket says 172.21.15.62:48760) 2023-05-15T16:40:22.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff02ffd640 1 -- 172.21.15.62:0/1536142622 learned_addr learned my addr 172.21.15.62:0/1536142622 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:22.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff03fff640 1 --2- 172.21.15.62:0/1536142622 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff041504d0 0x7eff04137c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:22.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff02ffd640 1 -- 172.21.15.62:0/1536142622 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff041504d0 msgr2=0x7eff04137c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:22.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff037fe640 1 --2- 172.21.15.62:0/1536142622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff040b5e70 0x7eff041425c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:22.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff02ffd640 1 --2- 172.21.15.62:0/1536142622 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff041504d0 0x7eff04137c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff02ffd640 1 -- 172.21.15.62:0/1536142622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff040b5e70 msgr2=0x7eff041425c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:22.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff02ffd640 1 --2- 172.21.15.62:0/1536142622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff040b5e70 0x7eff041425c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff02ffd640 1 -- 172.21.15.62:0/1536142622 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef4009a70 con 0x7eff040b7910 2023-05-15T16:40:22.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff03fff640 1 --2- 172.21.15.62:0/1536142622 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff041504d0 0x7eff04137c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:22.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff02ffd640 1 --2- 172.21.15.62:0/1536142622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff040b7910 0x7eff040b9d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efeec00c4b0 tx=0x7efeec00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:22.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7efefbfff640 1 -- 172.21.15.62:0/1536142622 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec0074e0 con 0x7eff040b7910 2023-05-15T16:40:22.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7efefbfff640 1 -- 172.21.15.62:0/1536142622 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efeec007660 con 0x7eff040b7910 2023-05-15T16:40:22.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff09bc7640 1 -- 172.21.15.62:0/1536142622 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff040b34c0 con 0x7eff040b7910 2023-05-15T16:40:22.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7efefbfff640 1 -- 172.21.15.62:0/1536142622 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efeec004a30 con 0x7eff040b7910 2023-05-15T16:40:22.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff09bc7640 1 -- 172.21.15.62:0/1536142622 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff040b4710 con 0x7eff040b7910 2023-05-15T16:40:22.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.491+0000 7eff09bc7640 1 -- 172.21.15.62:0/1536142622 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff040b2a90 con 0x7eff040b7910 2023-05-15T16:40:22.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.495+0000 7efefbfff640 1 -- 172.21.15.62:0/1536142622 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7efeec004b90 con 0x7eff040b7910 2023-05-15T16:40:22.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.495+0000 7efefbfff640 1 --2- 172.21.15.62:0/1536142622 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7efee40653b0 0x7efee4067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:22.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.495+0000 7efefbfff640 1 -- 172.21.15.62:0/1536142622 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7efeec081c80 con 0x7eff040b7910 2023-05-15T16:40:22.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.495+0000 7eff037fe640 1 --2- 172.21.15.62:0/1536142622 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7efee40653b0 0x7efee4067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:22.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.495+0000 7eff037fe640 1 --2- 172.21.15.62:0/1536142622 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7efee40653b0 0x7efee4067860 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efefc007fd0 tx=0x7efefc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:22.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.499+0000 7efefbfff640 1 -- 172.21.15.62:0/1536142622 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7efeec04fa50 con 0x7eff040b7910 2023-05-15T16:40:22.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.651+0000 7eff09bc7640 1 -- 172.21.15.62:0/1536142622 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7eff041372f0 con 0x7eff040b7910 2023-05-15T16:40:22.656 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.651+0000 7efefbfff640 1 -- 172.21.15.62:0/1536142622 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7eff041372f0 con 0x7eff040b7910 2023-05-15T16:40:22.656 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-05-15T16:40:22.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.655+0000 7eff09bc7640 1 -- 172.21.15.62:0/1536142622 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7efee40653b0 msgr2=0x7efee4067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:22.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.655+0000 7eff09bc7640 1 --2- 172.21.15.62:0/1536142622 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7efee40653b0 0x7efee4067860 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7efefc007fd0 tx=0x7efefc009040 comp rx=0 tx=0).stop 2023-05-15T16:40:22.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.655+0000 7eff09bc7640 1 -- 172.21.15.62:0/1536142622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff040b7910 msgr2=0x7eff040b9d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:22.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.655+0000 7eff09bc7640 1 --2- 172.21.15.62:0/1536142622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff040b7910 0x7eff040b9d80 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efeec00c4b0 tx=0x7efeec00c970 comp rx=0 tx=0).stop 2023-05-15T16:40:22.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.655+0000 7eff09bc7640 1 -- 172.21.15.62:0/1536142622 shutdown_connections 2023-05-15T16:40:22.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.655+0000 7eff09bc7640 1 --2- 172.21.15.62:0/1536142622 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7eff041504d0 0x7eff04137c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.655+0000 7eff09bc7640 1 --2- 172.21.15.62:0/1536142622 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7efee40653b0 0x7efee4067860 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.655+0000 7eff09bc7640 1 --2- 172.21.15.62:0/1536142622 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7eff040b7910 0x7eff040b9d80 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.655+0000 7eff09bc7640 1 --2- 172.21.15.62:0/1536142622 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7eff040b5e70 0x7eff041425c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.655+0000 7eff09bc7640 1 -- 172.21.15.62:0/1536142622 >> 172.21.15.62:0/1536142622 conn(0x7eff040697b0 msgr2=0x7eff0413db70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:22.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.655+0000 7eff09bc7640 1 -- 172.21.15.62:0/1536142622 shutdown_connections 2023-05-15T16:40:22.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.655+0000 7eff09bc7640 1 -- 172.21.15.62:0/1536142622 wait complete. 2023-05-15T16:40:22.675 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-15T16:40:22.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.795+0000 7fb86900f640 1 Processor -- start 2023-05-15T16:40:22.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.795+0000 7fb86900f640 1 -- start start 2023-05-15T16:40:22.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb86900f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8640b3080 0x7fb8640b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:22.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb86900f640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8640b7400 con 0x7fb8640b4100 2023-05-15T16:40:22.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb86900f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb864142380 con 0x7fb864147c30 2023-05-15T16:40:22.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb86900f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640b4e70 con 0x7fb8640b3080 2023-05-15T16:40:22.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb862d9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb8640b4100 0x7fb864141c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58208/0 (socket says 172.21.15.62:58208) 2023-05-15T16:40:22.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb862d9d640 1 -- 172.21.15.62:0/2359668386 learned_addr learned my addr 172.21.15.62:0/2359668386 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:22.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb86259c640 1 --2- 172.21.15.62:0/2359668386 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8640b3080 0x7fb8640b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:22.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb861d9b640 1 -- 172.21.15.62:0/2359668386 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 834734717 0 0) 0x7fb8640b7400 con 0x7fb8640b4100 2023-05-15T16:40:22.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb861d9b640 1 -- 172.21.15.62:0/2359668386 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb84c003530 con 0x7fb8640b4100 2023-05-15T16:40:22.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb861d9b640 1 -- 172.21.15.62:0/2359668386 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3510757411 0 0) 0x7fb84c003530 con 0x7fb8640b4100 2023-05-15T16:40:22.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb861d9b640 1 -- 172.21.15.62:0/2359668386 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8640b3080 msgr2=0x7fb8640b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:22.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb861d9b640 1 --2- 172.21.15.62:0/2359668386 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8640b3080 0x7fb8640b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb861d9b640 1 -- 172.21.15.62:0/2359668386 >> v1:172.21.15.161:6789/0 conn(0x7fb864147c30 legacy=0x7fb8641524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:22.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb861d9b640 1 -- 172.21.15.62:0/2359668386 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8640b6640 con 0x7fb8640b4100 2023-05-15T16:40:22.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb861d9b640 1 -- 172.21.15.62:0/2359668386 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7fb854001680 con 0x7fb8640b4100 2023-05-15T16:40:22.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb861d9b640 1 -- 172.21.15.62:0/2359668386 >> v1:172.21.15.62:6789/0 conn(0x7fb8640b4100 legacy=0x7fb864141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:22.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb861d9b640 1 --2- 172.21.15.62:0/2359668386 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8640b3080 0x7fb84c0039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:22.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb861d9b640 1 --2- 172.21.15.62:0/2359668386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb84c003f30 0x7fb84c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:22.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb861d9b640 1 --2- 172.21.15.62:0/2359668386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb84c004d10 0x7fb84c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:22.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb861d9b640 1 -- 172.21.15.62:0/2359668386 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640b4e70 con 0x7fb84c003f30 2023-05-15T16:40:22.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb861d9b640 1 -- 172.21.15.62:0/2359668386 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c00ba70 con 0x7fb84c004d10 2023-05-15T16:40:22.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb861d9b640 1 -- 172.21.15.62:0/2359668386 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb84c00bc30 con 0x7fb8640b3080 2023-05-15T16:40:22.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb86259c640 1 --2- 172.21.15.62:0/2359668386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb84c003f30 0x7fb84c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:22.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb862d9d640 1 --2- 172.21.15.62:0/2359668386 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8640b3080 0x7fb84c0039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:22.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb86359e640 1 --2- 172.21.15.62:0/2359668386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb84c004d10 0x7fb84c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:22.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb86259c640 1 -- 172.21.15.62:0/2359668386 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8640b3080 msgr2=0x7fb84c0039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:22.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb86259c640 1 --2- 172.21.15.62:0/2359668386 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb8640b3080 0x7fb84c0039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb86259c640 1 -- 172.21.15.62:0/2359668386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb84c004d10 msgr2=0x7fb84c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:22.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb86259c640 1 --2- 172.21.15.62:0/2359668386 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb84c004d10 0x7fb84c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.809 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.799+0000 7fb86259c640 1 -- 172.21.15.62:0/2359668386 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb84c003530 con 0x7fb84c003f30 2023-05-15T16:40:22.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86259c640 1 --2- 172.21.15.62:0/2359668386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb84c003f30 0x7fb84c0047d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb8640b3450 tx=0x7fb85801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b5b6bb4d0c93e6 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:22.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb861d9b640 1 -- 172.21.15.62:0/2359668386 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8580a64e0 con 0x7fb84c003f30 2023-05-15T16:40:22.811 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb861d9b640 1 -- 172.21.15.62:0/2359668386 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8580a6640 con 0x7fb84c003f30 2023-05-15T16:40:22.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb861d9b640 1 -- 172.21.15.62:0/2359668386 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8580a69f0 con 0x7fb84c003f30 2023-05-15T16:40:22.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86900f640 1 -- 172.21.15.62:0/2359668386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb84c003f30 msgr2=0x7fb84c0047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:22.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86900f640 1 --2- 172.21.15.62:0/2359668386 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb84c003f30 0x7fb84c0047d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb8640b3450 tx=0x7fb85801c9f0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86359e640 1 -- 172.21.15.62:0/2359668386 reap_dead start 2023-05-15T16:40:22.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86900f640 1 -- 172.21.15.62:0/2359668386 shutdown_connections 2023-05-15T16:40:22.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86900f640 1 -- 172.21.15.62:0/2359668386 >> 172.21.15.62:0/2359668386 conn(0x7fb8640697b0 msgr2=0x7fb864069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:22.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86900f640 1 -- 172.21.15.62:0/2359668386 shutdown_connections 2023-05-15T16:40:22.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86900f640 1 -- 172.21.15.62:0/2359668386 wait complete. 2023-05-15T16:40:22.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86900f640 1 Processor -- start 2023-05-15T16:40:22.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86900f640 1 -- start start 2023-05-15T16:40:22.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86900f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb84c003f30 0x7fb86406fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:22.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86900f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8640b1ed0 0x7fb8641d2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:22.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86900f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8641d2670 0x7fb864137080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:22.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86900f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb864070380 con 0x7fb8640b1ed0 2023-05-15T16:40:22.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86900f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8641d2b10 con 0x7fb8641d2670 2023-05-15T16:40:22.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86900f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8640a1dd0 con 0x7fb84c003f30 2023-05-15T16:40:22.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8640b1ed0 0x7fb8641d2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:22.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8640b1ed0 0x7fb8641d2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48768/0 (socket says 172.21.15.62:48768) 2023-05-15T16:40:22.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86259c640 1 -- 172.21.15.62:0/1118647448 learned_addr learned my addr 172.21.15.62:0/1118647448 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:22.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86359e640 1 --2- 172.21.15.62:0/1118647448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8641d2670 0x7fb864137080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:22.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb862d9d640 1 --2- 172.21.15.62:0/1118647448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb84c003f30 0x7fb86406fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:22.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86259c640 1 -- 172.21.15.62:0/1118647448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb84c003f30 msgr2=0x7fb86406fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:22.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86259c640 1 --2- 172.21.15.62:0/1118647448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb84c003f30 0x7fb86406fe40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86259c640 1 -- 172.21.15.62:0/1118647448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8641d2670 msgr2=0x7fb864137080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:22.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86259c640 1 --2- 172.21.15.62:0/1118647448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8641d2670 0x7fb864137080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86259c640 1 -- 172.21.15.62:0/1118647448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8640b6c00 con 0x7fb8640b1ed0 2023-05-15T16:40:22.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86259c640 1 --2- 172.21.15.62:0/1118647448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8640b1ed0 0x7fb8641d2130 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb8580b0040 tx=0x7fb84c005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:22.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb84b7fe640 1 -- 172.21.15.62:0/1118647448 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8580a6a80 con 0x7fb8640b1ed0 2023-05-15T16:40:22.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb84b7fe640 1 -- 172.21.15.62:0/1118647448 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8580a6be0 con 0x7fb8640b1ed0 2023-05-15T16:40:22.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86900f640 1 -- 172.21.15.62:0/1118647448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8640b6920 con 0x7fb8640b1ed0 2023-05-15T16:40:22.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb84b7fe640 1 -- 172.21.15.62:0/1118647448 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb858006040 con 0x7fb8640b1ed0 2023-05-15T16:40:22.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.803+0000 7fb86900f640 1 -- 172.21.15.62:0/1118647448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8640b6ee0 con 0x7fb8640b1ed0 2023-05-15T16:40:22.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.807+0000 7fb86900f640 1 -- 172.21.15.62:0/1118647448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb864067960 con 0x7fb8640b1ed0 2023-05-15T16:40:22.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.807+0000 7fb84b7fe640 1 -- 172.21.15.62:0/1118647448 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fb8580061a0 con 0x7fb8640b1ed0 2023-05-15T16:40:22.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.807+0000 7fb84b7fe640 1 --2- 172.21.15.62:0/1118647448 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb8500653b0 0x7fb850067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:22.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.807+0000 7fb84b7fe640 1 -- 172.21.15.62:0/1118647448 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb8580aa070 con 0x7fb8640b1ed0 2023-05-15T16:40:22.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.807+0000 7fb862d9d640 1 --2- 172.21.15.62:0/1118647448 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb8500653b0 0x7fb850067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:22.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.807+0000 7fb862d9d640 1 --2- 172.21.15.62:0/1118647448 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb8500653b0 0x7fb850067860 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb854005320 tx=0x7fb854009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:22.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.811+0000 7fb84b7fe640 1 -- 172.21.15.62:0/1118647448 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fb8580ef0d0 con 0x7fb8640b1ed0 2023-05-15T16:40:22.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.963+0000 7fb86900f640 1 -- 172.21.15.62:0/1118647448 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb86404dbe0 con 0x7fb8640b1ed0 2023-05-15T16:40:22.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.963+0000 7fb84b7fe640 1 -- 172.21.15.62:0/1118647448 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb8580eecc0 con 0x7fb8640b1ed0 2023-05-15T16:40:22.968 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-05-15T16:40:22.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.967+0000 7fb86900f640 1 -- 172.21.15.62:0/1118647448 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb8500653b0 msgr2=0x7fb850067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:22.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.967+0000 7fb86900f640 1 --2- 172.21.15.62:0/1118647448 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb8500653b0 0x7fb850067860 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb854005320 tx=0x7fb854009040 comp rx=0 tx=0).stop 2023-05-15T16:40:22.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.967+0000 7fb86900f640 1 -- 172.21.15.62:0/1118647448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8640b1ed0 msgr2=0x7fb8641d2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:22.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.967+0000 7fb86900f640 1 --2- 172.21.15.62:0/1118647448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8640b1ed0 0x7fb8641d2130 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb8580b0040 tx=0x7fb84c005800 comp rx=0 tx=0).stop 2023-05-15T16:40:22.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.967+0000 7fb86900f640 1 -- 172.21.15.62:0/1118647448 shutdown_connections 2023-05-15T16:40:22.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.967+0000 7fb86900f640 1 --2- 172.21.15.62:0/1118647448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb8641d2670 0x7fb864137080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.967+0000 7fb86900f640 1 --2- 172.21.15.62:0/1118647448 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb8500653b0 0x7fb850067860 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.967+0000 7fb86900f640 1 --2- 172.21.15.62:0/1118647448 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb8640b1ed0 0x7fb8641d2130 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.967+0000 7fb86900f640 1 --2- 172.21.15.62:0/1118647448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb84c003f30 0x7fb86406fe40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:22.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.967+0000 7fb86900f640 1 -- 172.21.15.62:0/1118647448 >> 172.21.15.62:0/1118647448 conn(0x7fb8640697b0 msgr2=0x7fb8640ba8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:22.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.967+0000 7fb86900f640 1 -- 172.21.15.62:0/1118647448 shutdown_connections 2023-05-15T16:40:22.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:22.967+0000 7fb86900f640 1 -- 172.21.15.62:0/1118647448 wait complete. 2023-05-15T16:40:22.988 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-15T16:40:23.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.107+0000 7fb22a29d640 1 Processor -- start 2023-05-15T16:40:23.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.107+0000 7fb22a29d640 1 -- start start 2023-05-15T16:40:23.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.111+0000 7fb22a29d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb2240b5700 0x7fb224153360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:23.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.111+0000 7fb22a29d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2240b5b80 con 0x7fb224071a90 2023-05-15T16:40:23.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.111+0000 7fb22a29d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2240716b0 con 0x7fb2240b5330 2023-05-15T16:40:23.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.111+0000 7fb22a29d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2240b2280 con 0x7fb2240b5700 2023-05-15T16:40:23.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.111+0000 7fb22883a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb2240b5700 0x7fb224153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:23.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.111+0000 7fb2237fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fb224071a90 0x7fb224144e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58218/0 (socket says 172.21.15.62:58218) 2023-05-15T16:40:23.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.111+0000 7fb22883a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb2240b5700 0x7fb224153360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48772/0 (socket says 172.21.15.62:48772) 2023-05-15T16:40:23.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.111+0000 7fb2237fe640 1 -- 172.21.15.62:0/2563327355 learned_addr learned my addr 172.21.15.62:0/2563327355 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:23.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.111+0000 7fb22883a640 1 -- 172.21.15.62:0/2563327355 >> v1:172.21.15.161:6789/0 conn(0x7fb2240b5330 legacy=0x7fb2240b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:23.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.111+0000 7fb22883a640 1 -- 172.21.15.62:0/2563327355 >> v1:172.21.15.62:6789/0 conn(0x7fb224071a90 legacy=0x7fb224144e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:23.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.111+0000 7fb22883a640 1 -- 172.21.15.62:0/2563327355 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2240afa90 con 0x7fb2240b5700 2023-05-15T16:40:23.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.111+0000 7fb22883a640 1 --2- 172.21.15.62:0/2563327355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2240b5700 0x7fb224153360 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0097c0 tx=0x7fb20c01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87d7bd5caa45691f server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:23.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.111+0000 7fb222ffd640 1 -- 172.21.15.62:0/2563327355 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c0a8930 con 0x7fb2240b5700 2023-05-15T16:40:23.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.111+0000 7fb222ffd640 1 -- 172.21.15.62:0/2563327355 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb20c0a8a90 con 0x7fb2240b5700 2023-05-15T16:40:23.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.111+0000 7fb222ffd640 1 -- 172.21.15.62:0/2563327355 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb20c0a8e20 con 0x7fb2240b5700 2023-05-15T16:40:23.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.111+0000 7fb22a29d640 1 -- 172.21.15.62:0/2563327355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2240b5700 msgr2=0x7fb224153360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:23.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.111+0000 7fb22a29d640 1 --2- 172.21.15.62:0/2563327355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2240b5700 0x7fb224153360 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb20c0097c0 tx=0x7fb20c01ec30 comp rx=0 tx=0).stop 2023-05-15T16:40:23.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.111+0000 7fb22a29d640 1 -- 172.21.15.62:0/2563327355 shutdown_connections 2023-05-15T16:40:23.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.111+0000 7fb22a29d640 1 --2- 172.21.15.62:0/2563327355 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2240b5700 0x7fb224153360 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.111+0000 7fb22a29d640 1 -- 172.21.15.62:0/2563327355 >> 172.21.15.62:0/2563327355 conn(0x7fb2240653f0 msgr2=0x7fb2240697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:23.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb22a29d640 1 -- 172.21.15.62:0/2563327355 shutdown_connections 2023-05-15T16:40:23.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb22a29d640 1 -- 172.21.15.62:0/2563327355 wait complete. 2023-05-15T16:40:23.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb22a29d640 1 Processor -- start 2023-05-15T16:40:23.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb22a29d640 1 -- start start 2023-05-15T16:40:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb22a29d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb224071a90 0x7fb22414a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb22a29d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2240b5330 0x7fb22406e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb22a29d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2240b5700 0x7fb22406ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb22a29d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240705c0 con 0x7fb224071a90 2023-05-15T16:40:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb22a29d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2241ddaa0 con 0x7fb2240b5700 2023-05-15T16:40:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb22a29d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22413aa00 con 0x7fb2240b5330 2023-05-15T16:40:23.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb223fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb224071a90 0x7fb22414a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb223fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb224071a90 0x7fb22414a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48776/0 (socket says 172.21.15.62:48776) 2023-05-15T16:40:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb223fff640 1 -- 172.21.15.62:0/976904653 learned_addr learned my addr 172.21.15.62:0/976904653 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb2237fe640 1 --2- 172.21.15.62:0/976904653 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2240b5330 0x7fb22406e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb22883a640 1 --2- 172.21.15.62:0/976904653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2240b5700 0x7fb22406ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb223fff640 1 -- 172.21.15.62:0/976904653 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2240b5330 msgr2=0x7fb22406e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb223fff640 1 --2- 172.21.15.62:0/976904653 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2240b5330 0x7fb22406e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb223fff640 1 -- 172.21.15.62:0/976904653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2240b5700 msgr2=0x7fb22406ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:23.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb223fff640 1 --2- 172.21.15.62:0/976904653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2240b5700 0x7fb22406ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb223fff640 1 -- 172.21.15.62:0/976904653 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb20c009420 con 0x7fb224071a90 2023-05-15T16:40:23.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb223fff640 1 --2- 172.21.15.62:0/976904653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb224071a90 0x7fb22414a110 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00c7c0 tx=0x7fb21c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:23.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb220ff9640 1 -- 172.21.15.62:0/976904653 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c00aa50 con 0x7fb224071a90 2023-05-15T16:40:23.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb220ff9640 1 -- 172.21.15.62:0/976904653 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21c00abb0 con 0x7fb224071a90 2023-05-15T16:40:23.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb22a29d640 1 -- 172.21.15.62:0/976904653 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2240af7b0 con 0x7fb224071a90 2023-05-15T16:40:23.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb220ff9640 1 -- 172.21.15.62:0/976904653 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c012420 con 0x7fb224071a90 2023-05-15T16:40:23.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb22a29d640 1 -- 172.21.15.62:0/976904653 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2240b0f00 con 0x7fb224071a90 2023-05-15T16:40:23.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.115+0000 7fb22a29d640 1 -- 172.21.15.62:0/976904653 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2240b11a0 con 0x7fb224071a90 2023-05-15T16:40:23.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.119+0000 7fb220ff9640 1 -- 172.21.15.62:0/976904653 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fb21c012580 con 0x7fb224071a90 2023-05-15T16:40:23.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.119+0000 7fb220ff9640 1 --2- 172.21.15.62:0/976904653 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb2080653b0 0x7fb208067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:23.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.119+0000 7fb220ff9640 1 -- 172.21.15.62:0/976904653 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb21c082a80 con 0x7fb224071a90 2023-05-15T16:40:23.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.119+0000 7fb2237fe640 1 --2- 172.21.15.62:0/976904653 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb2080653b0 0x7fb208067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:23.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.119+0000 7fb2237fe640 1 --2- 172.21.15.62:0/976904653 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb2080653b0 0x7fb208067860 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb2240ba470 tx=0x7fb214009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:23.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.123+0000 7fb220ff9640 1 -- 172.21.15.62:0/976904653 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fb21c050700 con 0x7fb224071a90 2023-05-15T16:40:23.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.275+0000 7fb22a29d640 1 -- 172.21.15.62:0/976904653 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb22404dbe0 con 0x7fb224071a90 2023-05-15T16:40:23.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.279+0000 7fb220ff9640 1 -- 172.21.15.62:0/976904653 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17811 (secure 0 0 0) 0x7fb21c016090 con 0x7fb224071a90 2023-05-15T16:40:23.284 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:23.285 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:40:02.088078+0000","last_up_change":"2023-05-15T16:39:48.597049+0000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-15T16:39:49.394028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-15T16:39:55.208679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-15T16:39:59.547414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-15T16:40:00.055526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37594},{"type":"v1","addr":"172.21.15.62:6825","nonce":37594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37594},{"type":"v1","addr":"172.21.15.62:6827","nonce":37594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37594},{"type":"v1","addr":"172.21.15.62:6831","nonce":37594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37594},{"type":"v1","addr":"172.21.15.62:6829","nonce":37594}]},"public_addr":"172.21.15.62:6825/37594","cluster_addr":"172.21.15.62:6827/37594","heartbeat_back_addr":"172.21.15.62:6831/37594","heartbeat_front_addr":"172.21.15.62:6829/37594","state":["exists","up"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37592},{"type":"v1","addr":"172.21.15.62:6808","nonce":37592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":37592},{"type":"v1","addr":"172.21.15.62:6814","nonce":37592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6821","nonce":37592},{"type":"v1","addr":"172.21.15.62:6823","nonce":37592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37592},{"type":"v1","addr":"172.21.15.62:6818","nonce":37592}]},"public_addr":"172.21.15.62:6808/37592","cluster_addr":"172.21.15.62:6814/37592","heartbeat_back_addr":"172.21.15.62:6823/37592","heartbeat_front_addr":"172.21.15.62:6818/37592","state":["exists","up"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":37591},{"type":"v1","addr":"172.21.15.62:6810","nonce":37591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":37591},{"type":"v1","addr":"172.21.15.62:6815","nonce":37591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37591},{"type":"v1","addr":"172.21.15.62:6822","nonce":37591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":37591},{"type":"v1","addr":"172.21.15.62:6819","nonce":37591}]},"public_addr":"172.21.15.62:6810/37591","cluster_addr":"172.21.15.62:6815/37591","heartbeat_back_addr":"172.21.15.62:6822/37591","heartbeat_front_addr":"172.21.15.62:6819/37591","state":["exists","up"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37593},{"type":"v1","addr":"172.21.15.62:6801","nonce":37593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37593},{"type":"v1","addr":"172.21.15.62:6803","nonce":37593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":37593},{"type":"v1","addr":"172.21.15.62:6812","nonce":37593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37593},{"type":"v1","addr":"172.21.15.62:6805","nonce":37593}]},"public_addr":"172.21.15.62:6801/37593","cluster_addr":"172.21.15.62:6803/37593","heartbeat_back_addr":"172.21.15.62:6812/37593","heartbeat_front_addr":"172.21.15.62:6805/37593","state":["exists","up"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37854},{"type":"v1","addr":"172.21.15.161:6801","nonce":37854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37854},{"type":"v1","addr":"172.21.15.161:6803","nonce":37854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37854},{"type":"v1","addr":"172.21.15.161:6807","nonce":37854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37854},{"type":"v1","addr":"172.21.15.161:6805","nonce":37854}]},"public_addr":"172.21.15.161:6801/37854","cluster_addr":"172.21.15.161:6803/37854","heartbeat_back_addr":"172.21.15.161:6807/37854","heartbeat_front_addr":"172.21.15.161:6805/37854","state":["exists","up"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37855},{"type":"v1","addr":"172.21.15.161:6810","nonce":37855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37855},{"type":"v1","addr":"172.21.15.161:6815","nonce":37855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37855},{"type":"v1","addr":"172.21.15.161:6824","nonce":37855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37855},{"type":"v1","addr":"172.21.15.161:6820","nonce":37855}]},"public_addr":"172.21.15.161:6810/37855","cluster_addr":"172.21.15.161:6815/37855","heartbeat_back_addr":"172.21.15.161:6824/37855","heartbeat_front_addr":"172.21.15.161:6820/37855","state":["exists","up"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":37856},{"type":"v1","addr":"172.21.15.161:6814","nonce":37856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37856},{"type":"v1","addr":"172.21.15.161:6819","nonce":37856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":37856},{"type":"v1","addr":"172.21.15.161:6830","nonce":37856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37856},{"type":"v1","addr":"172.21.15.161:6826","nonce":37856}]},"public_addr":"172.21.15.161:6814/37856","cluster_addr":"172.21.15.161:6819/37856","heartbeat_back_addr":"172.21.15.161:6830/37856","heartbeat_front_addr":"172.21.15.161:6826/37856","state":["exists","up"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":37857},{"type":"v1","addr":"172.21.15.161:6813","nonce":37857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":37857},{"type":"v1","addr":"172.21.15.161:6821","nonce":37857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":37857},{"type":"v1","addr":"172.21.15.161:6831","nonce":37857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":37857},{"type":"v1","addr":"172.21.15.161:6827","nonce":37857}]},"public_addr":"172.21.15.161:6813/37857","cluster_addr":"172.21.15.161:6821/37857","heartbeat_back_addr":"172.21.15.161:6831/37857","heartbeat_front_addr":"172.21.15.161:6827/37857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.592907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.618143+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.641533+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.614355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.579293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.718353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.730135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.792887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:40:23.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.283+0000 7fb22a29d640 1 -- 172.21.15.62:0/976904653 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb2080653b0 msgr2=0x7fb208067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:23.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.283+0000 7fb22a29d640 1 --2- 172.21.15.62:0/976904653 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb2080653b0 0x7fb208067860 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb2240ba470 tx=0x7fb214009040 comp rx=0 tx=0).stop 2023-05-15T16:40:23.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.283+0000 7fb22a29d640 1 -- 172.21.15.62:0/976904653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb224071a90 msgr2=0x7fb22414a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:23.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.283+0000 7fb22a29d640 1 --2- 172.21.15.62:0/976904653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb224071a90 0x7fb22414a110 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00c7c0 tx=0x7fb21c00cc80 comp rx=0 tx=0).stop 2023-05-15T16:40:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.283+0000 7fb22a29d640 1 -- 172.21.15.62:0/976904653 shutdown_connections 2023-05-15T16:40:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.283+0000 7fb22a29d640 1 --2- 172.21.15.62:0/976904653 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2240b5700 0x7fb22406ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.283+0000 7fb22a29d640 1 --2- 172.21.15.62:0/976904653 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2240b5330 0x7fb22406e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.283+0000 7fb22a29d640 1 --2- 172.21.15.62:0/976904653 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb2080653b0 0x7fb208067860 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.283+0000 7fb22a29d640 1 --2- 172.21.15.62:0/976904653 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb224071a90 0x7fb22414a110 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.283+0000 7fb22a29d640 1 -- 172.21.15.62:0/976904653 >> 172.21.15.62:0/976904653 conn(0x7fb2240653f0 msgr2=0x7fb2240b16c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.283+0000 7fb22a29d640 1 -- 172.21.15.62:0/976904653 shutdown_connections 2023-05-15T16:40:23.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.283+0000 7fb22a29d640 1 -- 172.21.15.62:0/976904653 wait complete. 2023-05-15T16:40:23.303 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-15T16:39:49.394028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-15T16:39:55.208679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-15T16:39:59.547414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-15T16:40:00.055526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-15T16:40:23.304 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-15T16:40:23.433 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.431+0000 7f61ffd13640 1 Processor -- start 2023-05-15T16:40:23.434 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.431+0000 7f61ffd13640 1 -- start start 2023-05-15T16:40:23.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.431+0000 7f61ffd13640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61f80b7910 0x7f61f80b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:23.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.431+0000 7f61ffd13640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f61f80b5e70 0x7f61f8144170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:23.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.431+0000 7f61ffd13640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f61f80b86a0 0x7f61f80b8b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:23.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.431+0000 7f61ffd13640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f80b5a50 con 0x7f61f80b86a0 2023-05-15T16:40:23.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.431+0000 7f61ffd13640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f80b1610 con 0x7f61f80b5e70 2023-05-15T16:40:23.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.431+0000 7f61ffd13640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f80b3220 con 0x7f61f80b7910 2023-05-15T16:40:23.435 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.431+0000 7f61fe2b0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f61f80b86a0 0x7f61f80b8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:23.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.431+0000 7f61fe2b0640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f61f80b86a0 0x7f61f80b8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48788/0 (socket says 172.21.15.62:48788) 2023-05-15T16:40:23.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.431+0000 7f61fe2b0640 1 -- 172.21.15.62:0/2690825099 learned_addr learned my addr 172.21.15.62:0/2690825099 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:23.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.431+0000 7f61fdaaf640 1 --2- 172.21.15.62:0/2690825099 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61f80b7910 0x7f61f80b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:23.436 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.431+0000 7f61fd2ae640 1 --2- 172.21.15.62:0/2690825099 >> v2:172.21.15.161:3300/0 conn(0x7f61f80b5e70 0x7f61f8144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:23.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.431+0000 7f61fe2b0640 1 -- 172.21.15.62:0/2690825099 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61f80b7910 msgr2=0x7f61f80b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:23.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.431+0000 7f61fe2b0640 1 --2- 172.21.15.62:0/2690825099 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61f80b7910 0x7f61f80b4b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.431+0000 7f61fe2b0640 1 -- 172.21.15.62:0/2690825099 >> v2:172.21.15.161:3300/0 conn(0x7f61f80b5e70 msgr2=0x7f61f8144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:23.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.431+0000 7f61fe2b0640 1 --2- 172.21.15.62:0/2690825099 >> v2:172.21.15.161:3300/0 conn(0x7f61f80b5e70 0x7f61f8144170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.431+0000 7f61fe2b0640 1 -- 172.21.15.62:0/2690825099 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f80b4710 con 0x7f61f80b86a0 2023-05-15T16:40:23.437 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.431+0000 7f61fd2ae640 1 --2- 172.21.15.62:0/2690825099 >> v2:172.21.15.161:3300/0 conn(0x7f61f80b5e70 0x7f61f8144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-15T16:40:23.438 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.435+0000 7f61fe2b0640 1 --2- 172.21.15.62:0/2690825099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f80b86a0 0x7f61f80b8b40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f61f80b9770 tx=0x7f61f001f1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221139762962a45a server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:23.439 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.435+0000 7f61fcaad640 1 -- 172.21.15.62:0/2690825099 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f00af400 con 0x7f61f80b86a0 2023-05-15T16:40:23.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.435+0000 7f61fcaad640 1 -- 172.21.15.62:0/2690825099 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f00ab050 con 0x7f61f80b86a0 2023-05-15T16:40:23.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.435+0000 7f61fcaad640 1 -- 172.21.15.62:0/2690825099 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f00af780 con 0x7f61f80b86a0 2023-05-15T16:40:23.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.435+0000 7f61ffd13640 1 -- 172.21.15.62:0/2690825099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f80b86a0 msgr2=0x7f61f80b8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:23.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.435+0000 7f61ffd13640 1 --2- 172.21.15.62:0/2690825099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f80b86a0 0x7f61f80b8b40 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f61f80b9770 tx=0x7f61f001f1c0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.440 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.435+0000 7f61ffd13640 1 -- 172.21.15.62:0/2690825099 shutdown_connections 2023-05-15T16:40:23.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.435+0000 7f61ffd13640 1 --2- 172.21.15.62:0/2690825099 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f80b86a0 0x7f61f80b8b40 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.435+0000 7f61ffd13640 1 --2- 172.21.15.62:0/2690825099 >> v2:172.21.15.161:3300/0 conn(0x7f61f80b5e70 0x7f61f8144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.435+0000 7f61ffd13640 1 --2- 172.21.15.62:0/2690825099 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61f80b7910 0x7f61f80b4b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.435+0000 7f61ffd13640 1 -- 172.21.15.62:0/2690825099 >> 172.21.15.62:0/2690825099 conn(0x7f61f80697b0 msgr2=0x7f61f8069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:23.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.435+0000 7f61ffd13640 1 -- 172.21.15.62:0/2690825099 shutdown_connections 2023-05-15T16:40:23.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.435+0000 7f61ffd13640 1 -- 172.21.15.62:0/2690825099 wait complete. 2023-05-15T16:40:23.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.435+0000 7f61ffd13640 1 Processor -- start 2023-05-15T16:40:23.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.435+0000 7f61ffd13640 1 -- start start 2023-05-15T16:40:23.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61ffd13640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61f80b5e70 0x7f61f81dff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:23.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61ffd13640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61f80b7910 0x7f61f81d4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:23.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61ffd13640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f80b86a0 0x7f61f81d3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:23.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61ffd13640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f8070c20 con 0x7f61f80b86a0 2023-05-15T16:40:23.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61ffd13640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f81d4e60 con 0x7f61f80b5e70 2023-05-15T16:40:23.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61ffd13640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f81e0f10 con 0x7f61f80b7910 2023-05-15T16:40:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61fe2b0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f80b86a0 0x7f61f81d3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61fe2b0640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f80b86a0 0x7f61f81d3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48792/0 (socket says 172.21.15.62:48792) 2023-05-15T16:40:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61fe2b0640 1 -- 172.21.15.62:0/1312413010 learned_addr learned my addr 172.21.15.62:0/1312413010 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61fd2ae640 1 --2- 172.21.15.62:0/1312413010 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61f80b7910 0x7f61f81d4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61fdaaf640 1 --2- 172.21.15.62:0/1312413010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61f80b5e70 0x7f61f81dff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61fe2b0640 1 -- 172.21.15.62:0/1312413010 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61f80b7910 msgr2=0x7f61f81d4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61fe2b0640 1 --2- 172.21.15.62:0/1312413010 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61f80b7910 0x7f61f81d4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61fe2b0640 1 -- 172.21.15.62:0/1312413010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61f80b5e70 msgr2=0x7f61f81dff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:23.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61fe2b0640 1 --2- 172.21.15.62:0/1312413010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61f80b5e70 0x7f61f81dff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61fe2b0640 1 -- 172.21.15.62:0/1312413010 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f0009b30 con 0x7f61f80b86a0 2023-05-15T16:40:23.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61fd2ae640 1 --2- 172.21.15.62:0/1312413010 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61f80b7910 0x7f61f81d4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:23.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61fdaaf640 1 --2- 172.21.15.62:0/1312413010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61f80b5e70 0x7f61f81dff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:23.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61fe2b0640 1 --2- 172.21.15.62:0/1312413010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f80b86a0 0x7f61f81d3b40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f61f00b2040 tx=0x7f61f001bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:23.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61ee7fc640 1 -- 172.21.15.62:0/1312413010 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f00afd30 con 0x7f61f80b86a0 2023-05-15T16:40:23.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61ee7fc640 1 -- 172.21.15.62:0/1312413010 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f00afe90 con 0x7f61f80b86a0 2023-05-15T16:40:23.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61ee7fc640 1 -- 172.21.15.62:0/1312413010 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f00ba680 con 0x7f61f80b86a0 2023-05-15T16:40:23.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61ffd13640 1 -- 172.21.15.62:0/1312413010 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f80b2a90 con 0x7f61f80b86a0 2023-05-15T16:40:23.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61ffd13640 1 -- 172.21.15.62:0/1312413010 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f80b34c0 con 0x7f61f80b86a0 2023-05-15T16:40:23.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61ffd13640 1 -- 172.21.15.62:0/1312413010 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f80b2cf0 con 0x7f61f80b86a0 2023-05-15T16:40:23.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61ee7fc640 1 -- 172.21.15.62:0/1312413010 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f61f00b6040 con 0x7f61f80b86a0 2023-05-15T16:40:23.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61ee7fc640 1 --2- 172.21.15.62:0/1312413010 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f61dc065380 0x7f61dc067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:23.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.439+0000 7f61ee7fc640 1 -- 172.21.15.62:0/1312413010 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f61f0120970 con 0x7f61f80b86a0 2023-05-15T16:40:23.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.443+0000 7f61fdaaf640 1 --2- 172.21.15.62:0/1312413010 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f61dc065380 0x7f61dc067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:23.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.443+0000 7f61fdaaf640 1 --2- 172.21.15.62:0/1312413010 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f61dc065380 0x7f61dc067830 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009ae0 tx=0x7f61f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:23.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.443+0000 7f61ee7fc640 1 -- 172.21.15.62:0/1312413010 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f61f00ee6b0 con 0x7f61f80b86a0 2023-05-15T16:40:23.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.603+0000 7f61ffd13640 1 -- 172.21.15.62:0/1312413010 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f61f8067960 con 0x7f61f80b86a0 2023-05-15T16:40:23.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.603+0000 7f61ee7fc640 1 -- 172.21.15.62:0/1312413010 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f61f0009510 con 0x7f61f80b86a0 2023-05-15T16:40:23.608 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-05-15T16:40:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.607+0000 7f61ffd13640 1 -- 172.21.15.62:0/1312413010 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f61dc065380 msgr2=0x7f61dc067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:23.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.607+0000 7f61ffd13640 1 --2- 172.21.15.62:0/1312413010 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f61dc065380 0x7f61dc067830 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f61f4009ae0 tx=0x7f61f4008040 comp rx=0 tx=0).stop 2023-05-15T16:40:23.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.607+0000 7f61ffd13640 1 -- 172.21.15.62:0/1312413010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f80b86a0 msgr2=0x7f61f81d3b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:23.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.607+0000 7f61ffd13640 1 --2- 172.21.15.62:0/1312413010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f80b86a0 0x7f61f81d3b40 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f61f00b2040 tx=0x7f61f001bf60 comp rx=0 tx=0).stop 2023-05-15T16:40:23.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.607+0000 7f61ffd13640 1 -- 172.21.15.62:0/1312413010 shutdown_connections 2023-05-15T16:40:23.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.607+0000 7f61ffd13640 1 --2- 172.21.15.62:0/1312413010 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f61dc065380 0x7f61dc067830 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.607+0000 7f61ffd13640 1 --2- 172.21.15.62:0/1312413010 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f61f80b86a0 0x7f61f81d3b40 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.607+0000 7f61ffd13640 1 --2- 172.21.15.62:0/1312413010 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f61f80b7910 0x7f61f81d4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.607+0000 7f61ffd13640 1 --2- 172.21.15.62:0/1312413010 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f61f80b5e70 0x7f61f81dff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.607+0000 7f61ffd13640 1 -- 172.21.15.62:0/1312413010 >> 172.21.15.62:0/1312413010 conn(0x7f61f80697b0 msgr2=0x7f61f8069b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:23.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.607+0000 7f61ffd13640 1 -- 172.21.15.62:0/1312413010 shutdown_connections 2023-05-15T16:40:23.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.607+0000 7f61ffd13640 1 -- 172.21.15.62:0/1312413010 wait complete. 2023-05-15T16:40:23.626 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-15T16:40:23.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.751+0000 7ff6d8ada640 1 Processor -- start 2023-05-15T16:40:23.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.751+0000 7ff6d8ada640 1 -- start start 2023-05-15T16:40:23.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d8ada640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6d40b5e70 0x7ff6d4144170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:23.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d8ada640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7ff6d414f4c0 0x7ff6d41518a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:23.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d8ada640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6d40b5240 con 0x7ff6d40b7910 2023-05-15T16:40:23.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d8ada640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6d40b5a50 con 0x7ff6d414f4c0 2023-05-15T16:40:23.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d8ada640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d40b1610 con 0x7ff6d40b5e70 2023-05-15T16:40:23.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d259c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7ff6d40b7910 0x7ff6d40b4b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58220/0 (socket says 172.21.15.62:58220) 2023-05-15T16:40:23.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d259c640 1 -- 172.21.15.62:0/1492511476 learned_addr learned my addr 172.21.15.62:0/1492511476 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:23.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d2d9d640 1 --2- 172.21.15.62:0/1492511476 >> v2:172.21.15.161:3300/0 conn(0x7ff6d414f4c0 0x7ff6d41518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:23.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d1d9b640 1 --2- 172.21.15.62:0/1492511476 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6d40b5e70 0x7ff6d4144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:23.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d159a640 1 -- 172.21.15.62:0/1492511476 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 919856265 0 0) 0x7ff6d40b5240 con 0x7ff6d40b7910 2023-05-15T16:40:23.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d159a640 1 -- 172.21.15.62:0/1492511476 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff6c0003530 con 0x7ff6d40b7910 2023-05-15T16:40:23.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d159a640 1 -- 172.21.15.62:0/1492511476 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 590972447 0 0) 0x7ff6c0003530 con 0x7ff6d40b7910 2023-05-15T16:40:23.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d159a640 1 -- 172.21.15.62:0/1492511476 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6d40b5e70 msgr2=0x7ff6d4144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:23.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d159a640 1 --2- 172.21.15.62:0/1492511476 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6d40b5e70 0x7ff6d4144170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d159a640 1 -- 172.21.15.62:0/1492511476 >> v2:172.21.15.161:3300/0 conn(0x7ff6d414f4c0 msgr2=0x7ff6d41518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:23.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d159a640 1 --2- 172.21.15.62:0/1492511476 >> v2:172.21.15.161:3300/0 conn(0x7ff6d414f4c0 0x7ff6d41518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d159a640 1 -- 172.21.15.62:0/1492511476 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d40b3220 con 0x7ff6d40b7910 2023-05-15T16:40:23.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d159a640 1 -- 172.21.15.62:0/1492511476 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7ff6bc001680 con 0x7ff6d40b7910 2023-05-15T16:40:23.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d159a640 1 -- 172.21.15.62:0/1492511476 >> v1:172.21.15.62:6789/0 conn(0x7ff6d40b7910 legacy=0x7ff6d40b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:23.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d159a640 1 --2- 172.21.15.62:0/1492511476 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6d40b5e70 0x7ff6c00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:23.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d159a640 1 --2- 172.21.15.62:0/1492511476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6c0003f80 0x7ff6c00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:23.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d159a640 1 --2- 172.21.15.62:0/1492511476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6c0004d10 0x7ff6c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:23.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d159a640 1 -- 172.21.15.62:0/1492511476 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d40b5a50 con 0x7ff6c0003f80 2023-05-15T16:40:23.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d159a640 1 -- 172.21.15.62:0/1492511476 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d40b1610 con 0x7ff6c0004d10 2023-05-15T16:40:23.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d159a640 1 -- 172.21.15.62:0/1492511476 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c000ba40 con 0x7ff6d40b5e70 2023-05-15T16:40:23.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d1d9b640 1 --2- 172.21.15.62:0/1492511476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6c0003f80 0x7ff6c00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:23.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d259c640 1 --2- 172.21.15.62:0/1492511476 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6d40b5e70 0x7ff6c00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:23.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d2d9d640 1 --2- 172.21.15.62:0/1492511476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6c0004d10 0x7ff6c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:23.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d1d9b640 1 -- 172.21.15.62:0/1492511476 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6d40b5e70 msgr2=0x7ff6c00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:23.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d1d9b640 1 --2- 172.21.15.62:0/1492511476 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6d40b5e70 0x7ff6c00039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d1d9b640 1 -- 172.21.15.62:0/1492511476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6c0004d10 msgr2=0x7ff6c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:23.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d1d9b640 1 --2- 172.21.15.62:0/1492511476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6c0004d10 0x7ff6c0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d1d9b640 1 -- 172.21.15.62:0/1492511476 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c0003530 con 0x7ff6c0003f80 2023-05-15T16:40:23.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.755+0000 7ff6d2d9d640 1 --2- 172.21.15.62:0/1492511476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6c0004d10 0x7ff6c0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:23.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d1d9b640 1 --2- 172.21.15.62:0/1492511476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6c0003f80 0x7ff6c00047d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009ab0 tx=0x7ff6c401ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50023cd645c8b22c server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:23.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d159a640 1 -- 172.21.15.62:0/1492511476 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c40a5620 con 0x7ff6c0003f80 2023-05-15T16:40:23.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d159a640 1 -- 172.21.15.62:0/1492511476 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6c40a5780 con 0x7ff6c0003f80 2023-05-15T16:40:23.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d159a640 1 -- 172.21.15.62:0/1492511476 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6c40a5b30 con 0x7ff6c0003f80 2023-05-15T16:40:23.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d8ada640 1 -- 172.21.15.62:0/1492511476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6c0003f80 msgr2=0x7ff6c00047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:23.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d8ada640 1 --2- 172.21.15.62:0/1492511476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6c0003f80 0x7ff6c00047d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7ff6c4009ab0 tx=0x7ff6c401ca30 comp rx=0 tx=0).stop 2023-05-15T16:40:23.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d2d9d640 1 -- 172.21.15.62:0/1492511476 reap_dead start 2023-05-15T16:40:23.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d8ada640 1 -- 172.21.15.62:0/1492511476 shutdown_connections 2023-05-15T16:40:23.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d8ada640 1 -- 172.21.15.62:0/1492511476 >> 172.21.15.62:0/1492511476 conn(0x7ff6d40697b0 msgr2=0x7ff6d4069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:23.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d8ada640 1 -- 172.21.15.62:0/1492511476 shutdown_connections 2023-05-15T16:40:23.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d8ada640 1 -- 172.21.15.62:0/1492511476 wait complete. 2023-05-15T16:40:23.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d8ada640 1 Processor -- start 2023-05-15T16:40:23.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d8ada640 1 -- start start 2023-05-15T16:40:23.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d8ada640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6c0003f80 0x7ff6d40b6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:23.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d8ada640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6d4146910 0x7ff6d41df280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:23.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d8ada640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6d414a3b0 0x7ff6d414a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:23.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d8ada640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d40b6d40 con 0x7ff6c0003f80 2023-05-15T16:40:23.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d8ada640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d41e27d0 con 0x7ff6d414a3b0 2023-05-15T16:40:23.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d8ada640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6d41e2a20 con 0x7ff6d4146910 2023-05-15T16:40:23.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6c0003f80 0x7ff6d40b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:23.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d259c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6c0003f80 0x7ff6d40b6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48806/0 (socket says 172.21.15.62:48806) 2023-05-15T16:40:23.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d259c640 1 -- 172.21.15.62:0/1985859724 learned_addr learned my addr 172.21.15.62:0/1985859724 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d1d9b640 1 --2- 172.21.15.62:0/1985859724 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6d4146910 0x7ff6d41df280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d2d9d640 1 --2- 172.21.15.62:0/1985859724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6d414a3b0 0x7ff6d414a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d259c640 1 -- 172.21.15.62:0/1985859724 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6d4146910 msgr2=0x7ff6d41df280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d259c640 1 --2- 172.21.15.62:0/1985859724 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6d4146910 0x7ff6d41df280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d259c640 1 -- 172.21.15.62:0/1985859724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6d414a3b0 msgr2=0x7ff6d414a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d259c640 1 --2- 172.21.15.62:0/1985859724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6d414a3b0 0x7ff6d414a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d259c640 1 -- 172.21.15.62:0/1985859724 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d40b34c0 con 0x7ff6c0003f80 2023-05-15T16:40:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d2d9d640 1 --2- 172.21.15.62:0/1985859724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6d414a3b0 0x7ff6d414a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.759+0000 7ff6d259c640 1 --2- 172.21.15.62:0/1985859724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6c0003f80 0x7ff6d40b6800 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc00e590 tx=0x7ff6bc00ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.763+0000 7ff6caffd640 1 -- 172.21.15.62:0/1985859724 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc012650 con 0x7ff6c0003f80 2023-05-15T16:40:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.763+0000 7ff6caffd640 1 -- 172.21.15.62:0/1985859724 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc0127d0 con 0x7ff6c0003f80 2023-05-15T16:40:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.763+0000 7ff6d8ada640 1 -- 172.21.15.62:0/1985859724 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6d40b4710 con 0x7ff6c0003f80 2023-05-15T16:40:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.763+0000 7ff6caffd640 1 -- 172.21.15.62:0/1985859724 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6bc012b80 con 0x7ff6c0003f80 2023-05-15T16:40:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.763+0000 7ff6d8ada640 1 -- 172.21.15.62:0/1985859724 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6d40b2a90 con 0x7ff6c0003f80 2023-05-15T16:40:23.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.763+0000 7ff6d8ada640 1 -- 172.21.15.62:0/1985859724 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6d4067960 con 0x7ff6c0003f80 2023-05-15T16:40:23.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.763+0000 7ff6caffd640 1 -- 172.21.15.62:0/1985859724 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7ff6bc012ce0 con 0x7ff6c0003f80 2023-05-15T16:40:23.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.763+0000 7ff6caffd640 1 --2- 172.21.15.62:0/1985859724 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff6b4065380 0x7ff6b4067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:23.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.763+0000 7ff6caffd640 1 -- 172.21.15.62:0/1985859724 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7ff6bc082700 con 0x7ff6c0003f80 2023-05-15T16:40:23.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.763+0000 7ff6d1d9b640 1 --2- 172.21.15.62:0/1985859724 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff6b4065380 0x7ff6b4067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:23.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.763+0000 7ff6d1d9b640 1 --2- 172.21.15.62:0/1985859724 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff6b4065380 0x7ff6b4067830 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40af000 tx=0x7ff6c40046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:23.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.767+0000 7ff6caffd640 1 -- 172.21.15.62:0/1985859724 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7ff6bc0502f0 con 0x7ff6c0003f80 2023-05-15T16:40:23.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.919+0000 7ff6d8ada640 1 -- 172.21.15.62:0/1985859724 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff6d404dbe0 con 0x7ff6c0003f80 2023-05-15T16:40:23.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.919+0000 7ff6caffd640 1 -- 172.21.15.62:0/1985859724 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff6bc053910 con 0x7ff6c0003f80 2023-05-15T16:40:23.924 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-05-15T16:40:23.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.923+0000 7ff6d8ada640 1 -- 172.21.15.62:0/1985859724 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff6b4065380 msgr2=0x7ff6b4067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:23.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.923+0000 7ff6d8ada640 1 --2- 172.21.15.62:0/1985859724 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff6b4065380 0x7ff6b4067830 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff6c40af000 tx=0x7ff6c40046d0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.923+0000 7ff6d8ada640 1 -- 172.21.15.62:0/1985859724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6c0003f80 msgr2=0x7ff6d40b6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:23.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.923+0000 7ff6d8ada640 1 --2- 172.21.15.62:0/1985859724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6c0003f80 0x7ff6d40b6800 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7ff6bc00e590 tx=0x7ff6bc00ea50 comp rx=0 tx=0).stop 2023-05-15T16:40:23.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.923+0000 7ff6d8ada640 1 -- 172.21.15.62:0/1985859724 shutdown_connections 2023-05-15T16:40:23.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.923+0000 7ff6d8ada640 1 --2- 172.21.15.62:0/1985859724 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7ff6d414a3b0 0x7ff6d414a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.923+0000 7ff6d8ada640 1 --2- 172.21.15.62:0/1985859724 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7ff6d4146910 0x7ff6d41df280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.923+0000 7ff6d8ada640 1 --2- 172.21.15.62:0/1985859724 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7ff6b4065380 0x7ff6b4067830 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.923+0000 7ff6d8ada640 1 --2- 172.21.15.62:0/1985859724 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7ff6c0003f80 0x7ff6d40b6800 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:23.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.923+0000 7ff6d8ada640 1 -- 172.21.15.62:0/1985859724 >> 172.21.15.62:0/1985859724 conn(0x7ff6d40697b0 msgr2=0x7ff6d4147380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:23.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.923+0000 7ff6d8ada640 1 -- 172.21.15.62:0/1985859724 shutdown_connections 2023-05-15T16:40:23.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:23.923+0000 7ff6d8ada640 1 -- 172.21.15.62:0/1985859724 wait complete. 2023-05-15T16:40:23.942 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-15T16:40:24.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.059+0000 7f5524088640 1 Processor -- start 2023-05-15T16:40:24.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.059+0000 7f5524088640 1 -- start start 2023-05-15T16:40:24.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.059+0000 7f5524088640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f551c0b1fc0 0x7f551c1556f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:24.063 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.059+0000 7f5524088640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551c0b0b70 con 0x7f551c0b1bf0 2023-05-15T16:40:24.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.059+0000 7f5524088640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f551c14adc0 con 0x7f551c0b3080 2023-05-15T16:40:24.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.059+0000 7f5524088640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f551c0b2d50 con 0x7f551c0b1fc0 2023-05-15T16:40:24.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.059+0000 7f5522625640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f551c0b1fc0 0x7f551c1556f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:24.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.059+0000 7f5522625640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f551c0b1fc0 0x7f551c1556f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48812/0 (socket says 172.21.15.62:48812) 2023-05-15T16:40:24.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.059+0000 7f5521e24640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f551c0b1bf0 0x7f551c14a6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58234/0 (socket says 172.21.15.62:58234) 2023-05-15T16:40:24.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.059+0000 7f5522625640 1 -- 172.21.15.62:0/1249580578 learned_addr learned my addr 172.21.15.62:0/1249580578 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:24.064 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.059+0000 7f5522625640 1 -- 172.21.15.62:0/1249580578 >> v1:172.21.15.161:6789/0 conn(0x7f551c0b3080 legacy=0x7f551c147110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:24.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.059+0000 7f5522625640 1 -- 172.21.15.62:0/1249580578 >> v1:172.21.15.62:6789/0 conn(0x7f551c0b1bf0 legacy=0x7f551c14a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:24.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.059+0000 7f5522625640 1 -- 172.21.15.62:0/1249580578 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f551c0b0dc0 con 0x7f551c0b1fc0 2023-05-15T16:40:24.065 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5522625640 1 --2- 172.21.15.62:0/1249580578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f551c0b1fc0 0x7f551c1556f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5514009e50 tx=0x7f551401c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29fad5837dfde08 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:24.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5520e22640 1 -- 172.21.15.62:0/1249580578 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55140a57d0 con 0x7f551c0b1fc0 2023-05-15T16:40:24.066 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5520e22640 1 -- 172.21.15.62:0/1249580578 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55140a5930 con 0x7f551c0b1fc0 2023-05-15T16:40:24.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5520e22640 1 -- 172.21.15.62:0/1249580578 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55140a5cc0 con 0x7f551c0b1fc0 2023-05-15T16:40:24.067 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5524088640 1 -- 172.21.15.62:0/1249580578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f551c0b1fc0 msgr2=0x7f551c1556f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:24.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5524088640 1 --2- 172.21.15.62:0/1249580578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f551c0b1fc0 0x7f551c1556f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f5514009e50 tx=0x7f551401c910 comp rx=0 tx=0).stop 2023-05-15T16:40:24.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5524088640 1 -- 172.21.15.62:0/1249580578 shutdown_connections 2023-05-15T16:40:24.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5524088640 1 --2- 172.21.15.62:0/1249580578 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f551c0b1fc0 0x7f551c1556f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5524088640 1 -- 172.21.15.62:0/1249580578 >> 172.21.15.62:0/1249580578 conn(0x7f551c0697b0 msgr2=0x7f551c069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:24.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5524088640 1 -- 172.21.15.62:0/1249580578 shutdown_connections 2023-05-15T16:40:24.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5524088640 1 -- 172.21.15.62:0/1249580578 wait complete. 2023-05-15T16:40:24.068 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5524088640 1 Processor -- start 2023-05-15T16:40:24.069 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5524088640 1 -- start start 2023-05-15T16:40:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5524088640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f551c0b1bf0 0x7f551c070a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5524088640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f551c0b1fc0 0x7f551c06e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5524088640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f551c0b3080 0x7f551c06f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5524088640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551c06eb00 con 0x7f551c0b3080 2023-05-15T16:40:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5524088640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f551c06ed70 con 0x7f551c0b1fc0 2023-05-15T16:40:24.071 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5524088640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f551c0710f0 con 0x7f551c0b1bf0 2023-05-15T16:40:24.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5522625640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f551c0b3080 0x7f551c06f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:24.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5522625640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f551c0b3080 0x7f551c06f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48826/0 (socket says 172.21.15.62:48826) 2023-05-15T16:40:24.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5522625640 1 -- 172.21.15.62:0/1010002875 learned_addr learned my addr 172.21.15.62:0/1010002875 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:24.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5521623640 1 --2- 172.21.15.62:0/1010002875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f551c0b1fc0 0x7f551c06e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:24.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5521e24640 1 --2- 172.21.15.62:0/1010002875 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f551c0b1bf0 0x7f551c070a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:24.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5522625640 1 -- 172.21.15.62:0/1010002875 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f551c0b1bf0 msgr2=0x7f551c070a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:24.072 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5522625640 1 --2- 172.21.15.62:0/1010002875 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f551c0b1bf0 0x7f551c070a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5522625640 1 -- 172.21.15.62:0/1010002875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f551c0b1fc0 msgr2=0x7f551c06e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:24.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5522625640 1 --2- 172.21.15.62:0/1010002875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f551c0b1fc0 0x7f551c06e5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5522625640 1 -- 172.21.15.62:0/1010002875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5514009b30 con 0x7f551c0b3080 2023-05-15T16:40:24.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5521623640 1 --2- 172.21.15.62:0/1010002875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f551c0b1fc0 0x7f551c06e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:24.073 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.063+0000 7f5521e24640 1 --2- 172.21.15.62:0/1010002875 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f551c0b1bf0 0x7f551c070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:24.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.067+0000 7f5522625640 1 --2- 172.21.15.62:0/1010002875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f551c0b3080 0x7f551c06f4e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5514019520 tx=0x7f55140196b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:24.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.067+0000 7f55127fc640 1 -- 172.21.15.62:0/1010002875 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55140b8670 con 0x7f551c0b3080 2023-05-15T16:40:24.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.067+0000 7f55127fc640 1 -- 172.21.15.62:0/1010002875 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55140b87d0 con 0x7f551c0b3080 2023-05-15T16:40:24.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.067+0000 7f5524088640 1 -- 172.21.15.62:0/1010002875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f551c0b2400 con 0x7f551c0b3080 2023-05-15T16:40:24.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.067+0000 7f55127fc640 1 -- 172.21.15.62:0/1010002875 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55140b8b80 con 0x7f551c0b3080 2023-05-15T16:40:24.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.067+0000 7f5524088640 1 -- 172.21.15.62:0/1010002875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f551c147820 con 0x7f551c0b3080 2023-05-15T16:40:24.074 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.067+0000 7f5524088640 1 -- 172.21.15.62:0/1010002875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f551c067960 con 0x7f551c0b3080 2023-05-15T16:40:24.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.067+0000 7f55127fc640 1 -- 172.21.15.62:0/1010002875 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f55140b8ce0 con 0x7f551c0b3080 2023-05-15T16:40:24.075 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.067+0000 7f55127fc640 1 --2- 172.21.15.62:0/1010002875 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5500065380 0x7f5500067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:24.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.067+0000 7f55127fc640 1 -- 172.21.15.62:0/1010002875 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f551411de90 con 0x7f551c0b3080 2023-05-15T16:40:24.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.067+0000 7f5521e24640 1 --2- 172.21.15.62:0/1010002875 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5500065380 0x7f5500067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:24.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.067+0000 7f5521e24640 1 --2- 172.21.15.62:0/1010002875 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5500065380 0x7f5500067830 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f550c000f70 tx=0x7f550c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:24.076 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.071+0000 7f55127fc640 1 -- 172.21.15.62:0/1010002875 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f55140ef690 con 0x7f551c0b3080 2023-05-15T16:40:24.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.223+0000 7f5524088640 1 -- 172.21.15.62:0/1010002875 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f551c0bad20 con 0x7f551c0b3080 2023-05-15T16:40:24.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.223+0000 7f55127fc640 1 -- 172.21.15.62:0/1010002875 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f55140ef280 con 0x7f551c0b3080 2023-05-15T16:40:24.229 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-05-15T16:40:24.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.223+0000 7f5524088640 1 -- 172.21.15.62:0/1010002875 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5500065380 msgr2=0x7f5500067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:24.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.223+0000 7f5524088640 1 --2- 172.21.15.62:0/1010002875 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5500065380 0x7f5500067830 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f550c000f70 tx=0x7f550c009040 comp rx=0 tx=0).stop 2023-05-15T16:40:24.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.223+0000 7f5524088640 1 -- 172.21.15.62:0/1010002875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f551c0b3080 msgr2=0x7f551c06f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:24.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.223+0000 7f5524088640 1 --2- 172.21.15.62:0/1010002875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f551c0b3080 0x7f551c06f4e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5514019520 tx=0x7f55140196b0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.227+0000 7f5524088640 1 -- 172.21.15.62:0/1010002875 shutdown_connections 2023-05-15T16:40:24.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.227+0000 7f5524088640 1 --2- 172.21.15.62:0/1010002875 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5500065380 0x7f5500067830 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.227+0000 7f5524088640 1 --2- 172.21.15.62:0/1010002875 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f551c0b3080 0x7f551c06f4e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.227+0000 7f5524088640 1 --2- 172.21.15.62:0/1010002875 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f551c0b1fc0 0x7f551c06e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.227+0000 7f5524088640 1 --2- 172.21.15.62:0/1010002875 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f551c0b1bf0 0x7f551c070a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.227+0000 7f5524088640 1 -- 172.21.15.62:0/1010002875 >> 172.21.15.62:0/1010002875 conn(0x7f551c0697b0 msgr2=0x7f551c0ba610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:24.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.227+0000 7f5524088640 1 -- 172.21.15.62:0/1010002875 shutdown_connections 2023-05-15T16:40:24.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.227+0000 7f5524088640 1 -- 172.21.15.62:0/1010002875 wait complete. 2023-05-15T16:40:24.246 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-15T16:40:24.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.363+0000 7f5f5f38b640 1 Processor -- start 2023-05-15T16:40:24.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.363+0000 7f5f5f38b640 1 -- start start 2023-05-15T16:40:24.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.363+0000 7f5f5f38b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5f580b4100 0x7f5f580b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:24.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.363+0000 7f5f5f38b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5f580b3080 0x7f5f58141c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:24.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.363+0000 7f5f5f38b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f580b7400 con 0x7f5f581421b0 2023-05-15T16:40:24.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.363+0000 7f5f5f38b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f580b4e70 con 0x7f5f580b3080 2023-05-15T16:40:24.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.363+0000 7f5f5f38b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f580b6640 con 0x7f5f580b4100 2023-05-15T16:40:24.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.363+0000 7f5f5c926640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5f580b3080 0x7f5f58141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:24.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.363+0000 7f5f5c926640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5f580b3080 0x7f5f58141c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48842/0 (socket says 172.21.15.62:48842) 2023-05-15T16:40:24.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.363+0000 7f5f5c926640 1 -- 172.21.15.62:0/1623992986 learned_addr learned my addr 172.21.15.62:0/1623992986 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:24.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.367+0000 7f5f5d127640 1 --2- 172.21.15.62:0/1623992986 >> v2:172.21.15.161:3300/0 conn(0x7f5f580b4100 0x7f5f580b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:24.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.367+0000 7f5f5c926640 1 -- 172.21.15.62:0/1623992986 >> v2:172.21.15.161:3300/0 conn(0x7f5f580b4100 msgr2=0x7f5f580b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:24.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.367+0000 7f5f5c926640 1 --2- 172.21.15.62:0/1623992986 >> v2:172.21.15.161:3300/0 conn(0x7f5f580b4100 0x7f5f580b38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.367+0000 7f5f5c926640 1 -- 172.21.15.62:0/1623992986 >> v1:172.21.15.161:6789/0 conn(0x7f5f581421b0 legacy=0x7f5f58147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:24.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.367+0000 7f5f5c926640 1 -- 172.21.15.62:0/1623992986 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f580b6920 con 0x7f5f580b3080 2023-05-15T16:40:24.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.367+0000 7f5f5c926640 1 --2- 172.21.15.62:0/1623992986 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f580b3080 0x7f5f58141c70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5f580b2e90 tx=0x7f5f4801c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=642913ba78f9d265 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:24.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.367+0000 7f5f4ffff640 1 -- 172.21.15.62:0/1623992986 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f480aa5f0 con 0x7f5f580b3080 2023-05-15T16:40:24.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.367+0000 7f5f4ffff640 1 -- 172.21.15.62:0/1623992986 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f480aa750 con 0x7f5f580b3080 2023-05-15T16:40:24.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.367+0000 7f5f4ffff640 1 -- 172.21.15.62:0/1623992986 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f480aaae0 con 0x7f5f580b3080 2023-05-15T16:40:24.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.367+0000 7f5f5f38b640 1 -- 172.21.15.62:0/1623992986 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f580b3080 msgr2=0x7f5f58141c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:24.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.367+0000 7f5f5f38b640 1 --2- 172.21.15.62:0/1623992986 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f580b3080 0x7f5f58141c70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5f580b2e90 tx=0x7f5f4801c490 comp rx=0 tx=0).stop 2023-05-15T16:40:24.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.367+0000 7f5f5f38b640 1 -- 172.21.15.62:0/1623992986 shutdown_connections 2023-05-15T16:40:24.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.367+0000 7f5f5f38b640 1 --2- 172.21.15.62:0/1623992986 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f580b3080 0x7f5f58141c70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.367+0000 7f5f5f38b640 1 --2- 172.21.15.62:0/1623992986 >> v2:172.21.15.161:3300/0 conn(0x7f5f580b4100 0x7f5f580b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.367+0000 7f5f5f38b640 1 -- 172.21.15.62:0/1623992986 >> 172.21.15.62:0/1623992986 conn(0x7f5f580697b0 msgr2=0x7f5f58069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:24.375 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.367+0000 7f5f5f38b640 1 -- 172.21.15.62:0/1623992986 shutdown_connections 2023-05-15T16:40:24.375 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.367+0000 7f5f5f38b640 1 -- 172.21.15.62:0/1623992986 wait complete. 2023-05-15T16:40:24.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5f38b640 1 Processor -- start 2023-05-15T16:40:24.376 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5f38b640 1 -- start start 2023-05-15T16:40:24.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5f38b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f580b3080 0x7f5f58147230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:24.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5f38b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f580b4100 0x7f5f58147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:24.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5f38b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f581421b0 0x7f5f5813c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:24.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5f38b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f58131d60 con 0x7f5f581421b0 2023-05-15T16:40:24.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5f38b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f581317a0 con 0x7f5f580b3080 2023-05-15T16:40:24.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5f38b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f58131a80 con 0x7f5f580b4100 2023-05-15T16:40:24.377 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5d928640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f581421b0 0x7f5f5813c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:24.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5d928640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f581421b0 0x7f5f5813c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48858/0 (socket says 172.21.15.62:48858) 2023-05-15T16:40:24.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5d928640 1 -- 172.21.15.62:0/3570030793 learned_addr learned my addr 172.21.15.62:0/3570030793 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:24.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5c926640 1 --2- 172.21.15.62:0/3570030793 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f580b4100 0x7f5f58147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:24.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5d127640 1 --2- 172.21.15.62:0/3570030793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f580b3080 0x7f5f58147230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:24.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5d928640 1 -- 172.21.15.62:0/3570030793 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f580b4100 msgr2=0x7f5f58147770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:24.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5d928640 1 --2- 172.21.15.62:0/3570030793 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f580b4100 0x7f5f58147770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.378 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5d928640 1 -- 172.21.15.62:0/3570030793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f580b3080 msgr2=0x7f5f58147230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:24.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5d928640 1 --2- 172.21.15.62:0/3570030793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f580b3080 0x7f5f58147230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5d928640 1 -- 172.21.15.62:0/3570030793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f480094d0 con 0x7f5f581421b0 2023-05-15T16:40:24.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5c926640 1 --2- 172.21.15.62:0/3570030793 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f580b4100 0x7f5f58147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:24.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5d928640 1 --2- 172.21.15.62:0/3570030793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f581421b0 0x7f5f5813c910 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000b970 tx=0x7f5f5000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:24.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f4dffb640 1 -- 172.21.15.62:0/3570030793 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5000cb40 con 0x7f5f581421b0 2023-05-15T16:40:24.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f4dffb640 1 -- 172.21.15.62:0/3570030793 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5000cca0 con 0x7f5f581421b0 2023-05-15T16:40:24.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f4dffb640 1 -- 172.21.15.62:0/3570030793 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f50014680 con 0x7f5f581421b0 2023-05-15T16:40:24.379 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5f38b640 1 -- 172.21.15.62:0/3570030793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f580b44d0 con 0x7f5f581421b0 2023-05-15T16:40:24.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.371+0000 7f5f5f38b640 1 -- 172.21.15.62:0/3570030793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f58148340 con 0x7f5f581421b0 2023-05-15T16:40:24.380 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.375+0000 7f5f5f38b640 1 -- 172.21.15.62:0/3570030793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f580a1dc0 con 0x7f5f581421b0 2023-05-15T16:40:24.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.375+0000 7f5f4dffb640 1 -- 172.21.15.62:0/3570030793 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f5f5001d3b0 con 0x7f5f581421b0 2023-05-15T16:40:24.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.375+0000 7f5f4dffb640 1 --2- 172.21.15.62:0/3570030793 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5f3c0653b0 0x7f5f3c067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:24.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.375+0000 7f5f4dffb640 1 -- 172.21.15.62:0/3570030793 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5f50082590 con 0x7f5f581421b0 2023-05-15T16:40:24.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.375+0000 7f5f5d127640 1 --2- 172.21.15.62:0/3570030793 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5f3c0653b0 0x7f5f3c067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:24.381 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.375+0000 7f5f5d127640 1 --2- 172.21.15.62:0/3570030793 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5f3c0653b0 0x7f5f3c067860 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400b800 tx=0x7f5f54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:24.382 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.379+0000 7f5f4dffb640 1 -- 172.21.15.62:0/3570030793 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f5f50050240 con 0x7f5f581421b0 2023-05-15T16:40:24.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.527+0000 7f5f5f38b640 1 -- 172.21.15.62:0/3570030793 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f5f58067960 con 0x7f5f581421b0 2023-05-15T16:40:24.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.527+0000 7f5f4dffb640 1 -- 172.21.15.62:0/3570030793 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5f50053860 con 0x7f5f581421b0 2023-05-15T16:40:24.533 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-05-15T16:40:24.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.531+0000 7f5f5f38b640 1 -- 172.21.15.62:0/3570030793 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5f3c0653b0 msgr2=0x7f5f3c067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:24.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.531+0000 7f5f5f38b640 1 --2- 172.21.15.62:0/3570030793 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5f3c0653b0 0x7f5f3c067860 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400b800 tx=0x7f5f54008040 comp rx=0 tx=0).stop 2023-05-15T16:40:24.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.531+0000 7f5f5f38b640 1 -- 172.21.15.62:0/3570030793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f581421b0 msgr2=0x7f5f5813c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:24.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.531+0000 7f5f5f38b640 1 --2- 172.21.15.62:0/3570030793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f581421b0 0x7f5f5813c910 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f5f5000b970 tx=0x7f5f5000be30 comp rx=0 tx=0).stop 2023-05-15T16:40:24.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.531+0000 7f5f5f38b640 1 -- 172.21.15.62:0/3570030793 shutdown_connections 2023-05-15T16:40:24.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.531+0000 7f5f5f38b640 1 --2- 172.21.15.62:0/3570030793 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5f3c0653b0 0x7f5f3c067860 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.531+0000 7f5f5f38b640 1 --2- 172.21.15.62:0/3570030793 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5f581421b0 0x7f5f5813c910 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.531+0000 7f5f5f38b640 1 --2- 172.21.15.62:0/3570030793 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5f580b4100 0x7f5f58147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.531+0000 7f5f5f38b640 1 --2- 172.21.15.62:0/3570030793 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5f580b3080 0x7f5f58147230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.531+0000 7f5f5f38b640 1 -- 172.21.15.62:0/3570030793 >> 172.21.15.62:0/3570030793 conn(0x7f5f580697b0 msgr2=0x7f5f580bad90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:24.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.531+0000 7f5f5f38b640 1 -- 172.21.15.62:0/3570030793 shutdown_connections 2023-05-15T16:40:24.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.531+0000 7f5f5f38b640 1 -- 172.21.15.62:0/3570030793 wait complete. 2023-05-15T16:40:24.564 INFO:tasks.cephfs_test_runner:Starting test: test_fscrypt_dummy_encryption_with_quick_group (tasks.cephfs.test_fscrypt.TestFscrypt) 2023-05-15T16:40:24.565 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group' 2023-05-15T16:40:24.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.687+0000 7f3a60ada640 1 Processor -- start 2023-05-15T16:40:24.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.687+0000 7f3a60ada640 1 -- start start 2023-05-15T16:40:24.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.687+0000 7f3a60ada640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3a5c0bcd70 0x7f3a5c0badc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:24.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.687+0000 7f3a60ada640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f3a5c14a8d0 0x7f3a5c1544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:24.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.687+0000 7f3a60ada640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a5c149d30 con 0x7f3a5c06b050 2023-05-15T16:40:24.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.687+0000 7f3a60ada640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a5c06b5e0 con 0x7f3a5c0bcd70 2023-05-15T16:40:24.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.687+0000 7f3a60ada640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a5c06b8c0 con 0x7f3a5c14a8d0 2023-05-15T16:40:24.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.687+0000 7f3a5a59c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3a5c0bcd70 0x7f3a5c0badc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:24.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.687+0000 7f3a5a59c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f3a5c0bcd70 0x7f3a5c0badc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48866/0 (socket says 172.21.15.62:48866) 2023-05-15T16:40:24.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.687+0000 7f3a5a59c640 1 -- 172.21.15.62:0/1295460777 learned_addr learned my addr 172.21.15.62:0/1295460777 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:24.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.691+0000 7f3a5ad9d640 1 --2- 172.21.15.62:0/1295460777 >> v2:172.21.15.161:3300/0 conn(0x7f3a5c14a8d0 0x7f3a5c1544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:24.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.691+0000 7f3a5a59c640 1 -- 172.21.15.62:0/1295460777 >> v2:172.21.15.161:3300/0 conn(0x7f3a5c14a8d0 msgr2=0x7f3a5c1544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:24.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.691+0000 7f3a5a59c640 1 --2- 172.21.15.62:0/1295460777 >> v2:172.21.15.161:3300/0 conn(0x7f3a5c14a8d0 0x7f3a5c1544d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.691+0000 7f3a5a59c640 1 -- 172.21.15.62:0/1295460777 >> v1:172.21.15.161:6789/0 conn(0x7f3a5c06b050 legacy=0x7f3a5c14a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:24.695 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.691+0000 7f3a5a59c640 1 -- 172.21.15.62:0/1295460777 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a5c06bba0 con 0x7f3a5c0bcd70 2023-05-15T16:40:24.696 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.691+0000 7f3a5ad9d640 1 --2- 172.21.15.62:0/1295460777 >> v2:172.21.15.161:3300/0 conn(0x7f3a5c14a8d0 0x7f3a5c1544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:24.698 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.691+0000 7f3a5a59c640 1 --2- 172.21.15.62:0/1295460777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a5c0bcd70 0x7f3a5c0badc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c009870 tx=0x7f3a4c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55cf4e41e2f9c3b2 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:24.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.691+0000 7f3a5959a640 1 -- 172.21.15.62:0/1295460777 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c0ac630 con 0x7f3a5c0bcd70 2023-05-15T16:40:24.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.691+0000 7f3a5959a640 1 -- 172.21.15.62:0/1295460777 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4c0ac790 con 0x7f3a5c0bcd70 2023-05-15T16:40:24.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.691+0000 7f3a5959a640 1 -- 172.21.15.62:0/1295460777 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c0acb20 con 0x7f3a5c0bcd70 2023-05-15T16:40:24.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.691+0000 7f3a60ada640 1 -- 172.21.15.62:0/1295460777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a5c0bcd70 msgr2=0x7f3a5c0badc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:24.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.691+0000 7f3a60ada640 1 --2- 172.21.15.62:0/1295460777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a5c0bcd70 0x7f3a5c0badc0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c009870 tx=0x7f3a4c01c4c0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.691+0000 7f3a60ada640 1 -- 172.21.15.62:0/1295460777 shutdown_connections 2023-05-15T16:40:24.699 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.691+0000 7f3a60ada640 1 --2- 172.21.15.62:0/1295460777 >> v2:172.21.15.161:3300/0 conn(0x7f3a5c14a8d0 0x7f3a5c1544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.691+0000 7f3a60ada640 1 --2- 172.21.15.62:0/1295460777 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a5c0bcd70 0x7f3a5c0badc0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.691+0000 7f3a60ada640 1 -- 172.21.15.62:0/1295460777 >> 172.21.15.62:0/1295460777 conn(0x7f3a5c0bff80 msgr2=0x7f3a5c0c0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.691+0000 7f3a60ada640 1 -- 172.21.15.62:0/1295460777 shutdown_connections 2023-05-15T16:40:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.691+0000 7f3a60ada640 1 -- 172.21.15.62:0/1295460777 wait complete. 2023-05-15T16:40:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a60ada640 1 Processor -- start 2023-05-15T16:40:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a60ada640 1 -- start start 2023-05-15T16:40:24.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a60ada640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a5c06b050 0x7f3a5c1e27d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a60ada640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a5c0bcd70 0x7f3a5c1e6770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a60ada640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a5c14a8d0 0x7f3a5c13f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a60ada640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c13f5f0 con 0x7f3a5c06b050 2023-05-15T16:40:24.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a60ada640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c1e3760 con 0x7f3a5c0bcd70 2023-05-15T16:40:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a60ada640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a5c0b3630 con 0x7f3a5c14a8d0 2023-05-15T16:40:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a5a59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a5c06b050 0x7f3a5c1e27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a5a59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a5c06b050 0x7f3a5c1e27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:48880/0 (socket says 172.21.15.62:48880) 2023-05-15T16:40:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a5a59c640 1 -- 172.21.15.62:0/611823352 learned_addr learned my addr 172.21.15.62:0/611823352 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a59d9b640 1 --2- 172.21.15.62:0/611823352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a5c0bcd70 0x7f3a5c1e6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a5ad9d640 1 --2- 172.21.15.62:0/611823352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a5c14a8d0 0x7f3a5c13f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:24.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a5a59c640 1 -- 172.21.15.62:0/611823352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a5c14a8d0 msgr2=0x7f3a5c13f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a5a59c640 1 --2- 172.21.15.62:0/611823352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a5c14a8d0 0x7f3a5c13f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a5a59c640 1 -- 172.21.15.62:0/611823352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a5c0bcd70 msgr2=0x7f3a5c1e6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a5a59c640 1 --2- 172.21.15.62:0/611823352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a5c0bcd70 0x7f3a5c1e6770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:24.703 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a5a59c640 1 -- 172.21.15.62:0/611823352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a4c0094d0 con 0x7f3a5c06b050 2023-05-15T16:40:24.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a5a59c640 1 --2- 172.21.15.62:0/611823352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a5c06b050 0x7f3a5c1e27d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0af040 tx=0x7f3a4c01ad00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:24.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a4affd640 1 -- 172.21.15.62:0/611823352 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c0b7830 con 0x7f3a5c06b050 2023-05-15T16:40:24.705 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a4affd640 1 -- 172.21.15.62:0/611823352 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a4c0b79b0 con 0x7f3a5c06b050 2023-05-15T16:40:24.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a60ada640 1 -- 172.21.15.62:0/611823352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a5c1573c0 con 0x7f3a5c06b050 2023-05-15T16:40:24.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a4affd640 1 -- 172.21.15.62:0/611823352 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a4c0b7d60 con 0x7f3a5c06b050 2023-05-15T16:40:24.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a60ada640 1 -- 172.21.15.62:0/611823352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a5c157230 con 0x7f3a5c06b050 2023-05-15T16:40:24.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a60ada640 1 -- 172.21.15.62:0/611823352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a5c157550 con 0x7f3a5c06b050 2023-05-15T16:40:24.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a4affd640 1 -- 172.21.15.62:0/611823352 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f3a4c0b3040 con 0x7f3a5c06b050 2023-05-15T16:40:24.706 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a4affd640 1 --2- 172.21.15.62:0/611823352 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3a3c065380 0x7f3a3c067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:24.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.695+0000 7f3a4affd640 1 -- 172.21.15.62:0/611823352 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3a4c11ce70 con 0x7f3a5c06b050 2023-05-15T16:40:24.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.699+0000 7f3a59d9b640 1 --2- 172.21.15.62:0/611823352 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3a3c065380 0x7f3a3c067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:24.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.699+0000 7f3a59d9b640 1 --2- 172.21.15.62:0/611823352 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3a3c065380 0x7f3a3c067830 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c14e210 tx=0x7f3a50009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:24.707 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.699+0000 7f3a4affd640 1 -- 172.21.15.62:0/611823352 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f3a4c0eabb0 con 0x7f3a5c06b050 2023-05-15T16:40:24.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:24.911+0000 7f3a60ada640 1 -- 172.21.15.62:0/611823352 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]} v 0) v1 -- 0x7f3a5c04dbe0 con 0x7f3a5c06b050 2023-05-15T16:40:25.497 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:40:25.501 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:40:25.504 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:40:25.557 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.555+0000 7f3a4affd640 1 -- 172.21.15.62:0/611823352 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_fscrypt.TestFscrypt.test_fscrypt_dummy_encryption_with_quick_group"]}]=0 v47) v1 ==== 166+0+0 (secure 0 0 0) 0x7f3a4c0ee1d0 con 0x7f3a5c06b050 2023-05-15T16:40:25.560 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.555+0000 7f3a60ada640 1 -- 172.21.15.62:0/611823352 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3a3c065380 msgr2=0x7f3a3c067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:25.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.555+0000 7f3a60ada640 1 --2- 172.21.15.62:0/611823352 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3a3c065380 0x7f3a3c067830 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3a5c14e210 tx=0x7f3a50009040 comp rx=0 tx=0).stop 2023-05-15T16:40:25.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.555+0000 7f3a60ada640 1 -- 172.21.15.62:0/611823352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a5c06b050 msgr2=0x7f3a5c1e27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:25.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.555+0000 7f3a60ada640 1 --2- 172.21.15.62:0/611823352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a5c06b050 0x7f3a5c1e27d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3a4c0af040 tx=0x7f3a4c01ad00 comp rx=0 tx=0).stop 2023-05-15T16:40:25.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.555+0000 7f3a60ada640 1 -- 172.21.15.62:0/611823352 shutdown_connections 2023-05-15T16:40:25.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.555+0000 7f3a60ada640 1 --2- 172.21.15.62:0/611823352 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f3a5c14a8d0 0x7f3a5c13f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:25.561 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.555+0000 7f3a60ada640 1 --2- 172.21.15.62:0/611823352 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f3a5c0bcd70 0x7f3a5c1e6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:25.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.555+0000 7f3a60ada640 1 --2- 172.21.15.62:0/611823352 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3a3c065380 0x7f3a3c067830 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:25.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.555+0000 7f3a60ada640 1 --2- 172.21.15.62:0/611823352 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f3a5c06b050 0x7f3a5c1e27d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:25.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.555+0000 7f3a60ada640 1 -- 172.21.15.62:0/611823352 >> 172.21.15.62:0/611823352 conn(0x7f3a5c0bff80 msgr2=0x7f3a5c142450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:25.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.555+0000 7f3a60ada640 1 -- 172.21.15.62:0/611823352 shutdown_connections 2023-05-15T16:40:25.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.555+0000 7f3a60ada640 1 -- 172.21.15.62:0/611823352 wait complete. 2023-05-15T16:40:25.580 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-05-15T16:40:25.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.747+0000 7f244cecc640 1 Processor -- start 2023-05-15T16:40:25.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.747+0000 7f244cecc640 1 -- start start 2023-05-15T16:40:25.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.751+0000 7f244cecc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24480b0dd0 0x7f24480b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:25.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.751+0000 7f244cecc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f24480b65a0 0x7f2448146c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:25.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.751+0000 7f244cecc640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24481467e0 con 0x7f24480b5600 2023-05-15T16:40:25.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.751+0000 7f244cecc640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24480b2ca0 con 0x7f24480b65a0 2023-05-15T16:40:25.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.751+0000 7f244cecc640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24480b6130 con 0x7f24480b0dd0 2023-05-15T16:40:25.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.751+0000 7f2445d9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f24480b65a0 0x7f2448146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:25.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.751+0000 7f2446d9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f24480b5600 0x7f24480b5a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:60994/0 (socket says 172.21.15.62:60994) 2023-05-15T16:40:25.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.751+0000 7f2446d9d640 1 -- 172.21.15.62:0/369148375 learned_addr learned my addr 172.21.15.62:0/369148375 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:25.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.751+0000 7f244659c640 1 --2- 172.21.15.62:0/369148375 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24480b0dd0 0x7f24480b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:25.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.751+0000 7f2445d9b640 1 -- 172.21.15.62:0/369148375 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24480b0dd0 msgr2=0x7f24480b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:25.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.751+0000 7f2445d9b640 1 --2- 172.21.15.62:0/369148375 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24480b0dd0 0x7f24480b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:25.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.751+0000 7f2445d9b640 1 -- 172.21.15.62:0/369148375 >> v1:172.21.15.62:6789/0 conn(0x7f24480b5600 legacy=0x7f24480b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:25.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.751+0000 7f2445d9b640 1 -- 172.21.15.62:0/369148375 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24480b3e10 con 0x7f24480b65a0 2023-05-15T16:40:25.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.751+0000 7f244559a640 1 -- 172.21.15.62:0/369148375 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 517625056 0 0) 0x7f24481467e0 con 0x7f24480b5600 2023-05-15T16:40:25.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.751+0000 7f244659c640 1 --2- 172.21.15.62:0/369148375 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24480b0dd0 0x7f24480b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:25.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.751+0000 7f2445d9b640 1 --2- 172.21.15.62:0/369148375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24480b65a0 0x7f2448146c70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f24380097f0 tx=0x7f243801c480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=406e699e9ff7ec01 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:25.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.751+0000 7f244559a640 1 -- 172.21.15.62:0/369148375 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24380ac640 con 0x7f24480b65a0 2023-05-15T16:40:25.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.751+0000 7f244559a640 1 -- 172.21.15.62:0/369148375 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24380ac7a0 con 0x7f24480b65a0 2023-05-15T16:40:25.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.751+0000 7f244559a640 1 -- 172.21.15.62:0/369148375 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24380acb30 con 0x7f24480b65a0 2023-05-15T16:40:25.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f244cecc640 1 -- 172.21.15.62:0/369148375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24480b65a0 msgr2=0x7f2448146c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:25.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f244cecc640 1 --2- 172.21.15.62:0/369148375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24480b65a0 0x7f2448146c70 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f24380097f0 tx=0x7f243801c480 comp rx=0 tx=0).stop 2023-05-15T16:40:25.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f244cecc640 1 -- 172.21.15.62:0/369148375 shutdown_connections 2023-05-15T16:40:25.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f244cecc640 1 --2- 172.21.15.62:0/369148375 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24480b65a0 0x7f2448146c70 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:25.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f244cecc640 1 --2- 172.21.15.62:0/369148375 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24480b0dd0 0x7f24480b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:25.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f244cecc640 1 -- 172.21.15.62:0/369148375 >> 172.21.15.62:0/369148375 conn(0x7f24480697b0 msgr2=0x7f2448069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:25.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f244cecc640 1 -- 172.21.15.62:0/369148375 shutdown_connections 2023-05-15T16:40:25.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f244cecc640 1 -- 172.21.15.62:0/369148375 wait complete. 2023-05-15T16:40:25.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f244cecc640 1 Processor -- start 2023-05-15T16:40:25.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f244cecc640 1 -- start start 2023-05-15T16:40:25.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f244cecc640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24480b0dd0 0x7f244806ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:25.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f244cecc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24480b5600 0x7f244813d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:25.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f244cecc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24480b65a0 0x7f24481e24c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:25.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f244cecc640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244806f830 con 0x7f24480b65a0 2023-05-15T16:40:25.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f244cecc640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244809e530 con 0x7f24480b0dd0 2023-05-15T16:40:25.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f244cecc640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244806ff80 con 0x7f24480b5600 2023-05-15T16:40:25.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f2446d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24480b65a0 0x7f24481e24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:25.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f2446d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24480b65a0 0x7f24481e24c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46784/0 (socket says 172.21.15.62:46784) 2023-05-15T16:40:25.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f2446d9d640 1 -- 172.21.15.62:0/2162040938 learned_addr learned my addr 172.21.15.62:0/2162040938 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:25.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f244659c640 1 --2- 172.21.15.62:0/2162040938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24480b0dd0 0x7f244806ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:25.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f2445d9b640 1 --2- 172.21.15.62:0/2162040938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24480b5600 0x7f244813d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:25.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f2446d9d640 1 -- 172.21.15.62:0/2162040938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24480b5600 msgr2=0x7f244813d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:25.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f2446d9d640 1 --2- 172.21.15.62:0/2162040938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24480b5600 0x7f244813d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:25.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f2446d9d640 1 -- 172.21.15.62:0/2162040938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24480b0dd0 msgr2=0x7f244806ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:25.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f2446d9d640 1 --2- 172.21.15.62:0/2162040938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24480b0dd0 0x7f244806ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:25.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f2446d9d640 1 -- 172.21.15.62:0/2162040938 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2438009420 con 0x7f24480b65a0 2023-05-15T16:40:25.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f2446d9d640 1 --2- 172.21.15.62:0/2162040938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24480b65a0 0x7f24481e24c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2440001570 tx=0x7f244000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:25.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f243effd640 1 -- 172.21.15.62:0/2162040938 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244000a640 con 0x7f24480b65a0 2023-05-15T16:40:25.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f243effd640 1 -- 172.21.15.62:0/2162040938 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244000a7c0 con 0x7f24480b65a0 2023-05-15T16:40:25.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f244cecc640 1 -- 172.21.15.62:0/2162040938 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2448146470 con 0x7f24480b65a0 2023-05-15T16:40:25.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f243effd640 1 -- 172.21.15.62:0/2162040938 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244000ab70 con 0x7f24480b65a0 2023-05-15T16:40:25.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.755+0000 7f244cecc640 1 -- 172.21.15.62:0/2162040938 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24480b29c0 con 0x7f24480b65a0 2023-05-15T16:40:25.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.759+0000 7f244cecc640 1 -- 172.21.15.62:0/2162040938 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24480b11a0 con 0x7f24480b65a0 2023-05-15T16:40:25.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.759+0000 7f243effd640 1 -- 172.21.15.62:0/2162040938 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f244000acd0 con 0x7f24480b65a0 2023-05-15T16:40:25.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.759+0000 7f243effd640 1 --2- 172.21.15.62:0/2162040938 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f2428065380 0x7f2428067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:25.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.759+0000 7f243effd640 1 -- 172.21.15.62:0/2162040938 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f2440082170 con 0x7f24480b65a0 2023-05-15T16:40:25.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.759+0000 7f244659c640 1 --2- 172.21.15.62:0/2162040938 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f2428065380 0x7f2428067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:25.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.759+0000 7f244659c640 1 --2- 172.21.15.62:0/2162040938 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f2428065380 0x7f2428067830 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2430006fd0 tx=0x7f2430008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:25.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.763+0000 7f243effd640 1 -- 172.21.15.62:0/2162040938 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f244004fd60 con 0x7f24480b65a0 2023-05-15T16:40:25.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.915+0000 7f244cecc640 1 -- 172.21.15.62:0/2162040938 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f2448067960 con 0x7f24480b65a0 2023-05-15T16:40:25.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.923+0000 7f243effd640 1 -- 172.21.15.62:0/2162040938 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f24400180c0 con 0x7f24480b65a0 2023-05-15T16:40:25.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.923+0000 7f244cecc640 1 -- 172.21.15.62:0/2162040938 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f2428065380 msgr2=0x7f2428067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:25.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.923+0000 7f244cecc640 1 --2- 172.21.15.62:0/2162040938 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f2428065380 0x7f2428067830 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2430006fd0 tx=0x7f2430008040 comp rx=0 tx=0).stop 2023-05-15T16:40:25.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.923+0000 7f244cecc640 1 -- 172.21.15.62:0/2162040938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24480b65a0 msgr2=0x7f24481e24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:25.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.923+0000 7f244cecc640 1 --2- 172.21.15.62:0/2162040938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24480b65a0 0x7f24481e24c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f2440001570 tx=0x7f244000cca0 comp rx=0 tx=0).stop 2023-05-15T16:40:25.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.923+0000 7f244cecc640 1 -- 172.21.15.62:0/2162040938 shutdown_connections 2023-05-15T16:40:25.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.923+0000 7f244cecc640 1 --2- 172.21.15.62:0/2162040938 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f2428065380 0x7f2428067830 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:25.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.923+0000 7f244cecc640 1 --2- 172.21.15.62:0/2162040938 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f24480b65a0 0x7f24481e24c0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:25.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.923+0000 7f244cecc640 1 --2- 172.21.15.62:0/2162040938 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f24480b5600 0x7f244813d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:25.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.923+0000 7f244cecc640 1 --2- 172.21.15.62:0/2162040938 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f24480b0dd0 0x7f244806ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:25.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.923+0000 7f244cecc640 1 -- 172.21.15.62:0/2162040938 >> 172.21.15.62:0/2162040938 conn(0x7f24480697b0 msgr2=0x7f2448144940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:25.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.923+0000 7f244cecc640 1 -- 172.21.15.62:0/2162040938 shutdown_connections 2023-05-15T16:40:25.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:25.923+0000 7f244cecc640 1 -- 172.21.15.62:0/2162040938 wait complete. 2023-05-15T16:40:25.945 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-05-15T16:40:25.946 DEBUG:teuthology.orchestra.run.smithi062:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-15T16:40:26.003 DEBUG:teuthology.orchestra.run.smithi161:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-15T16:40:26.049 DEBUG:teuthology.orchestra.run.smithi171:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-05-15T16:40:26.105 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-05-15T16:40:26.106 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2023-05-15T16:40:26.106 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-15T16:40:26.114 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2023-05-15T16:40:26.115 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-15T16:40:26.170 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2023-05-15T16:40:26.170 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-15T16:40:26.226 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-15T16:40:26.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.355+0000 7f0535f1b640 1 Processor -- start 2023-05-15T16:40:26.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.355+0000 7f0535f1b640 1 -- start start 2023-05-15T16:40:26.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.359+0000 7f0535f1b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0530071a90 0x7f05300b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:26.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.359+0000 7f0535f1b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0530144e90 0x7f0530145310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:26.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.359+0000 7f0535f1b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05300716b0 con 0x7f05300b5330 2023-05-15T16:40:26.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.359+0000 7f0535f1b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05300b2280 con 0x7f0530071a90 2023-05-15T16:40:26.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.359+0000 7f0535f1b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05300afa90 con 0x7f0530144e90 2023-05-15T16:40:26.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.359+0000 7f052effd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0530071a90 0x7f05300b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:26.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.359+0000 7f052effd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f0530071a90 0x7f05300b5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46796/0 (socket says 172.21.15.62:46796) 2023-05-15T16:40:26.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.359+0000 7f052effd640 1 -- 172.21.15.62:0/1336129626 learned_addr learned my addr 172.21.15.62:0/1336129626 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:26.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.359+0000 7f052f7fe640 1 --1- 172.21.15.62:0/1336129626 >> v1:172.21.15.62:6789/0 conn(0x7f05300b5330 0x7f05300b16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32776/0 (socket says 172.21.15.62:32776) 2023-05-15T16:40:26.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.359+0000 7f052ffff640 1 --2- 172.21.15.62:0/1336129626 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0530144e90 0x7f0530145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:26.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.359+0000 7f052effd640 1 -- 172.21.15.62:0/1336129626 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0530144e90 msgr2=0x7f0530145310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:26.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.359+0000 7f052effd640 1 --2- 172.21.15.62:0/1336129626 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0530144e90 0x7f0530145310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.359+0000 7f052effd640 1 -- 172.21.15.62:0/1336129626 >> v1:172.21.15.62:6789/0 conn(0x7f05300b5330 legacy=0x7f05300b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:26.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.359+0000 7f052effd640 1 -- 172.21.15.62:0/1336129626 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05300b0f00 con 0x7f0530071a90 2023-05-15T16:40:26.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.359+0000 7f052effd640 1 --2- 172.21.15.62:0/1336129626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0530071a90 0x7f05300b5700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0520009870 tx=0x7f052001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c02cedf28ac99e7 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:26.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.359+0000 7f052e7fc640 1 -- 172.21.15.62:0/1336129626 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05200aa670 con 0x7f0530071a90 2023-05-15T16:40:26.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.359+0000 7f052e7fc640 1 -- 172.21.15.62:0/1336129626 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05200aa7d0 con 0x7f0530071a90 2023-05-15T16:40:26.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.359+0000 7f052e7fc640 1 -- 172.21.15.62:0/1336129626 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05200aab60 con 0x7f0530071a90 2023-05-15T16:40:26.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.359+0000 7f0535f1b640 1 -- 172.21.15.62:0/1336129626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0530071a90 msgr2=0x7f05300b5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:26.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.359+0000 7f0535f1b640 1 --2- 172.21.15.62:0/1336129626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0530071a90 0x7f05300b5700 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0520009870 tx=0x7f052001c510 comp rx=0 tx=0).stop 2023-05-15T16:40:26.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f0535f1b640 1 -- 172.21.15.62:0/1336129626 shutdown_connections 2023-05-15T16:40:26.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f0535f1b640 1 --2- 172.21.15.62:0/1336129626 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0530144e90 0x7f0530145310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f0535f1b640 1 --2- 172.21.15.62:0/1336129626 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0530071a90 0x7f05300b5700 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f0535f1b640 1 -- 172.21.15.62:0/1336129626 >> 172.21.15.62:0/1336129626 conn(0x7f05300653f0 msgr2=0x7f05300697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:26.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f0535f1b640 1 -- 172.21.15.62:0/1336129626 shutdown_connections 2023-05-15T16:40:26.367 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f0535f1b640 1 -- 172.21.15.62:0/1336129626 wait complete. 2023-05-15T16:40:26.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f0535f1b640 1 Processor -- start 2023-05-15T16:40:26.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f0535f1b640 1 -- start start 2023-05-15T16:40:26.368 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f0535f1b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0530071a90 0x7f05301e1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:26.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f0535f1b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05300b5330 0x7f0530151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:26.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f0535f1b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0530144e90 0x7f053013d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:26.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f0535f1b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0530137540 con 0x7f0530071a90 2023-05-15T16:40:26.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f0535f1b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f053013dd30 con 0x7f05300b5330 2023-05-15T16:40:26.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f0535f1b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0530150a40 con 0x7f0530144e90 2023-05-15T16:40:26.369 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f052f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0530071a90 0x7f05301e1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:26.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f052f7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0530071a90 0x7f05301e1d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46802/0 (socket says 172.21.15.62:46802) 2023-05-15T16:40:26.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f052f7fe640 1 -- 172.21.15.62:0/2178466074 learned_addr learned my addr 172.21.15.62:0/2178466074 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:26.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f052f7fe640 1 -- 172.21.15.62:0/2178466074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0530144e90 msgr2=0x7f053013d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:26.370 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f052f7fe640 1 --2- 172.21.15.62:0/2178466074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0530144e90 0x7f053013d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f052f7fe640 1 -- 172.21.15.62:0/2178466074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05300b5330 msgr2=0x7f0530151980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:26.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f052f7fe640 1 --2- 172.21.15.62:0/2178466074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05300b5330 0x7f0530151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f052f7fe640 1 -- 172.21.15.62:0/2178466074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05200094d0 con 0x7f0530071a90 2023-05-15T16:40:26.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f052f7fe640 1 --2- 172.21.15.62:0/2178466074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0530071a90 0x7f05301e1d80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f052400c870 tx=0x7f052400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:26.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f0517fff640 1 -- 172.21.15.62:0/2178466074 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052400a640 con 0x7f0530071a90 2023-05-15T16:40:26.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f0517fff640 1 -- 172.21.15.62:0/2178466074 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f052400a7a0 con 0x7f0530071a90 2023-05-15T16:40:26.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f0535f1b640 1 -- 172.21.15.62:0/2178466074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05300b2050 con 0x7f0530071a90 2023-05-15T16:40:26.371 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f0517fff640 1 -- 172.21.15.62:0/2178466074 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f052400ab10 con 0x7f0530071a90 2023-05-15T16:40:26.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f0535f1b640 1 -- 172.21.15.62:0/2178466074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05300b1ec0 con 0x7f0530071a90 2023-05-15T16:40:26.372 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.363+0000 7f0535f1b640 1 -- 172.21.15.62:0/2178466074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0530150f40 con 0x7f0530071a90 2023-05-15T16:40:26.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.367+0000 7f0517fff640 1 -- 172.21.15.62:0/2178466074 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f052400ac70 con 0x7f0530071a90 2023-05-15T16:40:26.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.367+0000 7f0517fff640 1 --2- 172.21.15.62:0/2178466074 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f051c065380 0x7f051c067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:26.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.367+0000 7f0517fff640 1 -- 172.21.15.62:0/2178466074 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0524081f80 con 0x7f0530071a90 2023-05-15T16:40:26.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.367+0000 7f052effd640 1 --2- 172.21.15.62:0/2178466074 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f051c065380 0x7f051c067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:26.373 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.367+0000 7f052effd640 1 --2- 172.21.15.62:0/2178466074 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f051c065380 0x7f051c067830 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f05200ae000 tx=0x7f0520008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:26.374 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.371+0000 7f0517fff640 1 -- 172.21.15.62:0/2178466074 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f052404a620 con 0x7f0530071a90 2023-05-15T16:40:26.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.527+0000 7f0535f1b640 1 -- 172.21.15.62:0/2178466074 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f053014aff0 con 0x7f0530071a90 2023-05-15T16:40:26.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.527+0000 7f0517fff640 1 -- 172.21.15.62:0/2178466074 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17811 (secure 0 0 0) 0x7f0524017090 con 0x7f0530071a90 2023-05-15T16:40:26.531 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:26.532 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:40:02.088078+0000","last_up_change":"2023-05-15T16:39:48.597049+0000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-15T16:39:49.394028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-15T16:39:55.208679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-15T16:39:59.547414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-15T16:40:00.055526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37594},{"type":"v1","addr":"172.21.15.62:6825","nonce":37594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37594},{"type":"v1","addr":"172.21.15.62:6827","nonce":37594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37594},{"type":"v1","addr":"172.21.15.62:6831","nonce":37594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37594},{"type":"v1","addr":"172.21.15.62:6829","nonce":37594}]},"public_addr":"172.21.15.62:6825/37594","cluster_addr":"172.21.15.62:6827/37594","heartbeat_back_addr":"172.21.15.62:6831/37594","heartbeat_front_addr":"172.21.15.62:6829/37594","state":["exists","up"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37592},{"type":"v1","addr":"172.21.15.62:6808","nonce":37592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":37592},{"type":"v1","addr":"172.21.15.62:6814","nonce":37592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6821","nonce":37592},{"type":"v1","addr":"172.21.15.62:6823","nonce":37592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37592},{"type":"v1","addr":"172.21.15.62:6818","nonce":37592}]},"public_addr":"172.21.15.62:6808/37592","cluster_addr":"172.21.15.62:6814/37592","heartbeat_back_addr":"172.21.15.62:6823/37592","heartbeat_front_addr":"172.21.15.62:6818/37592","state":["exists","up"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":37591},{"type":"v1","addr":"172.21.15.62:6810","nonce":37591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":37591},{"type":"v1","addr":"172.21.15.62:6815","nonce":37591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37591},{"type":"v1","addr":"172.21.15.62:6822","nonce":37591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":37591},{"type":"v1","addr":"172.21.15.62:6819","nonce":37591}]},"public_addr":"172.21.15.62:6810/37591","cluster_addr":"172.21.15.62:6815/37591","heartbeat_back_addr":"172.21.15.62:6822/37591","heartbeat_front_addr":"172.21.15.62:6819/37591","state":["exists","up"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37593},{"type":"v1","addr":"172.21.15.62:6801","nonce":37593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37593},{"type":"v1","addr":"172.21.15.62:6803","nonce":37593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":37593},{"type":"v1","addr":"172.21.15.62:6812","nonce":37593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37593},{"type":"v1","addr":"172.21.15.62:6805","nonce":37593}]},"public_addr":"172.21.15.62:6801/37593","cluster_addr":"172.21.15.62:6803/37593","heartbeat_back_addr":"172.21.15.62:6812/37593","heartbeat_front_addr":"172.21.15.62:6805/37593","state":["exists","up"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37854},{"type":"v1","addr":"172.21.15.161:6801","nonce":37854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37854},{"type":"v1","addr":"172.21.15.161:6803","nonce":37854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37854},{"type":"v1","addr":"172.21.15.161:6807","nonce":37854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37854},{"type":"v1","addr":"172.21.15.161:6805","nonce":37854}]},"public_addr":"172.21.15.161:6801/37854","cluster_addr":"172.21.15.161:6803/37854","heartbeat_back_addr":"172.21.15.161:6807/37854","heartbeat_front_addr":"172.21.15.161:6805/37854","state":["exists","up"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37855},{"type":"v1","addr":"172.21.15.161:6810","nonce":37855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37855},{"type":"v1","addr":"172.21.15.161:6815","nonce":37855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37855},{"type":"v1","addr":"172.21.15.161:6824","nonce":37855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37855},{"type":"v1","addr":"172.21.15.161:6820","nonce":37855}]},"public_addr":"172.21.15.161:6810/37855","cluster_addr":"172.21.15.161:6815/37855","heartbeat_back_addr":"172.21.15.161:6824/37855","heartbeat_front_addr":"172.21.15.161:6820/37855","state":["exists","up"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":37856},{"type":"v1","addr":"172.21.15.161:6814","nonce":37856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37856},{"type":"v1","addr":"172.21.15.161:6819","nonce":37856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":37856},{"type":"v1","addr":"172.21.15.161:6830","nonce":37856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37856},{"type":"v1","addr":"172.21.15.161:6826","nonce":37856}]},"public_addr":"172.21.15.161:6814/37856","cluster_addr":"172.21.15.161:6819/37856","heartbeat_back_addr":"172.21.15.161:6830/37856","heartbeat_front_addr":"172.21.15.161:6826/37856","state":["exists","up"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":37857},{"type":"v1","addr":"172.21.15.161:6813","nonce":37857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":37857},{"type":"v1","addr":"172.21.15.161:6821","nonce":37857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":37857},{"type":"v1","addr":"172.21.15.161:6831","nonce":37857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":37857},{"type":"v1","addr":"172.21.15.161:6827","nonce":37857}]},"public_addr":"172.21.15.161:6813/37857","cluster_addr":"172.21.15.161:6821/37857","heartbeat_back_addr":"172.21.15.161:6831/37857","heartbeat_front_addr":"172.21.15.161:6827/37857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.592907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.618143+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.641533+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.614355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.579293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.718353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.730135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.792887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:40:26.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.531+0000 7f0535f1b640 1 -- 172.21.15.62:0/2178466074 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f051c065380 msgr2=0x7f051c067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:26.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.531+0000 7f0535f1b640 1 --2- 172.21.15.62:0/2178466074 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f051c065380 0x7f051c067830 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f05200ae000 tx=0x7f0520008040 comp rx=0 tx=0).stop 2023-05-15T16:40:26.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.531+0000 7f0535f1b640 1 -- 172.21.15.62:0/2178466074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0530071a90 msgr2=0x7f05301e1d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:26.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.531+0000 7f0535f1b640 1 --2- 172.21.15.62:0/2178466074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0530071a90 0x7f05301e1d80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f052400c870 tx=0x7f052400cd30 comp rx=0 tx=0).stop 2023-05-15T16:40:26.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.531+0000 7f0535f1b640 1 -- 172.21.15.62:0/2178466074 shutdown_connections 2023-05-15T16:40:26.534 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.531+0000 7f0535f1b640 1 --2- 172.21.15.62:0/2178466074 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0530144e90 0x7f053013d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.531+0000 7f0535f1b640 1 --2- 172.21.15.62:0/2178466074 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f05300b5330 0x7f0530151980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.531+0000 7f0535f1b640 1 --2- 172.21.15.62:0/2178466074 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f051c065380 0x7f051c067830 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.531+0000 7f0535f1b640 1 --2- 172.21.15.62:0/2178466074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0530071a90 0x7f05301e1d80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.531+0000 7f0535f1b640 1 -- 172.21.15.62:0/2178466074 >> 172.21.15.62:0/2178466074 conn(0x7f05300653f0 msgr2=0x7f05300b98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:26.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.531+0000 7f0535f1b640 1 -- 172.21.15.62:0/2178466074 shutdown_connections 2023-05-15T16:40:26.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.531+0000 7f0535f1b640 1 -- 172.21.15.62:0/2178466074 wait complete. 2023-05-15T16:40:26.551 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-15T16:39:49.394028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-15T16:39:55.208679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-15T16:39:59.547414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-15T16:40:00.055526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-15T16:40:26.552 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-15T16:40:26.676 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.671+0000 7f3630fb1640 1 Processor -- start 2023-05-15T16:40:26.677 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.671+0000 7f3630fb1640 1 -- start start 2023-05-15T16:40:26.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.671+0000 7f3630fb1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f362c0be0a0 0x7f362c0b9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:26.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.671+0000 7f3630fb1640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f362c0be4d0 0x7f362c0ba010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:26.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.671+0000 7f3630fb1640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f362c06c7b0 con 0x7f362c1441b0 2023-05-15T16:40:26.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.671+0000 7f3630fb1640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f362c06b5e0 con 0x7f362c0be0a0 2023-05-15T16:40:26.678 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.671+0000 7f3630fb1640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f362c144580 con 0x7f362c0be4d0 2023-05-15T16:40:26.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.675+0000 7f3629d9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f362c0be0a0 0x7f362c0b9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:26.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.675+0000 7f362a59c640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f362c1441b0 0x7f362c0b86e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32788/0 (socket says 172.21.15.62:32788) 2023-05-15T16:40:26.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.675+0000 7f362a59c640 1 -- 172.21.15.62:0/3279834074 learned_addr learned my addr 172.21.15.62:0/3279834074 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:26.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.675+0000 7f362ad9d640 1 --2- 172.21.15.62:0/3279834074 >> v2:172.21.15.161:3300/0 conn(0x7f362c0be4d0 0x7f362c0ba010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:26.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.675+0000 7f3629d9b640 1 -- 172.21.15.62:0/3279834074 >> v2:172.21.15.161:3300/0 conn(0x7f362c0be4d0 msgr2=0x7f362c0ba010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:26.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.675+0000 7f3629d9b640 1 --2- 172.21.15.62:0/3279834074 >> v2:172.21.15.161:3300/0 conn(0x7f362c0be4d0 0x7f362c0ba010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.675+0000 7f3629d9b640 1 -- 172.21.15.62:0/3279834074 >> v1:172.21.15.62:6789/0 conn(0x7f362c1441b0 legacy=0x7f362c0b86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:26.679 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.675+0000 7f3629d9b640 1 -- 172.21.15.62:0/3279834074 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c06bbe0 con 0x7f362c0be0a0 2023-05-15T16:40:26.680 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.675+0000 7f3629d9b640 1 --2- 172.21.15.62:0/3279834074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f362c0be0a0 0x7f362c0b9ad0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f362c070450 tx=0x7f362001c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ff93903863f38a server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:26.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.675+0000 7f362959a640 1 -- 172.21.15.62:0/3279834074 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200ab600 con 0x7f362c0be0a0 2023-05-15T16:40:26.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.675+0000 7f362959a640 1 -- 172.21.15.62:0/3279834074 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36200a7050 con 0x7f362c0be0a0 2023-05-15T16:40:26.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.675+0000 7f362959a640 1 -- 172.21.15.62:0/3279834074 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36200ab980 con 0x7f362c0be0a0 2023-05-15T16:40:26.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.675+0000 7f3630fb1640 1 -- 172.21.15.62:0/3279834074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f362c0be0a0 msgr2=0x7f362c0b9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:26.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.675+0000 7f3630fb1640 1 --2- 172.21.15.62:0/3279834074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f362c0be0a0 0x7f362c0b9ad0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f362c070450 tx=0x7f362001c380 comp rx=0 tx=0).stop 2023-05-15T16:40:26.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.675+0000 7f3630fb1640 1 -- 172.21.15.62:0/3279834074 shutdown_connections 2023-05-15T16:40:26.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.675+0000 7f3630fb1640 1 --2- 172.21.15.62:0/3279834074 >> v2:172.21.15.161:3300/0 conn(0x7f362c0be4d0 0x7f362c0ba010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.675+0000 7f3630fb1640 1 --2- 172.21.15.62:0/3279834074 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f362c0be0a0 0x7f362c0b9ad0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.675+0000 7f3630fb1640 1 -- 172.21.15.62:0/3279834074 >> 172.21.15.62:0/3279834074 conn(0x7f362c06e480 msgr2=0x7f362c06e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:26.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.675+0000 7f3630fb1640 1 -- 172.21.15.62:0/3279834074 shutdown_connections 2023-05-15T16:40:26.682 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.675+0000 7f3630fb1640 1 -- 172.21.15.62:0/3279834074 wait complete. 2023-05-15T16:40:26.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f3630fb1640 1 Processor -- start 2023-05-15T16:40:26.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f3630fb1640 1 -- start start 2023-05-15T16:40:26.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f3630fb1640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f362c0be0a0 0x7f362c0b7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:26.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f3630fb1640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f362c0be4d0 0x7f362c1df6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:26.684 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f3630fb1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f362c1441b0 0x7f362c1dfbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:26.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f3630fb1640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c1d12b0 con 0x7f362c1441b0 2023-05-15T16:40:26.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f3630fb1640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c13e480 con 0x7f362c0be4d0 2023-05-15T16:40:26.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f3630fb1640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362c0b7640 con 0x7f362c0be0a0 2023-05-15T16:40:26.685 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f362ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f362c1441b0 0x7f362c1dfbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:26.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f362ad9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f362c1441b0 0x7f362c1dfbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46818/0 (socket says 172.21.15.62:46818) 2023-05-15T16:40:26.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f362ad9d640 1 -- 172.21.15.62:0/351660308 learned_addr learned my addr 172.21.15.62:0/351660308 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:26.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f362a59c640 1 --2- 172.21.15.62:0/351660308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f362c0be0a0 0x7f362c0b7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:26.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f3629d9b640 1 --2- 172.21.15.62:0/351660308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f362c0be4d0 0x7f362c1df6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:26.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f362ad9d640 1 -- 172.21.15.62:0/351660308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f362c0be0a0 msgr2=0x7f362c0b7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:26.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f362ad9d640 1 --2- 172.21.15.62:0/351660308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f362c0be0a0 0x7f362c0b7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.686 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f362ad9d640 1 -- 172.21.15.62:0/351660308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f362c0be4d0 msgr2=0x7f362c1df6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:26.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f362ad9d640 1 --2- 172.21.15.62:0/351660308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f362c0be4d0 0x7f362c1df6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f362ad9d640 1 -- 172.21.15.62:0/351660308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3620009420 con 0x7f362c1441b0 2023-05-15T16:40:26.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f362ad9d640 1 --2- 172.21.15.62:0/351660308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f362c1441b0 0x7f362c1dfbf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f362400cd70 tx=0x7f362400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:26.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f361affd640 1 -- 172.21.15.62:0/351660308 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624003ba0 con 0x7f362c1441b0 2023-05-15T16:40:26.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f361affd640 1 -- 172.21.15.62:0/351660308 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3624003d00 con 0x7f362c1441b0 2023-05-15T16:40:26.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f3630fb1640 1 -- 172.21.15.62:0/351660308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f362c06c160 con 0x7f362c1441b0 2023-05-15T16:40:26.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f361affd640 1 -- 172.21.15.62:0/351660308 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3624004240 con 0x7f362c1441b0 2023-05-15T16:40:26.687 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f3630fb1640 1 -- 172.21.15.62:0/351660308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f362c06be80 con 0x7f362c1441b0 2023-05-15T16:40:26.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.679+0000 7f3630fb1640 1 -- 172.21.15.62:0/351660308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362c06c440 con 0x7f362c1441b0 2023-05-15T16:40:26.688 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.683+0000 7f361affd640 1 -- 172.21.15.62:0/351660308 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f36240043a0 con 0x7f362c1441b0 2023-05-15T16:40:26.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.683+0000 7f361affd640 1 --2- 172.21.15.62:0/351660308 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f360c065380 0x7f360c067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:26.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.683+0000 7f361affd640 1 -- 172.21.15.62:0/351660308 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3624012070 con 0x7f362c1441b0 2023-05-15T16:40:26.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.683+0000 7f362a59c640 1 --2- 172.21.15.62:0/351660308 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f360c065380 0x7f360c067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:26.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.683+0000 7f362a59c640 1 --2- 172.21.15.62:0/351660308 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f360c065380 0x7f360c067830 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f361c009fd0 tx=0x7f361c00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:26.689 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.687+0000 7f361affd640 1 -- 172.21.15.62:0/351660308 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f3624050f10 con 0x7f362c1441b0 2023-05-15T16:40:26.845 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.839+0000 7f3630fb1640 1 -- 172.21.15.62:0/351660308 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f362c067960 con 0x7f362c1441b0 2023-05-15T16:40:26.846 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.843+0000 7f361affd640 1 -- 172.21.15.62:0/351660308 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3624054530 con 0x7f362c1441b0 2023-05-15T16:40:26.846 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-05-15T16:40:26.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.843+0000 7f3630fb1640 1 -- 172.21.15.62:0/351660308 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f360c065380 msgr2=0x7f360c067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:26.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.843+0000 7f3630fb1640 1 --2- 172.21.15.62:0/351660308 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f360c065380 0x7f360c067830 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f361c009fd0 tx=0x7f361c00b040 comp rx=0 tx=0).stop 2023-05-15T16:40:26.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.843+0000 7f3630fb1640 1 -- 172.21.15.62:0/351660308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f362c1441b0 msgr2=0x7f362c1dfbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:26.848 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.843+0000 7f3630fb1640 1 --2- 172.21.15.62:0/351660308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f362c1441b0 0x7f362c1dfbf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f362400cd70 tx=0x7f362400a660 comp rx=0 tx=0).stop 2023-05-15T16:40:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.843+0000 7f3630fb1640 1 -- 172.21.15.62:0/351660308 shutdown_connections 2023-05-15T16:40:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.843+0000 7f3630fb1640 1 --2- 172.21.15.62:0/351660308 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f360c065380 0x7f360c067830 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.843+0000 7f3630fb1640 1 --2- 172.21.15.62:0/351660308 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f362c1441b0 0x7f362c1dfbf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.843+0000 7f3630fb1640 1 --2- 172.21.15.62:0/351660308 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f362c0be4d0 0x7f362c1df6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.843+0000 7f3630fb1640 1 --2- 172.21.15.62:0/351660308 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f362c0be0a0 0x7f362c0b7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.843+0000 7f3630fb1640 1 -- 172.21.15.62:0/351660308 >> 172.21.15.62:0/351660308 conn(0x7f362c06e480 msgr2=0x7f362c140600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.843+0000 7f3630fb1640 1 -- 172.21.15.62:0/351660308 shutdown_connections 2023-05-15T16:40:26.849 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.843+0000 7f3630fb1640 1 -- 172.21.15.62:0/351660308 wait complete. 2023-05-15T16:40:26.865 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-15T16:40:26.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.979+0000 7f1a6982b640 1 Processor -- start 2023-05-15T16:40:26.984 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.979+0000 7f1a6982b640 1 -- start start 2023-05-15T16:40:26.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.979+0000 7f1a6982b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1a640b0dd0 0x7f1a640b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:26.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.979+0000 7f1a6982b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a640b5600 0x7f1a640b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:26.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.979+0000 7f1a6982b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a641467e0 con 0x7f1a640b65a0 2023-05-15T16:40:26.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.979+0000 7f1a6982b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a640b2ca0 con 0x7f1a640b0dd0 2023-05-15T16:40:26.985 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.979+0000 7f1a6982b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a640b3e10 con 0x7f1a640b5600 2023-05-15T16:40:26.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.983+0000 7f1a637fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a640b5600 0x7f1a640b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:26.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.983+0000 7f1a62ffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1a640b0dd0 0x7f1a640b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:26.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.983+0000 7f1a637fe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a640b5600 0x7f1a640b5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.62:42912/0 (socket says 172.21.15.62:42912) 2023-05-15T16:40:26.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.983+0000 7f1a637fe640 1 -- 172.21.15.62:0/2219094556 learned_addr learned my addr 172.21.15.62:0/2219094556 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:26.986 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.983+0000 7f1a5bfff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f1a640b65a0 0x7f1a64146c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.62:56338/0 (socket says 172.21.15.62:56338) 2023-05-15T16:40:26.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.983+0000 7f1a637fe640 1 -- 172.21.15.62:0/2219094556 >> v2:172.21.15.161:3300/0 conn(0x7f1a640b0dd0 msgr2=0x7f1a640b2200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:26.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.983+0000 7f1a637fe640 1 --2- 172.21.15.62:0/2219094556 >> v2:172.21.15.161:3300/0 conn(0x7f1a640b0dd0 0x7f1a640b2200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.983+0000 7f1a637fe640 1 -- 172.21.15.62:0/2219094556 >> v1:172.21.15.161:6789/0 conn(0x7f1a640b65a0 legacy=0x7f1a64146c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:26.987 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.983+0000 7f1a637fe640 1 -- 172.21.15.62:0/2219094556 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a640b2740 con 0x7f1a640b5600 2023-05-15T16:40:26.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.983+0000 7f1a637fe640 1 --2- 172.21.15.62:0/2219094556 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a640b5600 0x7f1a640b5a40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c009e80 tx=0x7f1a5c01c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a32bdb569bed5f11 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:26.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.983+0000 7f1a627fc640 1 -- 172.21.15.62:0/2219094556 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c0a5830 con 0x7f1a640b5600 2023-05-15T16:40:26.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.983+0000 7f1a627fc640 1 -- 172.21.15.62:0/2219094556 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c0a5990 con 0x7f1a640b5600 2023-05-15T16:40:26.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.983+0000 7f1a627fc640 1 -- 172.21.15.62:0/2219094556 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a5c0a5d20 con 0x7f1a640b5600 2023-05-15T16:40:26.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.983+0000 7f1a6982b640 1 -- 172.21.15.62:0/2219094556 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a640b5600 msgr2=0x7f1a640b5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:26.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.983+0000 7f1a6982b640 1 --2- 172.21.15.62:0/2219094556 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a640b5600 0x7f1a640b5a40 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c009e80 tx=0x7f1a5c01c9f0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.983+0000 7f1a6982b640 1 -- 172.21.15.62:0/2219094556 shutdown_connections 2023-05-15T16:40:26.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.983+0000 7f1a6982b640 1 --2- 172.21.15.62:0/2219094556 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a640b5600 0x7f1a640b5a40 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.983+0000 7f1a6982b640 1 --2- 172.21.15.62:0/2219094556 >> v2:172.21.15.161:3300/0 conn(0x7f1a640b0dd0 0x7f1a640b2200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.983+0000 7f1a6982b640 1 -- 172.21.15.62:0/2219094556 >> 172.21.15.62:0/2219094556 conn(0x7f1a640697b0 msgr2=0x7f1a64069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:26.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a6982b640 1 -- 172.21.15.62:0/2219094556 shutdown_connections 2023-05-15T16:40:26.990 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a6982b640 1 -- 172.21.15.62:0/2219094556 wait complete. 2023-05-15T16:40:26.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a6982b640 1 Processor -- start 2023-05-15T16:40:26.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a6982b640 1 -- start start 2023-05-15T16:40:26.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a6982b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a640b0dd0 0x7f1a641437c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:26.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a6982b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a640b5600 0x7f1a6406f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:26.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a6982b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a640b65a0 0x7f1a6406fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:26.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a6982b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a641e2b50 con 0x7f1a640b5600 2023-05-15T16:40:26.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a6982b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6409d7e0 con 0x7f1a640b65a0 2023-05-15T16:40:26.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a6982b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6409da50 con 0x7f1a640b0dd0 2023-05-15T16:40:26.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a5bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a640b5600 0x7f1a6406f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:26.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a5bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a640b5600 0x7f1a6406f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46832/0 (socket says 172.21.15.62:46832) 2023-05-15T16:40:26.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a5bfff640 1 -- 172.21.15.62:0/2983176263 learned_addr learned my addr 172.21.15.62:0/2983176263 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:26.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a62ffd640 1 --2- 172.21.15.62:0/2983176263 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a640b0dd0 0x7f1a641437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:26.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a637fe640 1 --2- 172.21.15.62:0/2983176263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a640b65a0 0x7f1a6406fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:26.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a5bfff640 1 -- 172.21.15.62:0/2983176263 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a640b0dd0 msgr2=0x7f1a641437c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:26.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a5bfff640 1 --2- 172.21.15.62:0/2983176263 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a640b0dd0 0x7f1a641437c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a5bfff640 1 -- 172.21.15.62:0/2983176263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a640b65a0 msgr2=0x7f1a6406fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:26.994 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a5bfff640 1 --2- 172.21.15.62:0/2983176263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a640b65a0 0x7f1a6406fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:26.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a5bfff640 1 -- 172.21.15.62:0/2983176263 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a5c009b30 con 0x7f1a640b5600 2023-05-15T16:40:26.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a5bfff640 1 --2- 172.21.15.62:0/2983176263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a640b5600 0x7f1a6406f850 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00c3c0 tx=0x7f1a4c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:26.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a60ff9640 1 -- 172.21.15.62:0/2983176263 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c0074e0 con 0x7f1a640b5600 2023-05-15T16:40:26.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a60ff9640 1 -- 172.21.15.62:0/2983176263 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a4c007640 con 0x7f1a640b5600 2023-05-15T16:40:26.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a6982b640 1 -- 172.21.15.62:0/2983176263 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a640b11a0 con 0x7f1a640b5600 2023-05-15T16:40:26.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a60ff9640 1 -- 172.21.15.62:0/2983176263 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a4c004a10 con 0x7f1a640b5600 2023-05-15T16:40:26.995 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a6982b640 1 -- 172.21.15.62:0/2983176263 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a64146470 con 0x7f1a640b5600 2023-05-15T16:40:26.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.987+0000 7f1a6982b640 1 -- 172.21.15.62:0/2983176263 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a640b5f80 con 0x7f1a640b5600 2023-05-15T16:40:26.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.991+0000 7f1a60ff9640 1 -- 172.21.15.62:0/2983176263 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f1a4c004b70 con 0x7f1a640b5600 2023-05-15T16:40:26.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.991+0000 7f1a60ff9640 1 --2- 172.21.15.62:0/2983176263 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1a440653b0 0x7f1a44067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:26.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.991+0000 7f1a60ff9640 1 -- 172.21.15.62:0/2983176263 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1a4c082a40 con 0x7f1a640b5600 2023-05-15T16:40:26.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.991+0000 7f1a62ffd640 1 --2- 172.21.15.62:0/2983176263 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1a440653b0 0x7f1a44067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:26.997 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.991+0000 7f1a62ffd640 1 --2- 172.21.15.62:0/2983176263 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1a440653b0 0x7f1a44067860 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009af0 tx=0x7f1a54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:26.998 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:26.995+0000 7f1a60ff9640 1 -- 172.21.15.62:0/2983176263 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f1a4c050620 con 0x7f1a640b5600 2023-05-15T16:40:27.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.151+0000 7f1a6982b640 1 -- 172.21.15.62:0/2983176263 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f1a64067960 con 0x7f1a640b5600 2023-05-15T16:40:27.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.151+0000 7f1a60ff9640 1 -- 172.21.15.62:0/2983176263 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f1a4c053c40 con 0x7f1a640b5600 2023-05-15T16:40:27.156 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-05-15T16:40:27.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.155+0000 7f1a6982b640 1 -- 172.21.15.62:0/2983176263 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1a440653b0 msgr2=0x7f1a44067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:27.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.155+0000 7f1a6982b640 1 --2- 172.21.15.62:0/2983176263 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1a440653b0 0x7f1a44067860 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f1a54009af0 tx=0x7f1a54008040 comp rx=0 tx=0).stop 2023-05-15T16:40:27.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.155+0000 7f1a6982b640 1 -- 172.21.15.62:0/2983176263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a640b5600 msgr2=0x7f1a6406f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:27.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.155+0000 7f1a6982b640 1 --2- 172.21.15.62:0/2983176263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a640b5600 0x7f1a6406f850 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f1a4c00c3c0 tx=0x7f1a4c00c880 comp rx=0 tx=0).stop 2023-05-15T16:40:27.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.155+0000 7f1a6982b640 1 -- 172.21.15.62:0/2983176263 shutdown_connections 2023-05-15T16:40:27.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.155+0000 7f1a6982b640 1 --2- 172.21.15.62:0/2983176263 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1a640b65a0 0x7f1a6406fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.155+0000 7f1a6982b640 1 --2- 172.21.15.62:0/2983176263 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1a440653b0 0x7f1a44067860 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.155+0000 7f1a6982b640 1 --2- 172.21.15.62:0/2983176263 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1a640b5600 0x7f1a6406f850 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.155+0000 7f1a6982b640 1 --2- 172.21.15.62:0/2983176263 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1a640b0dd0 0x7f1a641437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.155+0000 7f1a6982b640 1 -- 172.21.15.62:0/2983176263 >> 172.21.15.62:0/2983176263 conn(0x7f1a640697b0 msgr2=0x7f1a64070f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:27.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.155+0000 7f1a6982b640 1 -- 172.21.15.62:0/2983176263 shutdown_connections 2023-05-15T16:40:27.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.155+0000 7f1a6982b640 1 -- 172.21.15.62:0/2983176263 wait complete. 2023-05-15T16:40:27.174 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-15T16:40:27.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.287+0000 7f2050f59640 1 Processor -- start 2023-05-15T16:40:27.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.287+0000 7f2050f59640 1 -- start start 2023-05-15T16:40:27.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.287+0000 7f2050f59640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f204c0b4100 0x7f204c0b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:27.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.287+0000 7f2050f59640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0b3080 0x7f204c141c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:27.292 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.287+0000 7f2050f59640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f204c0b7400 con 0x7f204c1421b0 2023-05-15T16:40:27.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.287+0000 7f2050f59640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f204c0b4e70 con 0x7f204c0b4100 2023-05-15T16:40:27.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.287+0000 7f2050f59640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204c0b6640 con 0x7f204c0b3080 2023-05-15T16:40:27.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.287+0000 7f204a59c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f204c0b4100 0x7f204c0b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:27.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.287+0000 7f204ad9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f204c1421b0 0x7f204c147c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32790/0 (socket says 172.21.15.62:32790) 2023-05-15T16:40:27.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.287+0000 7f204ad9d640 1 -- 172.21.15.62:0/2625047462 learned_addr learned my addr 172.21.15.62:0/2625047462 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:27.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.287+0000 7f2049d9b640 1 --2- 172.21.15.62:0/2625047462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0b3080 0x7f204c141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:27.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.287+0000 7f204a59c640 1 -- 172.21.15.62:0/2625047462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0b3080 msgr2=0x7f204c141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:27.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.287+0000 7f204a59c640 1 --2- 172.21.15.62:0/2625047462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0b3080 0x7f204c141c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.287+0000 7f204a59c640 1 -- 172.21.15.62:0/2625047462 >> v1:172.21.15.62:6789/0 conn(0x7f204c1421b0 legacy=0x7f204c147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:27.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.287+0000 7f204a59c640 1 -- 172.21.15.62:0/2625047462 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f204c0b6920 con 0x7f204c0b4100 2023-05-15T16:40:27.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.287+0000 7f204959a640 1 -- 172.21.15.62:0/2625047462 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 776942480 0 0) 0x7f204c0b7400 con 0x7f204c1421b0 2023-05-15T16:40:27.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f204a59c640 1 --2- 172.21.15.62:0/2625047462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f204c0b4100 0x7f204c0b38a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f20440097c0 tx=0x7f204401c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eca641a3fba9aa49 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:27.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f204959a640 1 -- 172.21.15.62:0/2625047462 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20440ab650 con 0x7f204c0b4100 2023-05-15T16:40:27.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f204959a640 1 -- 172.21.15.62:0/2625047462 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20440ab7b0 con 0x7f204c0b4100 2023-05-15T16:40:27.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f204959a640 1 -- 172.21.15.62:0/2625047462 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20440abb40 con 0x7f204c0b4100 2023-05-15T16:40:27.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f2050f59640 1 -- 172.21.15.62:0/2625047462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f204c0b4100 msgr2=0x7f204c0b38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:27.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f2050f59640 1 --2- 172.21.15.62:0/2625047462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f204c0b4100 0x7f204c0b38a0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f20440097c0 tx=0x7f204401c450 comp rx=0 tx=0).stop 2023-05-15T16:40:27.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f2050f59640 1 -- 172.21.15.62:0/2625047462 shutdown_connections 2023-05-15T16:40:27.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f2050f59640 1 --2- 172.21.15.62:0/2625047462 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0b3080 0x7f204c141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f2050f59640 1 --2- 172.21.15.62:0/2625047462 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f204c0b4100 0x7f204c0b38a0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f2050f59640 1 -- 172.21.15.62:0/2625047462 >> 172.21.15.62:0/2625047462 conn(0x7f204c0697b0 msgr2=0x7f204c069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:27.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f2050f59640 1 -- 172.21.15.62:0/2625047462 shutdown_connections 2023-05-15T16:40:27.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f2050f59640 1 -- 172.21.15.62:0/2625047462 wait complete. 2023-05-15T16:40:27.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f2050f59640 1 Processor -- start 2023-05-15T16:40:27.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f2050f59640 1 -- start start 2023-05-15T16:40:27.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f2050f59640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f204c0b3080 0x7f204c146d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:27.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f2050f59640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0b4100 0x7f204c070720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:27.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f2050f59640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f204c1421b0 0x7f204c131e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:27.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f2050f59640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c144c10 con 0x7f204c0b3080 2023-05-15T16:40:27.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f2050f59640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f204c147250 con 0x7f204c1421b0 2023-05-15T16:40:27.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f2050f59640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f204c143a90 con 0x7f204c0b4100 2023-05-15T16:40:27.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f204a59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f204c0b3080 0x7f204c146d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:27.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f204a59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f204c0b3080 0x7f204c146d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46848/0 (socket says 172.21.15.62:46848) 2023-05-15T16:40:27.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f204a59c640 1 -- 172.21.15.62:0/75050864 learned_addr learned my addr 172.21.15.62:0/75050864 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:27.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f2049d9b640 1 --2- 172.21.15.62:0/75050864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0b4100 0x7f204c070720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:27.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f204ad9d640 1 --2- 172.21.15.62:0/75050864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f204c1421b0 0x7f204c131e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:27.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f204a59c640 1 -- 172.21.15.62:0/75050864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0b4100 msgr2=0x7f204c070720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:27.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f204a59c640 1 --2- 172.21.15.62:0/75050864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0b4100 0x7f204c070720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f204a59c640 1 -- 172.21.15.62:0/75050864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f204c1421b0 msgr2=0x7f204c131e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:27.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f204a59c640 1 --2- 172.21.15.62:0/75050864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f204c1421b0 0x7f204c131e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f204a59c640 1 -- 172.21.15.62:0/75050864 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2044009420 con 0x7f204c0b3080 2023-05-15T16:40:27.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.291+0000 7f204a59c640 1 --2- 172.21.15.62:0/75050864 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f204c0b3080 0x7f204c146d10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f204401ab00 tx=0x7f204401ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:27.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.295+0000 7f203affd640 1 -- 172.21.15.62:0/75050864 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2044004220 con 0x7f204c0b3080 2023-05-15T16:40:27.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.295+0000 7f203affd640 1 -- 172.21.15.62:0/75050864 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20440b9070 con 0x7f204c0b3080 2023-05-15T16:40:27.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.295+0000 7f2050f59640 1 -- 172.21.15.62:0/75050864 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f204c0b44d0 con 0x7f204c0b3080 2023-05-15T16:40:27.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.295+0000 7f203affd640 1 -- 172.21.15.62:0/75050864 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2044003620 con 0x7f204c0b3080 2023-05-15T16:40:27.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.295+0000 7f2050f59640 1 -- 172.21.15.62:0/75050864 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f204c148340 con 0x7f204c0b3080 2023-05-15T16:40:27.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.295+0000 7f2050f59640 1 -- 172.21.15.62:0/75050864 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f204c0a1dc0 con 0x7f204c0b3080 2023-05-15T16:40:27.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.295+0000 7f203affd640 1 -- 172.21.15.62:0/75050864 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f2044003990 con 0x7f204c0b3080 2023-05-15T16:40:27.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.295+0000 7f203affd640 1 --2- 172.21.15.62:0/75050864 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f202c065380 0x7f202c067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:27.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.295+0000 7f203affd640 1 -- 172.21.15.62:0/75050864 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f20440bb070 con 0x7f204c0b3080 2023-05-15T16:40:27.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.295+0000 7f2049d9b640 1 --2- 172.21.15.62:0/75050864 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f202c065380 0x7f202c067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:27.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.295+0000 7f2049d9b640 1 --2- 172.21.15.62:0/75050864 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f202c065380 0x7f202c067830 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f204c071760 tx=0x7f2040008460 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:27.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.299+0000 7f203affd640 1 -- 172.21.15.62:0/75050864 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f20440eb4b0 con 0x7f204c0b3080 2023-05-15T16:40:27.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.451+0000 7f2050f59640 1 -- 172.21.15.62:0/75050864 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f204c0b57e0 con 0x7f204c0b3080 2023-05-15T16:40:27.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.451+0000 7f203affd640 1 -- 172.21.15.62:0/75050864 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7f20440c4020 con 0x7f204c0b3080 2023-05-15T16:40:27.454 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-05-15T16:40:27.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.451+0000 7f2050f59640 1 -- 172.21.15.62:0/75050864 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f202c065380 msgr2=0x7f202c067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:27.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.451+0000 7f2050f59640 1 --2- 172.21.15.62:0/75050864 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f202c065380 0x7f202c067830 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f204c071760 tx=0x7f2040008460 comp rx=0 tx=0).stop 2023-05-15T16:40:27.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.451+0000 7f2050f59640 1 -- 172.21.15.62:0/75050864 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f204c0b3080 msgr2=0x7f204c146d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:27.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.451+0000 7f2050f59640 1 --2- 172.21.15.62:0/75050864 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f204c0b3080 0x7f204c146d10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f204401ab00 tx=0x7f204401ac90 comp rx=0 tx=0).stop 2023-05-15T16:40:27.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.451+0000 7f2050f59640 1 -- 172.21.15.62:0/75050864 shutdown_connections 2023-05-15T16:40:27.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.451+0000 7f2050f59640 1 --2- 172.21.15.62:0/75050864 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f204c1421b0 0x7f204c131e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.451+0000 7f2050f59640 1 --2- 172.21.15.62:0/75050864 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f204c0b4100 0x7f204c070720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.451+0000 7f2050f59640 1 --2- 172.21.15.62:0/75050864 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f202c065380 0x7f202c067830 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.451+0000 7f2050f59640 1 --2- 172.21.15.62:0/75050864 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f204c0b3080 0x7f204c146d10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.451+0000 7f2050f59640 1 -- 172.21.15.62:0/75050864 >> 172.21.15.62:0/75050864 conn(0x7f204c0697b0 msgr2=0x7f204c13d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:27.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.451+0000 7f2050f59640 1 -- 172.21.15.62:0/75050864 shutdown_connections 2023-05-15T16:40:27.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.451+0000 7f2050f59640 1 -- 172.21.15.62:0/75050864 wait complete. 2023-05-15T16:40:27.473 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-15T16:40:27.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.599+0000 7fb2a7fbe640 1 Processor -- start 2023-05-15T16:40:27.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.599+0000 7fb2a7fbe640 1 -- start start 2023-05-15T16:40:27.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.599+0000 7fb2a7fbe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2a00b4100 0x7fb2a00b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:27.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.599+0000 7fb2a7fbe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb2a0147c30 0x7fb2a01524f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:27.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.599+0000 7fb2a7fbe640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2a00b7400 con 0x7fb2a00b3080 2023-05-15T16:40:27.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.599+0000 7fb2a7fbe640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a00b4e70 con 0x7fb2a0147c30 2023-05-15T16:40:27.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.599+0000 7fb2a7fbe640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a0142380 con 0x7fb2a00b4100 2023-05-15T16:40:27.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.599+0000 7fb2a655b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb2a0147c30 0x7fb2a01524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:27.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.599+0000 7fb2a655b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fb2a0147c30 0x7fb2a01524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46862/0 (socket says 172.21.15.62:46862) 2023-05-15T16:40:27.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.599+0000 7fb2a655b640 1 -- 172.21.15.62:0/764880889 learned_addr learned my addr 172.21.15.62:0/764880889 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:27.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.599+0000 7fb2a5559640 1 --1- 172.21.15.62:0/764880889 >> v1:172.21.15.62:6789/0 conn(0x7fb2a00b3080 0x7fb2a0141c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32798/0 (socket says 172.21.15.62:32798) 2023-05-15T16:40:27.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.599+0000 7fb2a655b640 1 -- 172.21.15.62:0/764880889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2a00b4100 msgr2=0x7fb2a00b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:27.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.599+0000 7fb2a5d5a640 1 --2- 172.21.15.62:0/764880889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2a00b4100 0x7fb2a00b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:27.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.599+0000 7fb2a4d58640 1 -- 172.21.15.62:0/764880889 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106436880 0 0) 0x7fb2a00b7400 con 0x7fb2a00b3080 2023-05-15T16:40:27.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.599+0000 7fb2a655b640 1 --2- 172.21.15.62:0/764880889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2a00b4100 0x7fb2a00b38a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.599+0000 7fb2a655b640 1 -- 172.21.15.62:0/764880889 >> v1:172.21.15.62:6789/0 conn(0x7fb2a00b3080 legacy=0x7fb2a0141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:27.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.599+0000 7fb2a655b640 1 -- 172.21.15.62:0/764880889 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a00b6640 con 0x7fb2a0147c30 2023-05-15T16:40:27.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a655b640 1 --2- 172.21.15.62:0/764880889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2a0147c30 0x7fb2a01524f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb298009e50 tx=0x7fb29801c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14627317455aa1db server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:27.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a4d58640 1 -- 172.21.15.62:0/764880889 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2980a58a0 con 0x7fb2a0147c30 2023-05-15T16:40:27.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a4d58640 1 -- 172.21.15.62:0/764880889 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2980a5a00 con 0x7fb2a0147c30 2023-05-15T16:40:27.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a4d58640 1 -- 172.21.15.62:0/764880889 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2980a5d90 con 0x7fb2a0147c30 2023-05-15T16:40:27.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a7fbe640 1 -- 172.21.15.62:0/764880889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2a0147c30 msgr2=0x7fb2a01524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:27.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a7fbe640 1 --2- 172.21.15.62:0/764880889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2a0147c30 0x7fb2a01524f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fb298009e50 tx=0x7fb29801c9e0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a7fbe640 1 -- 172.21.15.62:0/764880889 shutdown_connections 2023-05-15T16:40:27.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a7fbe640 1 --2- 172.21.15.62:0/764880889 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2a0147c30 0x7fb2a01524f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a7fbe640 1 --2- 172.21.15.62:0/764880889 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2a00b4100 0x7fb2a00b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a7fbe640 1 -- 172.21.15.62:0/764880889 >> 172.21.15.62:0/764880889 conn(0x7fb2a00697b0 msgr2=0x7fb2a0069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:27.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a7fbe640 1 -- 172.21.15.62:0/764880889 shutdown_connections 2023-05-15T16:40:27.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a7fbe640 1 -- 172.21.15.62:0/764880889 wait complete. 2023-05-15T16:40:27.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a7fbe640 1 Processor -- start 2023-05-15T16:40:27.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a7fbe640 1 -- start start 2023-05-15T16:40:27.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a7fbe640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a00b3080 0x7fb2a0070dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:27.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a7fbe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2a00b4100 0x7fb2a0142580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:27.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a7fbe640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2a0147c30 0x7fb2a01e35a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:27.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a7fbe640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a0071310 con 0x7fb2a00b4100 2023-05-15T16:40:27.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a7fbe640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a0143020 con 0x7fb2a00b3080 2023-05-15T16:40:27.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a7fbe640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a0145df0 con 0x7fb2a0147c30 2023-05-15T16:40:27.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a5559640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2a00b4100 0x7fb2a0142580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:27.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a5559640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2a00b4100 0x7fb2a0142580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46866/0 (socket says 172.21.15.62:46866) 2023-05-15T16:40:27.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a5559640 1 -- 172.21.15.62:0/3011531861 learned_addr learned my addr 172.21.15.62:0/3011531861 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:27.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a5559640 1 -- 172.21.15.62:0/3011531861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2a0147c30 msgr2=0x7fb2a01e35a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:27.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a5559640 1 --2- 172.21.15.62:0/3011531861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2a0147c30 0x7fb2a01e35a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a5559640 1 -- 172.21.15.62:0/3011531861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a00b3080 msgr2=0x7fb2a0070dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:27.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a5559640 1 --2- 172.21.15.62:0/3011531861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a00b3080 0x7fb2a0070dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a5559640 1 -- 172.21.15.62:0/3011531861 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb298009b30 con 0x7fb2a00b4100 2023-05-15T16:40:27.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a5559640 1 --2- 172.21.15.62:0/3011531861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2a00b4100 0x7fb2a0142580 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb29000c4b0 tx=0x7fb29000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:27.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2967fc640 1 -- 172.21.15.62:0/3011531861 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2900074e0 con 0x7fb2a00b4100 2023-05-15T16:40:27.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2967fc640 1 -- 172.21.15.62:0/3011531861 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb290007660 con 0x7fb2a00b4100 2023-05-15T16:40:27.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a7fbe640 1 -- 172.21.15.62:0/3011531861 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a00b44d0 con 0x7fb2a00b4100 2023-05-15T16:40:27.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2967fc640 1 -- 172.21.15.62:0/3011531861 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb290004a30 con 0x7fb2a00b4100 2023-05-15T16:40:27.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.603+0000 7fb2a7fbe640 1 -- 172.21.15.62:0/3011531861 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a00b6ee0 con 0x7fb2a00b4100 2023-05-15T16:40:27.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.607+0000 7fb2a7fbe640 1 -- 172.21.15.62:0/3011531861 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a00a1dc0 con 0x7fb2a00b4100 2023-05-15T16:40:27.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.607+0000 7fb2967fc640 1 -- 172.21.15.62:0/3011531861 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fb290004b90 con 0x7fb2a00b4100 2023-05-15T16:40:27.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.607+0000 7fb2967fc640 1 --2- 172.21.15.62:0/3011531861 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb284065380 0x7fb284067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:27.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.607+0000 7fb2967fc640 1 -- 172.21.15.62:0/3011531861 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fb290081d10 con 0x7fb2a00b4100 2023-05-15T16:40:27.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.607+0000 7fb2a5d5a640 1 --2- 172.21.15.62:0/3011531861 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb284065380 0x7fb284067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:27.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.607+0000 7fb2a5d5a640 1 --2- 172.21.15.62:0/3011531861 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb284065380 0x7fb284067830 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00a8b0 tx=0x7fb29c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:27.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.611+0000 7fb2967fc640 1 -- 172.21.15.62:0/3011531861 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fb29004fa50 con 0x7fb2a00b4100 2023-05-15T16:40:27.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.763+0000 7fb2a7fbe640 1 -- 172.21.15.62:0/3011531861 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb2a004dbe0 con 0x7fb2a00b4100 2023-05-15T16:40:27.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.763+0000 7fb2967fc640 1 -- 172.21.15.62:0/3011531861 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb290053070 con 0x7fb2a00b4100 2023-05-15T16:40:27.767 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-05-15T16:40:27.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.763+0000 7fb2a7fbe640 1 -- 172.21.15.62:0/3011531861 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb284065380 msgr2=0x7fb284067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:27.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.763+0000 7fb2a7fbe640 1 --2- 172.21.15.62:0/3011531861 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb284065380 0x7fb284067830 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb29c00a8b0 tx=0x7fb29c008040 comp rx=0 tx=0).stop 2023-05-15T16:40:27.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.763+0000 7fb2a7fbe640 1 -- 172.21.15.62:0/3011531861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2a00b4100 msgr2=0x7fb2a0142580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:27.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.763+0000 7fb2a7fbe640 1 --2- 172.21.15.62:0/3011531861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2a00b4100 0x7fb2a0142580 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb29000c4b0 tx=0x7fb29000c970 comp rx=0 tx=0).stop 2023-05-15T16:40:27.771 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.763+0000 7fb2a7fbe640 1 -- 172.21.15.62:0/3011531861 shutdown_connections 2023-05-15T16:40:27.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.763+0000 7fb2a7fbe640 1 --2- 172.21.15.62:0/3011531861 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fb2a0147c30 0x7fb2a01e35a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.763+0000 7fb2a7fbe640 1 --2- 172.21.15.62:0/3011531861 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fb284065380 0x7fb284067830 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.763+0000 7fb2a7fbe640 1 --2- 172.21.15.62:0/3011531861 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fb2a00b4100 0x7fb2a0142580 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.763+0000 7fb2a7fbe640 1 --2- 172.21.15.62:0/3011531861 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fb2a00b3080 0x7fb2a0070dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.763+0000 7fb2a7fbe640 1 -- 172.21.15.62:0/3011531861 >> 172.21.15.62:0/3011531861 conn(0x7fb2a00697b0 msgr2=0x7fb2a0147230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:27.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.763+0000 7fb2a7fbe640 1 -- 172.21.15.62:0/3011531861 shutdown_connections 2023-05-15T16:40:27.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.763+0000 7fb2a7fbe640 1 -- 172.21.15.62:0/3011531861 wait complete. 2023-05-15T16:40:27.785 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-05-15T16:40:27.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82eb09b640 1 Processor -- start 2023-05-15T16:40:27.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82eb09b640 1 -- start start 2023-05-15T16:40:27.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82eb09b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f82e406b050 0x7f82e414a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:27.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82eb09b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e4149d30 con 0x7f82e40bd140 2023-05-15T16:40:27.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82eb09b640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e406b5e0 con 0x7f82e40bcd70 2023-05-15T16:40:27.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82eb09b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e406b8c0 con 0x7f82e406b050 2023-05-15T16:40:27.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82e9638640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f82e40bd140 0x7f82e41544d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32804/0 (socket says 172.21.15.62:32804) 2023-05-15T16:40:27.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82e9638640 1 -- 172.21.15.62:0/412760798 learned_addr learned my addr 172.21.15.62:0/412760798 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:27.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82e3fff640 1 --2- 172.21.15.62:0/412760798 >> v2:172.21.15.161:3300/0 conn(0x7f82e406b050 0x7f82e414a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:27.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82e37fe640 1 -- 172.21.15.62:0/412760798 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570785845 0 0) 0x7f82e4149d30 con 0x7f82e40bd140 2023-05-15T16:40:27.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82e37fe640 1 -- 172.21.15.62:0/412760798 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82d0003530 con 0x7f82e40bd140 2023-05-15T16:40:27.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82e37fe640 1 -- 172.21.15.62:0/412760798 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3002652450 0 0) 0x7f82e406b5e0 con 0x7f82e40bcd70 2023-05-15T16:40:27.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82e37fe640 1 -- 172.21.15.62:0/412760798 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82e4149d30 con 0x7f82e40bcd70 2023-05-15T16:40:27.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82e37fe640 1 -- 172.21.15.62:0/412760798 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2930093286 0 0) 0x7f82d0003530 con 0x7f82e40bd140 2023-05-15T16:40:27.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82e37fe640 1 -- 172.21.15.62:0/412760798 >> v2:172.21.15.161:3300/0 conn(0x7f82e406b050 msgr2=0x7f82e414a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:27.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82e37fe640 1 --2- 172.21.15.62:0/412760798 >> v2:172.21.15.161:3300/0 conn(0x7f82e406b050 0x7f82e414a1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82e37fe640 1 -- 172.21.15.62:0/412760798 >> v1:172.21.15.161:6789/0 conn(0x7f82e40bcd70 legacy=0x7f82e40badc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:27.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82e37fe640 1 -- 172.21.15.62:0/412760798 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e406bba0 con 0x7f82e40bd140 2023-05-15T16:40:27.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82e37fe640 1 -- 172.21.15.62:0/412760798 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7f82d4001680 con 0x7f82e40bd140 2023-05-15T16:40:27.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82e37fe640 1 -- 172.21.15.62:0/412760798 >> v1:172.21.15.62:6789/0 conn(0x7f82e40bd140 legacy=0x7f82e41544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:27.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82e37fe640 1 --2- 172.21.15.62:0/412760798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82d0003b40 0x7f82d0003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:27.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82e37fe640 1 --2- 172.21.15.62:0/412760798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82d00047d0 0x7f82d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:27.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82e37fe640 1 --2- 172.21.15.62:0/412760798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82d0005180 0x7f82d000b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:27.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82e37fe640 1 -- 172.21.15.62:0/412760798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e406b8c0 con 0x7f82d00047d0 2023-05-15T16:40:27.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82e37fe640 1 -- 172.21.15.62:0/412760798 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d000c010 con 0x7f82d0005180 2023-05-15T16:40:27.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82e37fe640 1 -- 172.21.15.62:0/412760798 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82d000c1d0 con 0x7f82d0003b40 2023-05-15T16:40:27.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.907+0000 7f82e3fff640 1 --2- 172.21.15.62:0/412760798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82d00047d0 0x7f82d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:27.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.911+0000 7f82e9638640 1 --2- 172.21.15.62:0/412760798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82d0005180 0x7f82d000b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:27.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.911+0000 7f82e8e37640 1 --2- 172.21.15.62:0/412760798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82d0003b40 0x7f82d0003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:27.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.911+0000 7f82e3fff640 1 -- 172.21.15.62:0/412760798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82d0003b40 msgr2=0x7f82d0003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:27.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.911+0000 7f82e3fff640 1 --2- 172.21.15.62:0/412760798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82d0003b40 0x7f82d0003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.911+0000 7f82e3fff640 1 -- 172.21.15.62:0/412760798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82d0005180 msgr2=0x7f82d000b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:27.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.911+0000 7f82e3fff640 1 --2- 172.21.15.62:0/412760798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82d0005180 0x7f82d000b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.911+0000 7f82e9638640 1 -- 172.21.15.62:0/412760798 reap_dead start 2023-05-15T16:40:27.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.911+0000 7f82e3fff640 1 -- 172.21.15.62:0/412760798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d0003530 con 0x7f82d00047d0 2023-05-15T16:40:27.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.911+0000 7f82e8e37640 1 --2- 172.21.15.62:0/412760798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82d0003b40 0x7f82d0003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:27.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.911+0000 7f82e3fff640 1 --2- 172.21.15.62:0/412760798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82d00047d0 0x7f82d0004c40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009ae0 tx=0x7f82cc01ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719c649bdeb2a5e0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:27.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.911+0000 7f82e37fe640 1 -- 172.21.15.62:0/412760798 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0a5640 con 0x7f82d00047d0 2023-05-15T16:40:27.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.911+0000 7f82e37fe640 1 -- 172.21.15.62:0/412760798 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82cc0a57a0 con 0x7f82d00047d0 2023-05-15T16:40:27.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.911+0000 7f82e37fe640 1 -- 172.21.15.62:0/412760798 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82cc0a5b50 con 0x7f82d00047d0 2023-05-15T16:40:27.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.911+0000 7f82eb09b640 1 -- 172.21.15.62:0/412760798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82d00047d0 msgr2=0x7f82d0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:27.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.911+0000 7f82eb09b640 1 --2- 172.21.15.62:0/412760798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82d00047d0 0x7f82d0004c40 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f82cc009ae0 tx=0x7f82cc01ca50 comp rx=0 tx=0).stop 2023-05-15T16:40:27.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.911+0000 7f82eb09b640 1 -- 172.21.15.62:0/412760798 shutdown_connections 2023-05-15T16:40:27.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.911+0000 7f82eb09b640 1 --2- 172.21.15.62:0/412760798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82d00047d0 0x7f82d0004c40 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.911+0000 7f82eb09b640 1 -- 172.21.15.62:0/412760798 >> 172.21.15.62:0/412760798 conn(0x7f82e40bff80 msgr2=0x7f82e40c0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:27.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.911+0000 7f82eb09b640 1 -- 172.21.15.62:0/412760798 shutdown_connections 2023-05-15T16:40:27.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.911+0000 7f82eb09b640 1 -- 172.21.15.62:0/412760798 wait complete. 2023-05-15T16:40:27.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82eb09b640 1 Processor -- start 2023-05-15T16:40:27.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82eb09b640 1 -- start start 2023-05-15T16:40:27.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82eb09b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82d00047d0 0x7f82e41464f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:27.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82eb09b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82e4147ba0 0x7f82e40b14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:27.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82eb09b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82e4145810 0x7f82e4148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:27.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82eb09b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e4149260 con 0x7f82d00047d0 2023-05-15T16:40:27.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82eb09b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e40b1a00 con 0x7f82e4147ba0 2023-05-15T16:40:27.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82eb09b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e4144e00 con 0x7f82e4145810 2023-05-15T16:40:27.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82e8e37640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82d00047d0 0x7f82e41464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:27.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82e8e37640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82d00047d0 0x7f82e41464f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46888/0 (socket says 172.21.15.62:46888) 2023-05-15T16:40:27.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82e8e37640 1 -- 172.21.15.62:0/14310210 learned_addr learned my addr 172.21.15.62:0/14310210 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:27.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82e3fff640 1 --2- 172.21.15.62:0/14310210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82e4147ba0 0x7f82e40b14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:27.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82e9638640 1 --2- 172.21.15.62:0/14310210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82e4145810 0x7f82e4148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:27.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82e8e37640 1 -- 172.21.15.62:0/14310210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82e4145810 msgr2=0x7f82e4148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:27.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82e8e37640 1 --2- 172.21.15.62:0/14310210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82e4145810 0x7f82e4148320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82e8e37640 1 -- 172.21.15.62:0/14310210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82e4147ba0 msgr2=0x7f82e40b14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:27.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82e8e37640 1 --2- 172.21.15.62:0/14310210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82e4147ba0 0x7f82e40b14c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:27.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82e8e37640 1 -- 172.21.15.62:0/14310210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e40badc0 con 0x7f82d00047d0 2023-05-15T16:40:27.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82e8e37640 1 --2- 172.21.15.62:0/14310210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82d00047d0 0x7f82e41464f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f82dc004960 tx=0x7f82dc00e1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:27.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82e17fa640 1 -- 172.21.15.62:0/14310210 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc006b60 con 0x7f82d00047d0 2023-05-15T16:40:27.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82e17fa640 1 -- 172.21.15.62:0/14310210 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82dc006cc0 con 0x7f82d00047d0 2023-05-15T16:40:27.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82eb09b640 1 -- 172.21.15.62:0/14310210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82e41475d0 con 0x7f82d00047d0 2023-05-15T16:40:27.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82e17fa640 1 -- 172.21.15.62:0/14310210 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f82dc00ebe0 con 0x7f82d00047d0 2023-05-15T16:40:27.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82eb09b640 1 -- 172.21.15.62:0/14310210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e40baf50 con 0x7f82d00047d0 2023-05-15T16:40:27.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82eb09b640 1 -- 172.21.15.62:0/14310210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e4067960 con 0x7f82d00047d0 2023-05-15T16:40:27.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82e17fa640 1 -- 172.21.15.62:0/14310210 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f82dc00ed40 con 0x7f82d00047d0 2023-05-15T16:40:27.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82e17fa640 1 --2- 172.21.15.62:0/14310210 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f82c4065380 0x7f82c4067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:27.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.915+0000 7f82e17fa640 1 -- 172.21.15.62:0/14310210 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f82dc085ae0 con 0x7f82d00047d0 2023-05-15T16:40:27.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.919+0000 7f82e3fff640 1 --2- 172.21.15.62:0/14310210 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f82c4065380 0x7f82c4067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:27.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.919+0000 7f82e3fff640 1 --2- 172.21.15.62:0/14310210 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f82c4065380 0x7f82c4067830 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0af000 tx=0x7f82cc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:27.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:27.919+0000 7f82e17fa640 1 -- 172.21.15.62:0/14310210 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f82dc053760 con 0x7f82d00047d0 2023-05-15T16:40:28.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.079+0000 7f82eb09b640 1 -- 172.21.15.62:0/14310210 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f82e409f200 con 0x7f82d00047d0 2023-05-15T16:40:28.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.079+0000 7f82e17fa640 1 -- 172.21.15.62:0/14310210 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) v1 ==== 80+0+0 (secure 0 0 0) 0x7f82dc019080 con 0x7f82d00047d0 2023-05-15T16:40:28.087 INFO:teuthology.orchestra.run.smithi062.stderr:listed 0 entries 2023-05-15T16:40:28.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.083+0000 7f82eb09b640 1 -- 172.21.15.62:0/14310210 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f82c4065380 msgr2=0x7f82c4067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:28.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.083+0000 7f82eb09b640 1 --2- 172.21.15.62:0/14310210 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f82c4065380 0x7f82c4067830 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f82cc0af000 tx=0x7f82cc008040 comp rx=0 tx=0).stop 2023-05-15T16:40:28.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.083+0000 7f82eb09b640 1 -- 172.21.15.62:0/14310210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82d00047d0 msgr2=0x7f82e41464f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:28.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.083+0000 7f82eb09b640 1 --2- 172.21.15.62:0/14310210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82d00047d0 0x7f82e41464f0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f82dc004960 tx=0x7f82dc00e1b0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.083+0000 7f82eb09b640 1 -- 172.21.15.62:0/14310210 shutdown_connections 2023-05-15T16:40:28.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.083+0000 7f82eb09b640 1 --2- 172.21.15.62:0/14310210 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f82e4145810 0x7f82e4148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.083+0000 7f82eb09b640 1 --2- 172.21.15.62:0/14310210 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f82e4147ba0 0x7f82e40b14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.083+0000 7f82eb09b640 1 --2- 172.21.15.62:0/14310210 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f82c4065380 0x7f82c4067830 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.083+0000 7f82eb09b640 1 --2- 172.21.15.62:0/14310210 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f82d00047d0 0x7f82e41464f0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.083+0000 7f82eb09b640 1 -- 172.21.15.62:0/14310210 >> 172.21.15.62:0/14310210 conn(0x7f82e40bff80 msgr2=0x7f82e40bb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:28.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.083+0000 7f82eb09b640 1 -- 172.21.15.62:0/14310210 shutdown_connections 2023-05-15T16:40:28.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.083+0000 7f82eb09b640 1 -- 172.21.15.62:0/14310210 wait complete. 2023-05-15T16:40:28.102 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-05-15T16:40:28.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:28.103 DEBUG:teuthology.orchestra.run.smithi171:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-05-15T16:40:28.179 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi171.front.sepia.ceph.com 2023-05-15T16:40:28.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:28.180 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-05-15T16:40:28.197 INFO:tasks.cephfs.cephfs_test_case:[] 2023-05-15T16:40:28.198 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-15T16:40:28.324 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.319+0000 7f76344c3640 1 Processor -- start 2023-05-15T16:40:28.324 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.319+0000 7f76344c3640 1 -- start start 2023-05-15T16:40:28.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.319+0000 7f76344c3640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f762c0bccd0 0x7f762c0bb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:28.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.319+0000 7f76344c3640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f762c069b30 0x7f762c143e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:28.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.319+0000 7f76344c3640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f762c144380 0x7f762c0bbcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:28.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.319+0000 7f76344c3640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762c06bae0 con 0x7f762c144380 2023-05-15T16:40:28.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.319+0000 7f76344c3640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f762c1447e0 con 0x7f762c0bccd0 2023-05-15T16:40:28.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.319+0000 7f76344c3640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762c0baca0 con 0x7f762c069b30 2023-05-15T16:40:28.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f7632a60640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f762c144380 0x7f762c0bbcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:28.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f7632a60640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f762c144380 0x7f762c0bbcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46892/0 (socket says 172.21.15.62:46892) 2023-05-15T16:40:28.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f7632a60640 1 -- 172.21.15.62:0/2070634223 learned_addr learned my addr 172.21.15.62:0/2070634223 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:28.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f7631a5e640 1 --2- 172.21.15.62:0/2070634223 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f762c069b30 0x7f762c143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:28.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f763225f640 1 --2- 172.21.15.62:0/2070634223 >> v2:172.21.15.161:3300/0 conn(0x7f762c0bccd0 0x7f762c0bb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:28.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f7632a60640 1 -- 172.21.15.62:0/2070634223 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f762c069b30 msgr2=0x7f762c143e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:28.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f7632a60640 1 --2- 172.21.15.62:0/2070634223 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f762c069b30 0x7f762c143e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f7632a60640 1 -- 172.21.15.62:0/2070634223 >> v2:172.21.15.161:3300/0 conn(0x7f762c0bccd0 msgr2=0x7f762c0bb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:28.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f7632a60640 1 --2- 172.21.15.62:0/2070634223 >> v2:172.21.15.161:3300/0 conn(0x7f762c0bccd0 0x7f762c0bb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f7632a60640 1 -- 172.21.15.62:0/2070634223 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f762c06b420 con 0x7f762c144380 2023-05-15T16:40:28.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f7632a60640 1 --2- 172.21.15.62:0/2070634223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f762c144380 0x7f762c0bbcd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f762c0bd560 tx=0x7f762401c9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ab578e355532260 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:28.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f763125d640 1 -- 172.21.15.62:0/2070634223 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76240a5720 con 0x7f762c144380 2023-05-15T16:40:28.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f763125d640 1 -- 172.21.15.62:0/2070634223 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76240a5880 con 0x7f762c144380 2023-05-15T16:40:28.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f763125d640 1 -- 172.21.15.62:0/2070634223 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76240a5c10 con 0x7f762c144380 2023-05-15T16:40:28.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f76344c3640 1 -- 172.21.15.62:0/2070634223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f762c144380 msgr2=0x7f762c0bbcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:28.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f76344c3640 1 --2- 172.21.15.62:0/2070634223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f762c144380 0x7f762c0bbcd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f762c0bd560 tx=0x7f762401c9d0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f76344c3640 1 -- 172.21.15.62:0/2070634223 shutdown_connections 2023-05-15T16:40:28.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f76344c3640 1 --2- 172.21.15.62:0/2070634223 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f762c144380 0x7f762c0bbcd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f76344c3640 1 --2- 172.21.15.62:0/2070634223 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f762c069b30 0x7f762c143e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f76344c3640 1 --2- 172.21.15.62:0/2070634223 >> v2:172.21.15.161:3300/0 conn(0x7f762c0bccd0 0x7f762c0bb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f76344c3640 1 -- 172.21.15.62:0/2070634223 >> 172.21.15.62:0/2070634223 conn(0x7f762c0a1ad0 msgr2=0x7f762c0a1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:28.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f76344c3640 1 -- 172.21.15.62:0/2070634223 shutdown_connections 2023-05-15T16:40:28.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.323+0000 7f76344c3640 1 -- 172.21.15.62:0/2070634223 wait complete. 2023-05-15T16:40:28.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f76344c3640 1 Processor -- start 2023-05-15T16:40:28.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f76344c3640 1 -- start start 2023-05-15T16:40:28.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f76344c3640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f762c069b30 0x7f762c0b1430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:28.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f76344c3640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f762c0bccd0 0x7f762c1498f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:28.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f76344c3640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f762c144380 0x7f762c0a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:28.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f76344c3640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c1486d0 con 0x7f762c144380 2023-05-15T16:40:28.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f76344c3640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f762c148970 con 0x7f762c0bccd0 2023-05-15T16:40:28.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f76344c3640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f762c148c50 con 0x7f762c069b30 2023-05-15T16:40:28.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f7632a60640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f762c144380 0x7f762c0a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:28.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f7632a60640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f762c144380 0x7f762c0a5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46906/0 (socket says 172.21.15.62:46906) 2023-05-15T16:40:28.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f7632a60640 1 -- 172.21.15.62:0/4186375248 learned_addr learned my addr 172.21.15.62:0/4186375248 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:28.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f763225f640 1 --2- 172.21.15.62:0/4186375248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f762c069b30 0x7f762c0b1430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:28.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f7631a5e640 1 --2- 172.21.15.62:0/4186375248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f762c0bccd0 0x7f762c1498f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:28.333 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f7632a60640 1 -- 172.21.15.62:0/4186375248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f762c069b30 msgr2=0x7f762c0b1430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:28.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f7632a60640 1 --2- 172.21.15.62:0/4186375248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f762c069b30 0x7f762c0b1430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f7632a60640 1 -- 172.21.15.62:0/4186375248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f762c0bccd0 msgr2=0x7f762c1498f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:28.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f7632a60640 1 --2- 172.21.15.62:0/4186375248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f762c0bccd0 0x7f762c1498f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f7632a60640 1 -- 172.21.15.62:0/4186375248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7624009b30 con 0x7f762c144380 2023-05-15T16:40:28.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f763225f640 1 --2- 172.21.15.62:0/4186375248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f762c069b30 0x7f762c0b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:28.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f7631a5e640 1 --2- 172.21.15.62:0/4186375248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f762c0bccd0 0x7f762c1498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:28.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f7632a60640 1 --2- 172.21.15.62:0/4186375248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f762c144380 0x7f762c0a5390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f76240af040 tx=0x7f7624019770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:28.334 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f7622ffd640 1 -- 172.21.15.62:0/4186375248 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76240b8670 con 0x7f762c144380 2023-05-15T16:40:28.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f7622ffd640 1 -- 172.21.15.62:0/4186375248 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76240b87d0 con 0x7f762c144380 2023-05-15T16:40:28.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f7622ffd640 1 -- 172.21.15.62:0/4186375248 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76240b8b80 con 0x7f762c144380 2023-05-15T16:40:28.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f76344c3640 1 -- 172.21.15.62:0/4186375248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f762c0ba8c0 con 0x7f762c144380 2023-05-15T16:40:28.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f76344c3640 1 -- 172.21.15.62:0/4186375248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f762c0bd0a0 con 0x7f762c144380 2023-05-15T16:40:28.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f76344c3640 1 -- 172.21.15.62:0/4186375248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f762c0baa50 con 0x7f762c144380 2023-05-15T16:40:28.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.327+0000 7f7622ffd640 1 -- 172.21.15.62:0/4186375248 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f76240b8ce0 con 0x7f762c144380 2023-05-15T16:40:28.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.331+0000 7f7622ffd640 1 --2- 172.21.15.62:0/4186375248 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7610065380 0x7f7610067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:28.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.331+0000 7f7622ffd640 1 -- 172.21.15.62:0/4186375248 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f762411dcc0 con 0x7f762c144380 2023-05-15T16:40:28.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.331+0000 7f763225f640 1 --2- 172.21.15.62:0/4186375248 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7610065380 0x7f7610067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:28.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.331+0000 7f763225f640 1 --2- 172.21.15.62:0/4186375248 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7610065380 0x7f7610067830 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7628009840 tx=0x7f7628008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:28.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.335+0000 7f7622ffd640 1 -- 172.21.15.62:0/4186375248 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f76240eb9d0 con 0x7f762c144380 2023-05-15T16:40:28.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.515+0000 7f76344c3640 1 -- 172.21.15.62:0/4186375248 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f762c067960 con 0x7f762c144380 2023-05-15T16:40:28.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.515+0000 7f7622ffd640 1 -- 172.21.15.62:0/4186375248 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3889 (secure 0 0 0) 0x7f7624009510 con 0x7f762c144380 2023-05-15T16:40:28.520 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:28.521 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1731611654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1731611654},{"type":"v1","addr":"172.21.15.161:6835","nonce":1731611654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2563537601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2563537601},{"type":"v1","addr":"172.21.15.62:6834","nonce":2563537601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-15T16:40:01.085500+0000","modified":"2023-05-15T16:40:03.744733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/2804159919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2804159919},{"type":"v1","addr":"172.21.15.62:6835","nonce":2804159919}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-15T16:40:28.521 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 7 2023-05-15T16:40:28.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.519+0000 7f76344c3640 1 -- 172.21.15.62:0/4186375248 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7610065380 msgr2=0x7f7610067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:28.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.519+0000 7f76344c3640 1 --2- 172.21.15.62:0/4186375248 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7610065380 0x7f7610067830 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7628009840 tx=0x7f7628008040 comp rx=0 tx=0).stop 2023-05-15T16:40:28.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.519+0000 7f76344c3640 1 -- 172.21.15.62:0/4186375248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f762c144380 msgr2=0x7f762c0a5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:28.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.519+0000 7f76344c3640 1 --2- 172.21.15.62:0/4186375248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f762c144380 0x7f762c0a5390 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f76240af040 tx=0x7f7624019770 comp rx=0 tx=0).stop 2023-05-15T16:40:28.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.519+0000 7f76344c3640 1 -- 172.21.15.62:0/4186375248 shutdown_connections 2023-05-15T16:40:28.522 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.519+0000 7f76344c3640 1 --2- 172.21.15.62:0/4186375248 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7610065380 0x7f7610067830 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.519+0000 7f76344c3640 1 --2- 172.21.15.62:0/4186375248 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f762c144380 0x7f762c0a5390 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.519+0000 7f76344c3640 1 --2- 172.21.15.62:0/4186375248 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f762c0bccd0 0x7f762c1498f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.519+0000 7f76344c3640 1 --2- 172.21.15.62:0/4186375248 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f762c069b30 0x7f762c0b1430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.519+0000 7f76344c3640 1 -- 172.21.15.62:0/4186375248 >> 172.21.15.62:0/4186375248 conn(0x7f762c0a1ad0 msgr2=0x7f762c0a0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:28.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.519+0000 7f76344c3640 1 -- 172.21.15.62:0/4186375248 shutdown_connections 2023-05-15T16:40:28.523 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.519+0000 7f76344c3640 1 -- 172.21.15.62:0/4186375248 wait complete. 2023-05-15T16:40:28.537 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-15T16:40:28.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.647+0000 7f019d278640 1 Processor -- start 2023-05-15T16:40:28.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.647+0000 7f019d278640 1 -- start start 2023-05-15T16:40:28.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.647+0000 7f019d278640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01980b1d70 0x7f0198146090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:28.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.647+0000 7f019d278640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f01980b2500 0x7f01980b4120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:28.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.647+0000 7f019d278640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f01980b91d0 0x7f01980b4660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:28.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.647+0000 7f019d278640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01980b2990 con 0x7f01980b2500 2023-05-15T16:40:28.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.647+0000 7f019d278640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01980b2140 con 0x7f01980b91d0 2023-05-15T16:40:28.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.647+0000 7f019d278640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01980b4ba0 con 0x7f01980b1d70 2023-05-15T16:40:28.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.647+0000 7f018e7fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f01980b2500 0x7f01980b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:28.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.647+0000 7f018e7fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f01980b2500 0x7f01980b4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46908/0 (socket says 172.21.15.62:46908) 2023-05-15T16:40:28.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.647+0000 7f018e7fc640 1 -- 172.21.15.62:0/3319700461 learned_addr learned my addr 172.21.15.62:0/3319700461 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:28.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.647+0000 7f018e7fc640 1 -- 172.21.15.62:0/3319700461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01980b1d70 msgr2=0x7f0198146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:28.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.647+0000 7f018e7fc640 1 --2- 172.21.15.62:0/3319700461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01980b1d70 0x7f0198146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.647+0000 7f018e7fc640 1 -- 172.21.15.62:0/3319700461 >> v2:172.21.15.161:3300/0 conn(0x7f01980b91d0 msgr2=0x7f01980b4660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:28.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.647+0000 7f018e7fc640 1 --2- 172.21.15.62:0/3319700461 >> v2:172.21.15.161:3300/0 conn(0x7f01980b91d0 0x7f01980b4660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.647+0000 7f018e7fc640 1 -- 172.21.15.62:0/3319700461 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01980b3060 con 0x7f01980b2500 2023-05-15T16:40:28.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.647+0000 7f018e7fc640 1 --2- 172.21.15.62:0/3319700461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01980b2500 0x7f01980b4120 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f01980b8f60 tx=0x7f018001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3086766c557875f0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:28.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.647+0000 7f01967fc640 1 -- 172.21.15.62:0/3319700461 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01800a7070 con 0x7f01980b2500 2023-05-15T16:40:28.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.647+0000 7f01967fc640 1 -- 172.21.15.62:0/3319700461 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01800ab430 con 0x7f01980b2500 2023-05-15T16:40:28.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.647+0000 7f01967fc640 1 -- 172.21.15.62:0/3319700461 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01800ab7c0 con 0x7f01980b2500 2023-05-15T16:40:28.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f019d278640 1 -- 172.21.15.62:0/3319700461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01980b2500 msgr2=0x7f01980b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:28.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f019d278640 1 --2- 172.21.15.62:0/3319700461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01980b2500 0x7f01980b4120 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f01980b8f60 tx=0x7f018001c4f0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f019d278640 1 -- 172.21.15.62:0/3319700461 shutdown_connections 2023-05-15T16:40:28.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f019d278640 1 --2- 172.21.15.62:0/3319700461 >> v2:172.21.15.161:3300/0 conn(0x7f01980b91d0 0x7f01980b4660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f019d278640 1 --2- 172.21.15.62:0/3319700461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01980b2500 0x7f01980b4120 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f019d278640 1 --2- 172.21.15.62:0/3319700461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01980b1d70 0x7f0198146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f019d278640 1 -- 172.21.15.62:0/3319700461 >> 172.21.15.62:0/3319700461 conn(0x7f01980653f0 msgr2=0x7f01980697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:28.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f019d278640 1 -- 172.21.15.62:0/3319700461 shutdown_connections 2023-05-15T16:40:28.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f019d278640 1 -- 172.21.15.62:0/3319700461 wait complete. 2023-05-15T16:40:28.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f019d278640 1 Processor -- start 2023-05-15T16:40:28.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f019d278640 1 -- start start 2023-05-15T16:40:28.657 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f019d278640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01980b1d70 0x7f0198139240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:28.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f019d278640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01980b2500 0x7f0198144bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:28.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f019d278640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01980b91d0 0x7f0198138200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:28.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f019d278640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0198139780 con 0x7f01980b2500 2023-05-15T16:40:28.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f019d278640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0198145420 con 0x7f01980b1d70 2023-05-15T16:40:28.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f019d278640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019813a1d0 con 0x7f01980b91d0 2023-05-15T16:40:28.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f018e7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01980b2500 0x7f0198144bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:28.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f018e7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01980b2500 0x7f0198144bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46910/0 (socket says 172.21.15.62:46910) 2023-05-15T16:40:28.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f018e7fc640 1 -- 172.21.15.62:0/2438828643 learned_addr learned my addr 172.21.15.62:0/2438828643 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:28.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f01977fe640 1 --2- 172.21.15.62:0/2438828643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01980b91d0 0x7f0198138200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:28.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f018e7fc640 1 -- 172.21.15.62:0/2438828643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01980b91d0 msgr2=0x7f0198138200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:28.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f0196ffd640 1 --2- 172.21.15.62:0/2438828643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01980b1d70 0x7f0198139240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:28.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f018e7fc640 1 --2- 172.21.15.62:0/2438828643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01980b91d0 0x7f0198138200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f018e7fc640 1 -- 172.21.15.62:0/2438828643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01980b1d70 msgr2=0x7f0198139240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:28.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f018e7fc640 1 --2- 172.21.15.62:0/2438828643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01980b1d70 0x7f0198139240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f018e7fc640 1 -- 172.21.15.62:0/2438828643 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01800094d0 con 0x7f01980b2500 2023-05-15T16:40:28.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f01977fe640 1 --2- 172.21.15.62:0/2438828643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01980b91d0 0x7f0198138200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:28.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f018e7fc640 1 --2- 172.21.15.62:0/2438828643 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01980b2500 0x7f0198144bf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f018001aba0 tx=0x7f0180019290 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:28.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f018ffff640 1 -- 172.21.15.62:0/2438828643 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01800b4830 con 0x7f01980b2500 2023-05-15T16:40:28.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f018ffff640 1 -- 172.21.15.62:0/2438828643 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01800b4990 con 0x7f01980b2500 2023-05-15T16:40:28.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f019d278640 1 -- 172.21.15.62:0/2438828643 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01981495e0 con 0x7f01980b2500 2023-05-15T16:40:28.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f018ffff640 1 -- 172.21.15.62:0/2438828643 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01800b4d40 con 0x7f01980b2500 2023-05-15T16:40:28.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f019d278640 1 -- 172.21.15.62:0/2438828643 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01980b3b40 con 0x7f01980b2500 2023-05-15T16:40:28.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.651+0000 7f019d278640 1 -- 172.21.15.62:0/2438828643 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0198149770 con 0x7f01980b2500 2023-05-15T16:40:28.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.655+0000 7f018ffff640 1 -- 172.21.15.62:0/2438828643 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f01800c2460 con 0x7f01980b2500 2023-05-15T16:40:28.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.655+0000 7f018ffff640 1 --2- 172.21.15.62:0/2438828643 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0178065380 0x7f0178067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:28.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.655+0000 7f018ffff640 1 -- 172.21.15.62:0/2438828643 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f018011cf00 con 0x7f01980b2500 2023-05-15T16:40:28.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.655+0000 7f0196ffd640 1 --2- 172.21.15.62:0/2438828643 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0178065380 0x7f0178067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:28.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.655+0000 7f0196ffd640 1 --2- 172.21.15.62:0/2438828643 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0178065380 0x7f0178067830 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f018800a830 tx=0x7f0188008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:28.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.659+0000 7f018ffff640 1 -- 172.21.15.62:0/2438828643 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f01800eab20 con 0x7f01980b2500 2023-05-15T16:40:28.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.807+0000 7f019d278640 1 -- 172.21.15.62:0/2438828643 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01980b5400 con 0x7f01980b2500 2023-05-15T16:40:28.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.811+0000 7f018ffff640 1 -- 172.21.15.62:0/2438828643 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17811 (secure 0 0 0) 0x7f01800ee140 con 0x7f01980b2500 2023-05-15T16:40:28.815 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:28.816 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:40:02.088078+0000","last_up_change":"2023-05-15T16:39:48.597049+0000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-15T16:39:49.394028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-15T16:39:55.208679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-15T16:39:59.547414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-15T16:40:00.055526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37594},{"type":"v1","addr":"172.21.15.62:6825","nonce":37594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37594},{"type":"v1","addr":"172.21.15.62:6827","nonce":37594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37594},{"type":"v1","addr":"172.21.15.62:6831","nonce":37594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37594},{"type":"v1","addr":"172.21.15.62:6829","nonce":37594}]},"public_addr":"172.21.15.62:6825/37594","cluster_addr":"172.21.15.62:6827/37594","heartbeat_back_addr":"172.21.15.62:6831/37594","heartbeat_front_addr":"172.21.15.62:6829/37594","state":["exists","up"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37592},{"type":"v1","addr":"172.21.15.62:6808","nonce":37592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":37592},{"type":"v1","addr":"172.21.15.62:6814","nonce":37592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6821","nonce":37592},{"type":"v1","addr":"172.21.15.62:6823","nonce":37592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37592},{"type":"v1","addr":"172.21.15.62:6818","nonce":37592}]},"public_addr":"172.21.15.62:6808/37592","cluster_addr":"172.21.15.62:6814/37592","heartbeat_back_addr":"172.21.15.62:6823/37592","heartbeat_front_addr":"172.21.15.62:6818/37592","state":["exists","up"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":37591},{"type":"v1","addr":"172.21.15.62:6810","nonce":37591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":37591},{"type":"v1","addr":"172.21.15.62:6815","nonce":37591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37591},{"type":"v1","addr":"172.21.15.62:6822","nonce":37591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":37591},{"type":"v1","addr":"172.21.15.62:6819","nonce":37591}]},"public_addr":"172.21.15.62:6810/37591","cluster_addr":"172.21.15.62:6815/37591","heartbeat_back_addr":"172.21.15.62:6822/37591","heartbeat_front_addr":"172.21.15.62:6819/37591","state":["exists","up"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37593},{"type":"v1","addr":"172.21.15.62:6801","nonce":37593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37593},{"type":"v1","addr":"172.21.15.62:6803","nonce":37593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":37593},{"type":"v1","addr":"172.21.15.62:6812","nonce":37593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37593},{"type":"v1","addr":"172.21.15.62:6805","nonce":37593}]},"public_addr":"172.21.15.62:6801/37593","cluster_addr":"172.21.15.62:6803/37593","heartbeat_back_addr":"172.21.15.62:6812/37593","heartbeat_front_addr":"172.21.15.62:6805/37593","state":["exists","up"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37854},{"type":"v1","addr":"172.21.15.161:6801","nonce":37854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37854},{"type":"v1","addr":"172.21.15.161:6803","nonce":37854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37854},{"type":"v1","addr":"172.21.15.161:6807","nonce":37854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37854},{"type":"v1","addr":"172.21.15.161:6805","nonce":37854}]},"public_addr":"172.21.15.161:6801/37854","cluster_addr":"172.21.15.161:6803/37854","heartbeat_back_addr":"172.21.15.161:6807/37854","heartbeat_front_addr":"172.21.15.161:6805/37854","state":["exists","up"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37855},{"type":"v1","addr":"172.21.15.161:6810","nonce":37855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37855},{"type":"v1","addr":"172.21.15.161:6815","nonce":37855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37855},{"type":"v1","addr":"172.21.15.161:6824","nonce":37855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37855},{"type":"v1","addr":"172.21.15.161:6820","nonce":37855}]},"public_addr":"172.21.15.161:6810/37855","cluster_addr":"172.21.15.161:6815/37855","heartbeat_back_addr":"172.21.15.161:6824/37855","heartbeat_front_addr":"172.21.15.161:6820/37855","state":["exists","up"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":37856},{"type":"v1","addr":"172.21.15.161:6814","nonce":37856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37856},{"type":"v1","addr":"172.21.15.161:6819","nonce":37856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":37856},{"type":"v1","addr":"172.21.15.161:6830","nonce":37856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37856},{"type":"v1","addr":"172.21.15.161:6826","nonce":37856}]},"public_addr":"172.21.15.161:6814/37856","cluster_addr":"172.21.15.161:6819/37856","heartbeat_back_addr":"172.21.15.161:6830/37856","heartbeat_front_addr":"172.21.15.161:6826/37856","state":["exists","up"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":37857},{"type":"v1","addr":"172.21.15.161:6813","nonce":37857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":37857},{"type":"v1","addr":"172.21.15.161:6821","nonce":37857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":37857},{"type":"v1","addr":"172.21.15.161:6831","nonce":37857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":37857},{"type":"v1","addr":"172.21.15.161:6827","nonce":37857}]},"public_addr":"172.21.15.161:6813/37857","cluster_addr":"172.21.15.161:6821/37857","heartbeat_back_addr":"172.21.15.161:6831/37857","heartbeat_front_addr":"172.21.15.161:6827/37857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.592907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.618143+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.641533+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.614355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.579293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.718353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.730135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.792887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:40:28.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.811+0000 7f019d278640 1 -- 172.21.15.62:0/2438828643 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0178065380 msgr2=0x7f0178067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:28.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.811+0000 7f019d278640 1 --2- 172.21.15.62:0/2438828643 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0178065380 0x7f0178067830 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f018800a830 tx=0x7f0188008040 comp rx=0 tx=0).stop 2023-05-15T16:40:28.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.811+0000 7f019d278640 1 -- 172.21.15.62:0/2438828643 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01980b2500 msgr2=0x7f0198144bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:28.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.811+0000 7f019d278640 1 --2- 172.21.15.62:0/2438828643 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01980b2500 0x7f0198144bf0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f018001aba0 tx=0x7f0180019290 comp rx=0 tx=0).stop 2023-05-15T16:40:28.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.811+0000 7f019d278640 1 -- 172.21.15.62:0/2438828643 shutdown_connections 2023-05-15T16:40:28.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.811+0000 7f019d278640 1 --2- 172.21.15.62:0/2438828643 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f01980b91d0 0x7f0198138200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.811+0000 7f019d278640 1 --2- 172.21.15.62:0/2438828643 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0178065380 0x7f0178067830 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.811+0000 7f019d278640 1 --2- 172.21.15.62:0/2438828643 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f01980b2500 0x7f0198144bf0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.811+0000 7f019d278640 1 --2- 172.21.15.62:0/2438828643 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f01980b1d70 0x7f0198139240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.815+0000 7f019d278640 1 -- 172.21.15.62:0/2438828643 >> 172.21.15.62:0/2438828643 conn(0x7f01980653f0 msgr2=0x7f01980af6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:28.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.815+0000 7f019d278640 1 -- 172.21.15.62:0/2438828643 shutdown_connections 2023-05-15T16:40:28.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.815+0000 7f019d278640 1 -- 172.21.15.62:0/2438828643 wait complete. 2023-05-15T16:40:28.833 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-15T16:39:49.394028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-15T16:39:55.208679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-05-15T16:39:59.547414+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-05-15T16:40:00.055526+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-15T16:40:28.835 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-15T16:40:28.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.947+0000 7f797155d640 1 Processor -- start 2023-05-15T16:40:28.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.947+0000 7f797155d640 1 -- start start 2023-05-15T16:40:28.951 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.947+0000 7f797155d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f796c141ff0 0x7f796c0b86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:28.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.947+0000 7f797155d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c0b61e0 con 0x7f796c148250 2023-05-15T16:40:28.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.947+0000 7f797155d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796c0be800 con 0x7f796c0b94f0 2023-05-15T16:40:28.952 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.947+0000 7f797155d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f796c1423c0 con 0x7f796c141ff0 2023-05-15T16:40:28.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.947+0000 7f796affd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f796c141ff0 0x7f796c0b86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:28.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.947+0000 7f796b7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f796c148250 0x7f796c152470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32820/0 (socket says 172.21.15.62:32820) 2023-05-15T16:40:28.953 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.947+0000 7f796b7fe640 1 -- 172.21.15.62:0/4236565077 learned_addr learned my addr 172.21.15.62:0/4236565077 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:28.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.947+0000 7f796affd640 1 -- 172.21.15.62:0/4236565077 >> v1:172.21.15.161:6789/0 conn(0x7f796c0b94f0 legacy=0x7f796c0be0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:28.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.947+0000 7f796affd640 1 -- 172.21.15.62:0/4236565077 >> v1:172.21.15.62:6789/0 conn(0x7f796c148250 legacy=0x7f796c152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:28.954 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.947+0000 7f796affd640 1 -- 172.21.15.62:0/4236565077 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f796c0b92c0 con 0x7f796c141ff0 2023-05-15T16:40:28.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.947+0000 7f796affd640 1 --2- 172.21.15.62:0/4236565077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f796c141ff0 0x7f796c0b86e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f795c0097c0 tx=0x7f795c01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3469897ea7de3320 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:28.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.947+0000 7f796a7fc640 1 -- 172.21.15.62:0/4236565077 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c0a8930 con 0x7f796c141ff0 2023-05-15T16:40:28.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f796a7fc640 1 -- 172.21.15.62:0/4236565077 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c0a8a90 con 0x7f796c141ff0 2023-05-15T16:40:28.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f796a7fc640 1 -- 172.21.15.62:0/4236565077 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c0a8e20 con 0x7f796c141ff0 2023-05-15T16:40:28.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f797155d640 1 -- 172.21.15.62:0/4236565077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f796c141ff0 msgr2=0x7f796c0b86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:28.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f797155d640 1 --2- 172.21.15.62:0/4236565077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f796c141ff0 0x7f796c0b86e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f795c0097c0 tx=0x7f795c01ec30 comp rx=0 tx=0).stop 2023-05-15T16:40:28.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f797155d640 1 -- 172.21.15.62:0/4236565077 shutdown_connections 2023-05-15T16:40:28.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f797155d640 1 --2- 172.21.15.62:0/4236565077 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f796c141ff0 0x7f796c0b86e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f797155d640 1 -- 172.21.15.62:0/4236565077 >> 172.21.15.62:0/4236565077 conn(0x7f796c06e480 msgr2=0x7f796c06e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:28.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f797155d640 1 -- 172.21.15.62:0/4236565077 shutdown_connections 2023-05-15T16:40:28.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f797155d640 1 -- 172.21.15.62:0/4236565077 wait complete. 2023-05-15T16:40:28.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f797155d640 1 Processor -- start 2023-05-15T16:40:28.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f797155d640 1 -- start start 2023-05-15T16:40:28.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f797155d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f796c0b94f0 0x7f796c147660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:28.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f797155d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f796c141ff0 0x7f796c136ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:28.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f797155d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f796c148250 0x7f796c145a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:28.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f797155d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c13d430 con 0x7f796c0b94f0 2023-05-15T16:40:28.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f797155d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f796c13cde0 con 0x7f796c148250 2023-05-15T16:40:28.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f797155d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f796c13d0c0 con 0x7f796c141ff0 2023-05-15T16:40:28.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f796affd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f796c0b94f0 0x7f796c147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:28.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f796affd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f796c0b94f0 0x7f796c147660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46922/0 (socket says 172.21.15.62:46922) 2023-05-15T16:40:28.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f796affd640 1 -- 172.21.15.62:0/2113960279 learned_addr learned my addr 172.21.15.62:0/2113960279 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:28.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f796affd640 1 -- 172.21.15.62:0/2113960279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f796c141ff0 msgr2=0x7f796c136ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:28.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f796b7fe640 1 --2- 172.21.15.62:0/2113960279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f796c148250 0x7f796c145a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:28.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f7963fff640 1 --2- 172.21.15.62:0/2113960279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f796c141ff0 0x7f796c136ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:28.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f796affd640 1 --2- 172.21.15.62:0/2113960279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f796c141ff0 0x7f796c136ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f796affd640 1 -- 172.21.15.62:0/2113960279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f796c148250 msgr2=0x7f796c145a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:28.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f796affd640 1 --2- 172.21.15.62:0/2113960279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f796c148250 0x7f796c145a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:28.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f796affd640 1 -- 172.21.15.62:0/2113960279 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f795c009420 con 0x7f796c0b94f0 2023-05-15T16:40:28.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f796affd640 1 --2- 172.21.15.62:0/2113960279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f796c0b94f0 0x7f796c147660 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f795c01b840 tx=0x7f795c01b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:28.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f79637fe640 1 -- 172.21.15.62:0/2113960279 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c0a8930 con 0x7f796c0b94f0 2023-05-15T16:40:28.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f79637fe640 1 -- 172.21.15.62:0/2113960279 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f795c0b9410 con 0x7f796c0b94f0 2023-05-15T16:40:28.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f79637fe640 1 -- 172.21.15.62:0/2113960279 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f795c0b97a0 con 0x7f796c0b94f0 2023-05-15T16:40:28.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f797155d640 1 -- 172.21.15.62:0/2113960279 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f796c0b8fe0 con 0x7f796c0b94f0 2023-05-15T16:40:28.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f797155d640 1 -- 172.21.15.62:0/2113960279 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796c0b8d00 con 0x7f796c0b94f0 2023-05-15T16:40:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.951+0000 7f797155d640 1 -- 172.21.15.62:0/2113960279 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f796c147d30 con 0x7f796c0b94f0 2023-05-15T16:40:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.955+0000 7f79637fe640 1 -- 172.21.15.62:0/2113960279 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f795c0b7040 con 0x7f796c0b94f0 2023-05-15T16:40:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.955+0000 7f79637fe640 1 --2- 172.21.15.62:0/2113960279 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f794c065380 0x7f794c067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.955+0000 7f79637fe640 1 -- 172.21.15.62:0/2113960279 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f795c120630 con 0x7f796c0b94f0 2023-05-15T16:40:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.955+0000 7f7963fff640 1 --2- 172.21.15.62:0/2113960279 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f794c065380 0x7f794c067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:28.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.955+0000 7f7963fff640 1 --2- 172.21.15.62:0/2113960279 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f794c065380 0x7f794c067830 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f796c0b89a0 tx=0x7f7954009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:28.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:28.959+0000 7f79637fe640 1 -- 172.21.15.62:0/2113960279 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f795c0ee2b0 con 0x7f796c0b94f0 2023-05-15T16:40:29.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.111+0000 7f797155d640 1 -- 172.21.15.62:0/2113960279 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f796c147d30 con 0x7f796c0b94f0 2023-05-15T16:40:29.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.111+0000 7f79637fe640 1 -- 172.21.15.62:0/2113960279 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) v1 ==== 93+0+10 (secure 0 0 0) 0x7f795c0f18d0 con 0x7f796c0b94f0 2023-05-15T16:40:29.117 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-05-15T16:40:29.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.115+0000 7f797155d640 1 -- 172.21.15.62:0/2113960279 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f794c065380 msgr2=0x7f794c067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:29.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.115+0000 7f797155d640 1 --2- 172.21.15.62:0/2113960279 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f794c065380 0x7f794c067830 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f796c0b89a0 tx=0x7f7954009040 comp rx=0 tx=0).stop 2023-05-15T16:40:29.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.115+0000 7f797155d640 1 -- 172.21.15.62:0/2113960279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f796c0b94f0 msgr2=0x7f796c147660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:29.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.115+0000 7f797155d640 1 --2- 172.21.15.62:0/2113960279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f796c0b94f0 0x7f796c147660 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f795c01b840 tx=0x7f795c01b9d0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.115+0000 7f797155d640 1 -- 172.21.15.62:0/2113960279 shutdown_connections 2023-05-15T16:40:29.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.115+0000 7f797155d640 1 --2- 172.21.15.62:0/2113960279 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f796c148250 0x7f796c145a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.115+0000 7f797155d640 1 --2- 172.21.15.62:0/2113960279 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f796c141ff0 0x7f796c136ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.115+0000 7f797155d640 1 --2- 172.21.15.62:0/2113960279 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f794c065380 0x7f794c067830 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.115+0000 7f797155d640 1 --2- 172.21.15.62:0/2113960279 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f796c0b94f0 0x7f796c147660 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.120 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.115+0000 7f797155d640 1 -- 172.21.15.62:0/2113960279 >> 172.21.15.62:0/2113960279 conn(0x7f796c06e480 msgr2=0x7f796c1d0f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:29.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.115+0000 7f797155d640 1 -- 172.21.15.62:0/2113960279 shutdown_connections 2023-05-15T16:40:29.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.115+0000 7f797155d640 1 -- 172.21.15.62:0/2113960279 wait complete. 2023-05-15T16:40:29.136 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-15T16:40:29.265 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e60a30640 1 Processor -- start 2023-05-15T16:40:29.266 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e60a30640 1 -- start start 2023-05-15T16:40:29.268 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e60a30640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e5c140be0 0x7f8e5c06fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:29.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e60a30640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f8e5c0b37d0 0x7f8e5c0bd1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:29.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e60a30640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e5c0b8810 con 0x7f8e5c147060 2023-05-15T16:40:29.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e60a30640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e5c1468a0 con 0x7f8e5c0b37d0 2023-05-15T16:40:29.269 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e60a30640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c140fb0 con 0x7f8e5c140be0 2023-05-15T16:40:29.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5ad9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8e5c147060 0x7f8e5c149e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32824/0 (socket says 172.21.15.62:32824) 2023-05-15T16:40:29.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5ad9d640 1 -- 172.21.15.62:0/3095496871 learned_addr learned my addr 172.21.15.62:0/3095496871 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:29.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e59d9b640 1 --2- 172.21.15.62:0/3095496871 >> v2:172.21.15.161:3300/0 conn(0x7f8e5c0b37d0 0x7f8e5c0bd1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:29.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5a59c640 1 --2- 172.21.15.62:0/3095496871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e5c140be0 0x7f8e5c06fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:29.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5959a640 1 -- 172.21.15.62:0/3095496871 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596089713 0 0) 0x7f8e5c0b8810 con 0x7f8e5c147060 2023-05-15T16:40:29.270 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5959a640 1 -- 172.21.15.62:0/3095496871 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e44003530 con 0x7f8e5c147060 2023-05-15T16:40:29.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5959a640 1 -- 172.21.15.62:0/3095496871 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3748843816 0 0) 0x7f8e44003530 con 0x7f8e5c147060 2023-05-15T16:40:29.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5959a640 1 -- 172.21.15.62:0/3095496871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e5c140be0 msgr2=0x7f8e5c06fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:29.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5959a640 1 --2- 172.21.15.62:0/3095496871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e5c140be0 0x7f8e5c06fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5959a640 1 -- 172.21.15.62:0/3095496871 >> v2:172.21.15.161:3300/0 conn(0x7f8e5c0b37d0 msgr2=0x7f8e5c0bd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:29.271 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5959a640 1 --2- 172.21.15.62:0/3095496871 >> v2:172.21.15.161:3300/0 conn(0x7f8e5c0b37d0 0x7f8e5c0bd1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5959a640 1 -- 172.21.15.62:0/3095496871 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c070310 con 0x7f8e5c147060 2023-05-15T16:40:29.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5959a640 1 -- 172.21.15.62:0/3095496871 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7f8e54001a00 con 0x7f8e5c147060 2023-05-15T16:40:29.272 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5959a640 1 -- 172.21.15.62:0/3095496871 >> v1:172.21.15.62:6789/0 conn(0x7f8e5c147060 legacy=0x7f8e5c149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:29.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5959a640 1 --2- 172.21.15.62:0/3095496871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e44003980 0x7f8e44003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:29.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5959a640 1 --2- 172.21.15.62:0/3095496871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e5c140be0 0x7f8e440047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:29.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5959a640 1 --2- 172.21.15.62:0/3095496871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e44004d10 0x7f8e44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:29.273 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5959a640 1 -- 172.21.15.62:0/3095496871 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c1468a0 con 0x7f8e44004d10 2023-05-15T16:40:29.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5959a640 1 -- 172.21.15.62:0/3095496871 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c140fb0 con 0x7f8e44003980 2023-05-15T16:40:29.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5959a640 1 -- 172.21.15.62:0/3095496871 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e4400dba0 con 0x7f8e5c140be0 2023-05-15T16:40:29.274 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5ad9d640 1 --2- 172.21.15.62:0/3095496871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e44004d10 0x7f8e44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:29.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5a59c640 1 --2- 172.21.15.62:0/3095496871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e44003980 0x7f8e44003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:29.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e59d9b640 1 --2- 172.21.15.62:0/3095496871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e5c140be0 0x7f8e440047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:29.275 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5ad9d640 1 -- 172.21.15.62:0/3095496871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e5c140be0 msgr2=0x7f8e440047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:29.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5ad9d640 1 --2- 172.21.15.62:0/3095496871 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e5c140be0 0x7f8e440047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5ad9d640 1 -- 172.21.15.62:0/3095496871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e44003980 msgr2=0x7f8e44003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:29.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5ad9d640 1 --2- 172.21.15.62:0/3095496871 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e44003980 0x7f8e44003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.276 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.263+0000 7f8e5ad9d640 1 -- 172.21.15.62:0/3095496871 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e44003530 con 0x7f8e44004d10 2023-05-15T16:40:29.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e5ad9d640 1 --2- 172.21.15.62:0/3095496871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e44004d10 0x7f8e44005180 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400a860 tx=0x7f8e5401d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf7c66f402d8acb server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:29.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e5959a640 1 -- 172.21.15.62:0/3095496871 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e540ad630 con 0x7f8e44004d10 2023-05-15T16:40:29.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e5959a640 1 -- 172.21.15.62:0/3095496871 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e540a8070 con 0x7f8e44004d10 2023-05-15T16:40:29.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e5959a640 1 -- 172.21.15.62:0/3095496871 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e540ad9d0 con 0x7f8e44004d10 2023-05-15T16:40:29.280 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e60a30640 1 -- 172.21.15.62:0/3095496871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e44004d10 msgr2=0x7f8e44005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:29.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e60a30640 1 --2- 172.21.15.62:0/3095496871 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e44004d10 0x7f8e44005180 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400a860 tx=0x7f8e5401d2c0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e5ad9d640 1 -- 172.21.15.62:0/3095496871 reap_dead start 2023-05-15T16:40:29.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e60a30640 1 -- 172.21.15.62:0/3095496871 shutdown_connections 2023-05-15T16:40:29.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e60a30640 1 -- 172.21.15.62:0/3095496871 >> 172.21.15.62:0/3095496871 conn(0x7f8e5c06d280 msgr2=0x7f8e5c06d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:29.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e60a30640 1 -- 172.21.15.62:0/3095496871 shutdown_connections 2023-05-15T16:40:29.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e60a30640 1 -- 172.21.15.62:0/3095496871 wait complete. 2023-05-15T16:40:29.281 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e60a30640 1 Processor -- start 2023-05-15T16:40:29.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e60a30640 1 -- start start 2023-05-15T16:40:29.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e60a30640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e5c06ab90 0x7f8e5c1de080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:29.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e60a30640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e5c1de5c0 0x7f8e5c147a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:29.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e60a30640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e5c147f80 0x7f8e5c13bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:29.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e60a30640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c148eb0 con 0x7f8e5c06ab90 2023-05-15T16:40:29.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e60a30640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c149c50 con 0x7f8e5c147f80 2023-05-15T16:40:29.282 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e60a30640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e5c14a6f0 con 0x7f8e5c1de5c0 2023-05-15T16:40:29.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e5a59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e5c06ab90 0x7f8e5c1de080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:29.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e5a59c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e5c06ab90 0x7f8e5c1de080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46946/0 (socket says 172.21.15.62:46946) 2023-05-15T16:40:29.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e5a59c640 1 -- 172.21.15.62:0/3827636736 learned_addr learned my addr 172.21.15.62:0/3827636736 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:29.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e59d9b640 1 --2- 172.21.15.62:0/3827636736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e5c1de5c0 0x7f8e5c147a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:29.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e5a59c640 1 -- 172.21.15.62:0/3827636736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e5c1de5c0 msgr2=0x7f8e5c147a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:29.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e5ad9d640 1 --2- 172.21.15.62:0/3827636736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e5c147f80 0x7f8e5c13bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:29.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e5a59c640 1 --2- 172.21.15.62:0/3827636736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e5c1de5c0 0x7f8e5c147a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e5a59c640 1 -- 172.21.15.62:0/3827636736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e5c147f80 msgr2=0x7f8e5c13bbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:29.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e5a59c640 1 --2- 172.21.15.62:0/3827636736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e5c147f80 0x7f8e5c13bbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e5a59c640 1 -- 172.21.15.62:0/3827636736 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e5c146b40 con 0x7f8e5c06ab90 2023-05-15T16:40:29.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e5a59c640 1 --2- 172.21.15.62:0/3827636736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e5c06ab90 0x7f8e5c1de080 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0115e0 tx=0x7f8e4c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:29.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e4affd640 1 -- 172.21.15.62:0/3827636736 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c00f8f0 con 0x7f8e5c06ab90 2023-05-15T16:40:29.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e4affd640 1 -- 172.21.15.62:0/3827636736 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e4c00fa50 con 0x7f8e5c06ab90 2023-05-15T16:40:29.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e60a30640 1 -- 172.21.15.62:0/3827636736 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5c0705f0 con 0x7f8e5c06ab90 2023-05-15T16:40:29.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.267+0000 7f8e4affd640 1 -- 172.21.15.62:0/3827636736 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c00fdc0 con 0x7f8e5c06ab90 2023-05-15T16:40:29.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.271+0000 7f8e60a30640 1 -- 172.21.15.62:0/3827636736 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5c0b3be0 con 0x7f8e5c06ab90 2023-05-15T16:40:29.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.271+0000 7f8e60a30640 1 -- 172.21.15.62:0/3827636736 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e5c067960 con 0x7f8e5c06ab90 2023-05-15T16:40:29.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.271+0000 7f8e4affd640 1 -- 172.21.15.62:0/3827636736 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f8e4c015460 con 0x7f8e5c06ab90 2023-05-15T16:40:29.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.271+0000 7f8e4affd640 1 --2- 172.21.15.62:0/3827636736 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8e3c065380 0x7f8e3c067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:29.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.271+0000 7f8e4affd640 1 -- 172.21.15.62:0/3827636736 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f8e4c082db0 con 0x7f8e5c06ab90 2023-05-15T16:40:29.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.271+0000 7f8e59d9b640 1 --2- 172.21.15.62:0/3827636736 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8e3c065380 0x7f8e3c067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:29.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.271+0000 7f8e59d9b640 1 --2- 172.21.15.62:0/3827636736 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8e3c065380 0x7f8e3c067830 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c13cce0 tx=0x7f8e50008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:29.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.275+0000 7f8e4affd640 1 -- 172.21.15.62:0/3827636736 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f8e4c0509d0 con 0x7f8e5c06ab90 2023-05-15T16:40:29.425 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.423+0000 7f8e60a30640 1 -- 172.21.15.62:0/3827636736 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8e5c04dbe0 con 0x7f8e5c06ab90 2023-05-15T16:40:29.426 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.423+0000 7f8e4affd640 1 -- 172.21.15.62:0/3827636736 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v23) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8e4c053ff0 con 0x7f8e5c06ab90 2023-05-15T16:40:29.426 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-05-15T16:40:29.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.423+0000 7f8e60a30640 1 -- 172.21.15.62:0/3827636736 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8e3c065380 msgr2=0x7f8e3c067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:29.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.423+0000 7f8e60a30640 1 --2- 172.21.15.62:0/3827636736 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8e3c065380 0x7f8e3c067830 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c13cce0 tx=0x7f8e50008040 comp rx=0 tx=0).stop 2023-05-15T16:40:29.428 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.423+0000 7f8e60a30640 1 -- 172.21.15.62:0/3827636736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e5c06ab90 msgr2=0x7f8e5c1de080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:29.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.423+0000 7f8e60a30640 1 --2- 172.21.15.62:0/3827636736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e5c06ab90 0x7f8e5c1de080 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0115e0 tx=0x7f8e4c011aa0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.423+0000 7f8e60a30640 1 -- 172.21.15.62:0/3827636736 shutdown_connections 2023-05-15T16:40:29.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.423+0000 7f8e60a30640 1 --2- 172.21.15.62:0/3827636736 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8e5c147f80 0x7f8e5c13bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.423+0000 7f8e60a30640 1 --2- 172.21.15.62:0/3827636736 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8e5c1de5c0 0x7f8e5c147a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.423+0000 7f8e60a30640 1 --2- 172.21.15.62:0/3827636736 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8e3c065380 0x7f8e3c067830 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.423+0000 7f8e60a30640 1 --2- 172.21.15.62:0/3827636736 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8e5c06ab90 0x7f8e5c1de080 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.429 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.423+0000 7f8e60a30640 1 -- 172.21.15.62:0/3827636736 >> 172.21.15.62:0/3827636736 conn(0x7f8e5c06d280 msgr2=0x7f8e5c146080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:29.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.423+0000 7f8e60a30640 1 -- 172.21.15.62:0/3827636736 shutdown_connections 2023-05-15T16:40:29.430 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.423+0000 7f8e60a30640 1 -- 172.21.15.62:0/3827636736 wait complete. 2023-05-15T16:40:29.444 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-05-15T16:40:29.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.559+0000 7fcd54205640 1 Processor -- start 2023-05-15T16:40:29.562 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.559+0000 7fcd54205640 1 -- start start 2023-05-15T16:40:29.563 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.559+0000 7fcd54205640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd4c0b4100 0x7fcd4c0b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:29.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.559+0000 7fcd54205640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcd4c147c30 0x7fcd4c1524f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:29.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.559+0000 7fcd54205640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd4c0b7400 con 0x7fcd4c0b3080 2023-05-15T16:40:29.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.559+0000 7fcd54205640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd4c0b4e70 con 0x7fcd4c147c30 2023-05-15T16:40:29.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.559+0000 7fcd54205640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c142380 con 0x7fcd4c0b4100 2023-05-15T16:40:29.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.559+0000 7fcd517a0640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fcd4c0b3080 0x7fcd4c141c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32836/0 (socket says 172.21.15.62:32836) 2023-05-15T16:40:29.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.559+0000 7fcd527a2640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcd4c147c30 0x7fcd4c1524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:29.564 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.559+0000 7fcd517a0640 1 -- 172.21.15.62:0/599544057 learned_addr learned my addr 172.21.15.62:0/599544057 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:29.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.559+0000 7fcd51fa1640 1 --2- 172.21.15.62:0/599544057 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd4c0b4100 0x7fcd4c0b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:29.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.559+0000 7fcd527a2640 1 -- 172.21.15.62:0/599544057 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd4c0b4100 msgr2=0x7fcd4c0b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:29.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.559+0000 7fcd527a2640 1 --2- 172.21.15.62:0/599544057 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd4c0b4100 0x7fcd4c0b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.559+0000 7fcd527a2640 1 -- 172.21.15.62:0/599544057 >> v1:172.21.15.62:6789/0 conn(0x7fcd4c0b3080 legacy=0x7fcd4c141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:29.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.559+0000 7fcd527a2640 1 -- 172.21.15.62:0/599544057 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c0b6640 con 0x7fcd4c147c30 2023-05-15T16:40:29.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.559+0000 7fcd50f9f640 1 -- 172.21.15.62:0/599544057 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2377311608 0 0) 0x7fcd4c0b7400 con 0x7fcd4c0b3080 2023-05-15T16:40:29.565 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.559+0000 7fcd51fa1640 1 --2- 172.21.15.62:0/599544057 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd4c0b4100 0x7fcd4c0b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-15T16:40:29.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd527a2640 1 --2- 172.21.15.62:0/599544057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd4c147c30 0x7fcd4c1524f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c0097c0 tx=0x7fcd3c01c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26015897acb9cc93 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:29.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd50f9f640 1 -- 172.21.15.62:0/599544057 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c0ab650 con 0x7fcd4c147c30 2023-05-15T16:40:29.566 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd50f9f640 1 -- 172.21.15.62:0/599544057 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3c0ab7b0 con 0x7fcd4c147c30 2023-05-15T16:40:29.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd50f9f640 1 -- 172.21.15.62:0/599544057 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c0abb40 con 0x7fcd4c147c30 2023-05-15T16:40:29.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd54205640 1 -- 172.21.15.62:0/599544057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd4c147c30 msgr2=0x7fcd4c1524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:29.567 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd54205640 1 --2- 172.21.15.62:0/599544057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd4c147c30 0x7fcd4c1524f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c0097c0 tx=0x7fcd3c01c450 comp rx=0 tx=0).stop 2023-05-15T16:40:29.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd54205640 1 -- 172.21.15.62:0/599544057 shutdown_connections 2023-05-15T16:40:29.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd54205640 1 --2- 172.21.15.62:0/599544057 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd4c147c30 0x7fcd4c1524f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd54205640 1 --2- 172.21.15.62:0/599544057 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd4c0b4100 0x7fcd4c0b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd54205640 1 -- 172.21.15.62:0/599544057 >> 172.21.15.62:0/599544057 conn(0x7fcd4c0697b0 msgr2=0x7fcd4c069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:29.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd54205640 1 -- 172.21.15.62:0/599544057 shutdown_connections 2023-05-15T16:40:29.568 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd54205640 1 -- 172.21.15.62:0/599544057 wait complete. 2023-05-15T16:40:29.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd54205640 1 Processor -- start 2023-05-15T16:40:29.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd54205640 1 -- start start 2023-05-15T16:40:29.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd54205640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd4c0b3080 0x7fcd4c138960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:29.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd54205640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd4c0b4100 0x7fcd4c1e3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:29.570 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd54205640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd4c147c30 0x7fcd4c135180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:29.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd54205640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c138ea0 con 0x7fcd4c147c30 2023-05-15T16:40:29.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd54205640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c1e3ad0 con 0x7fcd4c0b4100 2023-05-15T16:40:29.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd54205640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c06f4d0 con 0x7fcd4c0b3080 2023-05-15T16:40:29.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd527a2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd4c147c30 0x7fcd4c135180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:29.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd527a2640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd4c147c30 0x7fcd4c135180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46966/0 (socket says 172.21.15.62:46966) 2023-05-15T16:40:29.571 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd527a2640 1 -- 172.21.15.62:0/3444557429 learned_addr learned my addr 172.21.15.62:0/3444557429 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:29.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd517a0640 1 --2- 172.21.15.62:0/3444557429 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd4c0b4100 0x7fcd4c1e3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:29.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd527a2640 1 -- 172.21.15.62:0/3444557429 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd4c0b3080 msgr2=0x7fcd4c138960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:29.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd527a2640 1 --2- 172.21.15.62:0/3444557429 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd4c0b3080 0x7fcd4c138960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd527a2640 1 -- 172.21.15.62:0/3444557429 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd4c0b4100 msgr2=0x7fcd4c1e3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:29.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd527a2640 1 --2- 172.21.15.62:0/3444557429 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd4c0b4100 0x7fcd4c1e3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.563+0000 7fcd527a2640 1 -- 172.21.15.62:0/3444557429 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c009420 con 0x7fcd4c147c30 2023-05-15T16:40:29.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.567+0000 7fcd527a2640 1 --2- 172.21.15.62:0/3444557429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd4c147c30 0x7fcd4c135180 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c0097c0 tx=0x7fcd3c01ac90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:29.572 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.567+0000 7fcd4a7fc640 1 -- 172.21.15.62:0/3444557429 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c004230 con 0x7fcd4c147c30 2023-05-15T16:40:29.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.567+0000 7fcd4a7fc640 1 -- 172.21.15.62:0/3444557429 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3c0b9070 con 0x7fcd4c147c30 2023-05-15T16:40:29.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.567+0000 7fcd54205640 1 -- 172.21.15.62:0/3444557429 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4c0b44d0 con 0x7fcd4c147c30 2023-05-15T16:40:29.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.567+0000 7fcd4a7fc640 1 -- 172.21.15.62:0/3444557429 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3c003620 con 0x7fcd4c147c30 2023-05-15T16:40:29.573 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.567+0000 7fcd54205640 1 -- 172.21.15.62:0/3444557429 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4c0b6ee0 con 0x7fcd4c147c30 2023-05-15T16:40:29.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.567+0000 7fcd54205640 1 -- 172.21.15.62:0/3444557429 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4c0a1dc0 con 0x7fcd4c147c30 2023-05-15T16:40:29.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.567+0000 7fcd4a7fc640 1 -- 172.21.15.62:0/3444557429 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fcd3c003780 con 0x7fcd4c147c30 2023-05-15T16:40:29.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.567+0000 7fcd4a7fc640 1 --2- 172.21.15.62:0/3444557429 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcd38065380 0x7fcd38067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:29.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.567+0000 7fcd4a7fc640 1 -- 172.21.15.62:0/3444557429 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcd3c0bb070 con 0x7fcd4c147c30 2023-05-15T16:40:29.574 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.567+0000 7fcd51fa1640 1 --2- 172.21.15.62:0/3444557429 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcd38065380 0x7fcd38067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:29.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.567+0000 7fcd51fa1640 1 --2- 172.21.15.62:0/3444557429 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcd38065380 0x7fcd38067830 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcd440094c0 tx=0x7fcd44009430 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:29.575 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.571+0000 7fcd4a7fc640 1 -- 172.21.15.62:0/3444557429 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fcd3c0eb3c0 con 0x7fcd4c147c30 2023-05-15T16:40:29.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.719+0000 7fcd54205640 1 -- 172.21.15.62:0/3444557429 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcd4c067960 con 0x7fcd4c147c30 2023-05-15T16:40:29.725 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.723+0000 7fcd4a7fc640 1 -- 172.21.15.62:0/3444557429 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcd3c0ee9e0 con 0x7fcd4c147c30 2023-05-15T16:40:29.726 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 32 2023-05-15T16:40:29.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.723+0000 7fcd54205640 1 -- 172.21.15.62:0/3444557429 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcd38065380 msgr2=0x7fcd38067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:29.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.723+0000 7fcd54205640 1 --2- 172.21.15.62:0/3444557429 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcd38065380 0x7fcd38067830 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fcd440094c0 tx=0x7fcd44009430 comp rx=0 tx=0).stop 2023-05-15T16:40:29.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.723+0000 7fcd54205640 1 -- 172.21.15.62:0/3444557429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd4c147c30 msgr2=0x7fcd4c135180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:29.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.723+0000 7fcd54205640 1 --2- 172.21.15.62:0/3444557429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd4c147c30 0x7fcd4c135180 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c0097c0 tx=0x7fcd3c01ac90 comp rx=0 tx=0).stop 2023-05-15T16:40:29.727 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.723+0000 7fcd54205640 1 -- 172.21.15.62:0/3444557429 shutdown_connections 2023-05-15T16:40:29.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.723+0000 7fcd54205640 1 --2- 172.21.15.62:0/3444557429 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcd38065380 0x7fcd38067830 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.723+0000 7fcd54205640 1 --2- 172.21.15.62:0/3444557429 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcd4c147c30 0x7fcd4c135180 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.723+0000 7fcd54205640 1 --2- 172.21.15.62:0/3444557429 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcd4c0b4100 0x7fcd4c1e3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.723+0000 7fcd54205640 1 --2- 172.21.15.62:0/3444557429 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcd4c0b3080 0x7fcd4c138960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.723+0000 7fcd54205640 1 -- 172.21.15.62:0/3444557429 >> 172.21.15.62:0/3444557429 conn(0x7fcd4c0697b0 msgr2=0x7fcd4c0ba300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:29.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.723+0000 7fcd54205640 1 -- 172.21.15.62:0/3444557429 shutdown_connections 2023-05-15T16:40:29.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.723+0000 7fcd54205640 1 -- 172.21.15.62:0/3444557429 wait complete. 2023-05-15T16:40:29.742 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-05-15T16:40:29.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.867+0000 7fa0e6a1b640 1 Processor -- start 2023-05-15T16:40:29.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.867+0000 7fa0e6a1b640 1 -- start start 2023-05-15T16:40:29.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.867+0000 7fa0e6a1b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa0e00b4100 0x7fa0e00b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:29.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.867+0000 7fa0e6a1b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0e00b3080 0x7fa0e0141c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:29.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.867+0000 7fa0e6a1b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0e00b7400 con 0x7fa0e01421b0 2023-05-15T16:40:29.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.867+0000 7fa0e6a1b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0e00b4e70 con 0x7fa0e00b4100 2023-05-15T16:40:29.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.867+0000 7fa0e6a1b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e00b6640 con 0x7fa0e00b3080 2023-05-15T16:40:29.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.867+0000 7fa0dffff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa0e00b4100 0x7fa0e00b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:29.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.867+0000 7fa0e4fb8640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa0e01421b0 0x7fa0e0147c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32842/0 (socket says 172.21.15.62:32842) 2023-05-15T16:40:29.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.867+0000 7fa0e4fb8640 1 -- 172.21.15.62:0/905917840 learned_addr learned my addr 172.21.15.62:0/905917840 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:29.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.867+0000 7fa0df7fe640 1 --2- 172.21.15.62:0/905917840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0e00b3080 0x7fa0e0141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:29.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.867+0000 7fa0dffff640 1 -- 172.21.15.62:0/905917840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0e00b3080 msgr2=0x7fa0e0141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:29.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.867+0000 7fa0dffff640 1 --2- 172.21.15.62:0/905917840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0e00b3080 0x7fa0e0141c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.867+0000 7fa0dffff640 1 -- 172.21.15.62:0/905917840 >> v1:172.21.15.62:6789/0 conn(0x7fa0e01421b0 legacy=0x7fa0e0147c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:29.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.867+0000 7fa0dffff640 1 -- 172.21.15.62:0/905917840 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0e00b6920 con 0x7fa0e00b4100 2023-05-15T16:40:29.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.867+0000 7fa0deffd640 1 -- 172.21.15.62:0/905917840 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2008537528 0 0) 0x7fa0e00b7400 con 0x7fa0e01421b0 2023-05-15T16:40:29.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.867+0000 7fa0df7fe640 1 --2- 172.21.15.62:0/905917840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0e00b3080 0x7fa0e0141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:29.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0dffff640 1 --2- 172.21.15.62:0/905917840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e00b4100 0x7fa0e00b38a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00097c0 tx=0x7fa0d001c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38cdddb243f52aaa server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:29.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0deffd640 1 -- 172.21.15.62:0/905917840 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d00ab650 con 0x7fa0e00b4100 2023-05-15T16:40:29.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0deffd640 1 -- 172.21.15.62:0/905917840 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d00ab7b0 con 0x7fa0e00b4100 2023-05-15T16:40:29.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0deffd640 1 -- 172.21.15.62:0/905917840 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d00abb40 con 0x7fa0e00b4100 2023-05-15T16:40:29.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e6a1b640 1 -- 172.21.15.62:0/905917840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e00b4100 msgr2=0x7fa0e00b38a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:29.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e6a1b640 1 --2- 172.21.15.62:0/905917840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e00b4100 0x7fa0e00b38a0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00097c0 tx=0x7fa0d001c450 comp rx=0 tx=0).stop 2023-05-15T16:40:29.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e6a1b640 1 -- 172.21.15.62:0/905917840 shutdown_connections 2023-05-15T16:40:29.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e6a1b640 1 --2- 172.21.15.62:0/905917840 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0e00b3080 0x7fa0e0141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e6a1b640 1 --2- 172.21.15.62:0/905917840 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e00b4100 0x7fa0e00b38a0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e6a1b640 1 -- 172.21.15.62:0/905917840 >> 172.21.15.62:0/905917840 conn(0x7fa0e00697b0 msgr2=0x7fa0e0069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:29.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e6a1b640 1 -- 172.21.15.62:0/905917840 shutdown_connections 2023-05-15T16:40:29.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e6a1b640 1 -- 172.21.15.62:0/905917840 wait complete. 2023-05-15T16:40:29.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e6a1b640 1 Processor -- start 2023-05-15T16:40:29.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e6a1b640 1 -- start start 2023-05-15T16:40:29.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e6a1b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0e00b3080 0x7fa0e01e2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:29.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e6a1b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0e00b4100 0x7fa0e012f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:29.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e6a1b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e01421b0 0x7fa0e0127ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:29.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e6a1b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e0128410 con 0x7fa0e01421b0 2023-05-15T16:40:29.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e6a1b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e012e060 con 0x7fa0e00b4100 2023-05-15T16:40:29.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e6a1b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0e01e1c20 con 0x7fa0e00b3080 2023-05-15T16:40:29.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e4fb8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e01421b0 0x7fa0e0127ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:29.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e4fb8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e01421b0 0x7fa0e0127ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46982/0 (socket says 172.21.15.62:46982) 2023-05-15T16:40:29.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e4fb8640 1 -- 172.21.15.62:0/3742196655 learned_addr learned my addr 172.21.15.62:0/3742196655 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:29.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0dffff640 1 --2- 172.21.15.62:0/3742196655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0e00b3080 0x7fa0e01e2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:29.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0df7fe640 1 --2- 172.21.15.62:0/3742196655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0e00b4100 0x7fa0e012f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:29.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e4fb8640 1 -- 172.21.15.62:0/3742196655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0e00b3080 msgr2=0x7fa0e01e2690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:29.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e4fb8640 1 --2- 172.21.15.62:0/3742196655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0e00b3080 0x7fa0e01e2690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e4fb8640 1 -- 172.21.15.62:0/3742196655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0e00b4100 msgr2=0x7fa0e012f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:29.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e4fb8640 1 --2- 172.21.15.62:0/3742196655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0e00b4100 0x7fa0e012f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:29.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e4fb8640 1 -- 172.21.15.62:0/3742196655 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0d0009420 con 0x7fa0e01421b0 2023-05-15T16:40:29.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0dffff640 1 --2- 172.21.15.62:0/3742196655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0e00b3080 0x7fa0e01e2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:29.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0df7fe640 1 --2- 172.21.15.62:0/3742196655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0e00b4100 0x7fa0e012f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:29.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e4fb8640 1 --2- 172.21.15.62:0/3742196655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e01421b0 0x7fa0e0127ed0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa0d800c6a0 tx=0x7fa0d800cb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:29.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0dcff9640 1 -- 172.21.15.62:0/3742196655 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d8004d70 con 0x7fa0e01421b0 2023-05-15T16:40:29.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0dcff9640 1 -- 172.21.15.62:0/3742196655 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0d800a640 con 0x7fa0e01421b0 2023-05-15T16:40:29.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.871+0000 7fa0e6a1b640 1 -- 172.21.15.62:0/3742196655 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0e00b44d0 con 0x7fa0e01421b0 2023-05-15T16:40:29.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.875+0000 7fa0dcff9640 1 -- 172.21.15.62:0/3742196655 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0d800a9f0 con 0x7fa0e01421b0 2023-05-15T16:40:29.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.875+0000 7fa0e6a1b640 1 -- 172.21.15.62:0/3742196655 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0e0148340 con 0x7fa0e01421b0 2023-05-15T16:40:29.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.875+0000 7fa0e6a1b640 1 -- 172.21.15.62:0/3742196655 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0e00a1dc0 con 0x7fa0e01421b0 2023-05-15T16:40:29.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.875+0000 7fa0dcff9640 1 -- 172.21.15.62:0/3742196655 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fa0d800ab50 con 0x7fa0e01421b0 2023-05-15T16:40:29.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.875+0000 7fa0dcff9640 1 --2- 172.21.15.62:0/3742196655 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa0c00653b0 0x7fa0c0067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:29.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.875+0000 7fa0dcff9640 1 -- 172.21.15.62:0/3742196655 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa0d8082000 con 0x7fa0e01421b0 2023-05-15T16:40:29.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.875+0000 7fa0dffff640 1 --2- 172.21.15.62:0/3742196655 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa0c00653b0 0x7fa0c0067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:29.882 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.875+0000 7fa0dffff640 1 --2- 172.21.15.62:0/3742196655 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa0c00653b0 0x7fa0c0067860 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00af000 tx=0x7fa0d00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:29.883 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:29.879+0000 7fa0dcff9640 1 -- 172.21.15.62:0/3742196655 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fa0d804fb90 con 0x7fa0e01421b0 2023-05-15T16:40:30.028 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.023+0000 7fa0e6a1b640 1 -- 172.21.15.62:0/3742196655 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fa0e0067960 con 0x7fa0e01421b0 2023-05-15T16:40:30.029 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.023+0000 7fa0dcff9640 1 -- 172.21.15.62:0/3742196655 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) v1 ==== 100+0+11 (secure 0 0 0) 0x7fa0d80180a0 con 0x7fa0e01421b0 2023-05-15T16:40:30.029 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 64 2023-05-15T16:40:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.027+0000 7fa0e6a1b640 1 -- 172.21.15.62:0/3742196655 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa0c00653b0 msgr2=0x7fa0c0067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:30.031 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.027+0000 7fa0e6a1b640 1 --2- 172.21.15.62:0/3742196655 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa0c00653b0 0x7fa0c0067860 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa0d00af000 tx=0x7fa0d00a7000 comp rx=0 tx=0).stop 2023-05-15T16:40:30.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.027+0000 7fa0e6a1b640 1 -- 172.21.15.62:0/3742196655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e01421b0 msgr2=0x7fa0e0127ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:30.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.027+0000 7fa0e6a1b640 1 --2- 172.21.15.62:0/3742196655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e01421b0 0x7fa0e0127ed0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa0d800c6a0 tx=0x7fa0d800cb60 comp rx=0 tx=0).stop 2023-05-15T16:40:30.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.027+0000 7fa0e6a1b640 1 -- 172.21.15.62:0/3742196655 shutdown_connections 2023-05-15T16:40:30.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.027+0000 7fa0e6a1b640 1 --2- 172.21.15.62:0/3742196655 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa0c00653b0 0x7fa0c0067860 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.027+0000 7fa0e6a1b640 1 --2- 172.21.15.62:0/3742196655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa0e01421b0 0x7fa0e0127ed0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.032 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.027+0000 7fa0e6a1b640 1 --2- 172.21.15.62:0/3742196655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa0e00b4100 0x7fa0e012f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.027+0000 7fa0e6a1b640 1 --2- 172.21.15.62:0/3742196655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa0e00b3080 0x7fa0e01e2690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.027+0000 7fa0e6a1b640 1 -- 172.21.15.62:0/3742196655 >> 172.21.15.62:0/3742196655 conn(0x7fa0e00697b0 msgr2=0x7fa0e013d690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:30.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.027+0000 7fa0e6a1b640 1 -- 172.21.15.62:0/3742196655 shutdown_connections 2023-05-15T16:40:30.033 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.027+0000 7fa0e6a1b640 1 -- 172.21.15.62:0/3742196655 wait complete. 2023-05-15T16:40:30.047 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-15T16:40:30.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.155+0000 7fc82ff64640 1 Processor -- start 2023-05-15T16:40:30.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.159+0000 7fc82ff64640 1 -- start start 2023-05-15T16:40:30.162 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.159+0000 7fc82ff64640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc82814a8d0 0x7fc8281554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.159+0000 7fc82ff64640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc828149d30 con 0x7fc82806b050 2023-05-15T16:40:30.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.159+0000 7fc82ff64640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc82806b5e0 con 0x7fc8280bcd70 2023-05-15T16:40:30.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.159+0000 7fc82ff64640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc82806b8c0 con 0x7fc82814a8d0 2023-05-15T16:40:30.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.159+0000 7fc82e501640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fc82814a8d0 0x7fc8281554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:30.163 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.159+0000 7fc82d4ff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc82806b050 0x7fc82814a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32844/0 (socket says 172.21.15.62:32844) 2023-05-15T16:40:30.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.159+0000 7fc82d4ff640 1 -- 172.21.15.62:0/3438581841 learned_addr learned my addr 172.21.15.62:0/3438581841 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:30.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.159+0000 7fc82e501640 1 -- 172.21.15.62:0/3438581841 >> v1:172.21.15.161:6789/0 conn(0x7fc8280bcd70 legacy=0x7fc8280badc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:30.164 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.159+0000 7fc82e501640 1 -- 172.21.15.62:0/3438581841 >> v1:172.21.15.62:6789/0 conn(0x7fc82806b050 legacy=0x7fc82814a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:30.165 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.159+0000 7fc82e501640 1 -- 172.21.15.62:0/3438581841 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc82806bba0 con 0x7fc82814a8d0 2023-05-15T16:40:30.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.159+0000 7fc82e501640 1 --2- 172.21.15.62:0/3438581841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc82814a8d0 0x7fc8281554e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc820009dc0 tx=0x7fc82001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c88a60acc780f83 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:30.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.159+0000 7fc82ccfe640 1 -- 172.21.15.62:0/3438581841 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8200a58c0 con 0x7fc82814a8d0 2023-05-15T16:40:30.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.159+0000 7fc82ccfe640 1 -- 172.21.15.62:0/3438581841 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8200a5a20 con 0x7fc82814a8d0 2023-05-15T16:40:30.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.159+0000 7fc82ccfe640 1 -- 172.21.15.62:0/3438581841 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8200a5db0 con 0x7fc82814a8d0 2023-05-15T16:40:30.166 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82ff64640 1 -- 172.21.15.62:0/3438581841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc82814a8d0 msgr2=0x7fc8281554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:30.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82ff64640 1 --2- 172.21.15.62:0/3438581841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc82814a8d0 0x7fc8281554e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc820009dc0 tx=0x7fc82001c8f0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82ff64640 1 -- 172.21.15.62:0/3438581841 shutdown_connections 2023-05-15T16:40:30.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82ff64640 1 --2- 172.21.15.62:0/3438581841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc82814a8d0 0x7fc8281554e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82ff64640 1 -- 172.21.15.62:0/3438581841 >> 172.21.15.62:0/3438581841 conn(0x7fc8280bff80 msgr2=0x7fc8280c0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:30.167 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82ff64640 1 -- 172.21.15.62:0/3438581841 shutdown_connections 2023-05-15T16:40:30.168 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82ff64640 1 -- 172.21.15.62:0/3438581841 wait complete. 2023-05-15T16:40:30.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82ff64640 1 Processor -- start 2023-05-15T16:40:30.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82ff64640 1 -- start start 2023-05-15T16:40:30.170 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82ff64640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc82806b050 0x7fc828143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82ff64640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8280bcd70 0x7fc828140cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82ff64640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc82814a8d0 0x7fc828141200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82ff64640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8280a4910 con 0x7fc82806b050 2023-05-15T16:40:30.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82ff64640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc828144270 con 0x7fc8280bcd70 2023-05-15T16:40:30.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82ff64640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8280a5d70 con 0x7fc82814a8d0 2023-05-15T16:40:30.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82dd00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc82806b050 0x7fc828143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:30.171 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82dd00640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc82806b050 0x7fc828143d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:46998/0 (socket says 172.21.15.62:46998) 2023-05-15T16:40:30.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82dd00640 1 -- 172.21.15.62:0/3282891935 learned_addr learned my addr 172.21.15.62:0/3282891935 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:30.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82d4ff640 1 --2- 172.21.15.62:0/3282891935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8280bcd70 0x7fc828140cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:30.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82e501640 1 --2- 172.21.15.62:0/3282891935 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc82814a8d0 0x7fc828141200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:30.172 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82dd00640 1 -- 172.21.15.62:0/3282891935 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc82814a8d0 msgr2=0x7fc828141200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:30.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82dd00640 1 --2- 172.21.15.62:0/3282891935 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc82814a8d0 0x7fc828141200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82dd00640 1 -- 172.21.15.62:0/3282891935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8280bcd70 msgr2=0x7fc828140cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:30.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82dd00640 1 --2- 172.21.15.62:0/3282891935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8280bcd70 0x7fc828140cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82dd00640 1 -- 172.21.15.62:0/3282891935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc820009a70 con 0x7fc82806b050 2023-05-15T16:40:30.173 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82e501640 1 --2- 172.21.15.62:0/3282891935 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc82814a8d0 0x7fc828141200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:30.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82dd00640 1 --2- 172.21.15.62:0/3282891935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc82806b050 0x7fc828143d30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00c450 tx=0x7fc81c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:30.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc81a7fc640 1 -- 172.21.15.62:0/3282891935 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c012830 con 0x7fc82806b050 2023-05-15T16:40:30.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc81a7fc640 1 -- 172.21.15.62:0/3282891935 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc81c0129b0 con 0x7fc82806b050 2023-05-15T16:40:30.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82ff64640 1 -- 172.21.15.62:0/3282891935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8281587e0 con 0x7fc82806b050 2023-05-15T16:40:30.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc81a7fc640 1 -- 172.21.15.62:0/3282891935 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc81c012d60 con 0x7fc82806b050 2023-05-15T16:40:30.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.163+0000 7fc82ff64640 1 -- 172.21.15.62:0/3282891935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc828158650 con 0x7fc82806b050 2023-05-15T16:40:30.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.167+0000 7fc82ff64640 1 -- 172.21.15.62:0/3282891935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc828158970 con 0x7fc82806b050 2023-05-15T16:40:30.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.167+0000 7fc81a7fc640 1 -- 172.21.15.62:0/3282891935 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fc81c01c460 con 0x7fc82806b050 2023-05-15T16:40:30.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.167+0000 7fc81a7fc640 1 --2- 172.21.15.62:0/3282891935 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc80c065380 0x7fc80c067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.167+0000 7fc81a7fc640 1 -- 172.21.15.62:0/3282891935 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fc81c0826b0 con 0x7fc82806b050 2023-05-15T16:40:30.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.167+0000 7fc82d4ff640 1 --2- 172.21.15.62:0/3282891935 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc80c065380 0x7fc80c067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:30.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.167+0000 7fc82d4ff640 1 --2- 172.21.15.62:0/3282891935 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc80c065380 0x7fc80c067830 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc8280ad680 tx=0x7fc824009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:30.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.171+0000 7fc81a7fc640 1 -- 172.21.15.62:0/3282891935 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fc81c0502d0 con 0x7fc82806b050 2023-05-15T16:40:30.360 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.355+0000 7fc82ff64640 1 -- 172.21.15.62:0/3282891935 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc828067960 con 0x7fc82806b050 2023-05-15T16:40:30.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.355+0000 7fc81a7fc640 1 -- 172.21.15.62:0/3282891935 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3889 (secure 0 0 0) 0x7fc81c0538f0 con 0x7fc82806b050 2023-05-15T16:40:30.361 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:30.363 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1731611654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1731611654},{"type":"v1","addr":"172.21.15.161:6835","nonce":1731611654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2563537601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2563537601},{"type":"v1","addr":"172.21.15.62:6834","nonce":2563537601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-15T16:40:01.085500+0000","modified":"2023-05-15T16:40:03.744733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/2804159919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2804159919},{"type":"v1","addr":"172.21.15.62:6835","nonce":2804159919}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-15T16:40:30.365 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 7 2023-05-15T16:40:30.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.359+0000 7fc82ff64640 1 -- 172.21.15.62:0/3282891935 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc80c065380 msgr2=0x7fc80c067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:30.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.359+0000 7fc82ff64640 1 --2- 172.21.15.62:0/3282891935 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc80c065380 0x7fc80c067830 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc8280ad680 tx=0x7fc824009040 comp rx=0 tx=0).stop 2023-05-15T16:40:30.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.359+0000 7fc82ff64640 1 -- 172.21.15.62:0/3282891935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc82806b050 msgr2=0x7fc828143d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:30.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.359+0000 7fc82ff64640 1 --2- 172.21.15.62:0/3282891935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc82806b050 0x7fc828143d30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00c450 tx=0x7fc81c00c910 comp rx=0 tx=0).stop 2023-05-15T16:40:30.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.359+0000 7fc82ff64640 1 -- 172.21.15.62:0/3282891935 shutdown_connections 2023-05-15T16:40:30.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.359+0000 7fc82ff64640 1 --2- 172.21.15.62:0/3282891935 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc82814a8d0 0x7fc828141200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.359+0000 7fc82ff64640 1 --2- 172.21.15.62:0/3282891935 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc8280bcd70 0x7fc828140cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.359+0000 7fc82ff64640 1 --2- 172.21.15.62:0/3282891935 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc80c065380 0x7fc80c067830 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.359+0000 7fc82ff64640 1 --2- 172.21.15.62:0/3282891935 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc82806b050 0x7fc828143d30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.359+0000 7fc82ff64640 1 -- 172.21.15.62:0/3282891935 >> 172.21.15.62:0/3282891935 conn(0x7fc8280bff80 msgr2=0x7fc8281451c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:30.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.359+0000 7fc82ff64640 1 -- 172.21.15.62:0/3282891935 shutdown_connections 2023-05-15T16:40:30.366 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.359+0000 7fc82ff64640 1 -- 172.21.15.62:0/3282891935 wait complete. 2023-05-15T16:40:30.379 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-15T16:40:30.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.487+0000 7f1137395640 1 Processor -- start 2023-05-15T16:40:30.493 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.487+0000 7f1137395640 1 -- start start 2023-05-15T16:40:30.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1137395640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11300705c0 0x7f1130149c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1137395640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f113006ce50 0x7f113014a190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.494 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1137395640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f113006e680 con 0x7f113006ad80 2023-05-15T16:40:30.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1137395640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f113014a6d0 con 0x7f113006ce50 2023-05-15T16:40:30.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1137395640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f113006d860 con 0x7f11300705c0 2023-05-15T16:40:30.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1135932640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f113006ad80 0x7f113006b180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32846/0 (socket says 172.21.15.62:32846) 2023-05-15T16:40:30.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1135932640 1 -- 172.21.15.62:0/3496846296 learned_addr learned my addr 172.21.15.62:0/3496846296 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:30.495 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1135131640 1 --2- 172.21.15.62:0/3496846296 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11300705c0 0x7f1130149c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:30.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1134930640 1 --2- 172.21.15.62:0/3496846296 >> v2:172.21.15.161:3300/0 conn(0x7f113006ce50 0x7f113014a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:30.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1127fff640 1 -- 172.21.15.62:0/3496846296 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801241056 0 0) 0x7f113006e680 con 0x7f113006ad80 2023-05-15T16:40:30.496 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1127fff640 1 -- 172.21.15.62:0/3496846296 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1118003530 con 0x7f113006ad80 2023-05-15T16:40:30.497 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1127fff640 1 -- 172.21.15.62:0/3496846296 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 558756651 0 0) 0x7f1118003530 con 0x7f113006ad80 2023-05-15T16:40:30.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1127fff640 1 -- 172.21.15.62:0/3496846296 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11300705c0 msgr2=0x7f1130149c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:30.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1127fff640 1 --2- 172.21.15.62:0/3496846296 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11300705c0 0x7f1130149c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1127fff640 1 -- 172.21.15.62:0/3496846296 >> v2:172.21.15.161:3300/0 conn(0x7f113006ce50 msgr2=0x7f113014a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:30.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1127fff640 1 --2- 172.21.15.62:0/3496846296 >> v2:172.21.15.161:3300/0 conn(0x7f113006ce50 0x7f113014a190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1127fff640 1 -- 172.21.15.62:0/3496846296 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113006dd90 con 0x7f113006ad80 2023-05-15T16:40:30.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1127fff640 1 -- 172.21.15.62:0/3496846296 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7f1120001680 con 0x7f113006ad80 2023-05-15T16:40:30.498 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1127fff640 1 -- 172.21.15.62:0/3496846296 >> v1:172.21.15.62:6789/0 conn(0x7f113006ad80 legacy=0x7f113006b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:30.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1127fff640 1 --2- 172.21.15.62:0/3496846296 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11300705c0 0x7f1118003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1127fff640 1 --2- 172.21.15.62:0/3496846296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1118003f50 0x7f11180047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1127fff640 1 --2- 172.21.15.62:0/3496846296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1118004d10 0x7f1118005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.499 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1127fff640 1 -- 172.21.15.62:0/3496846296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113014a6d0 con 0x7f1118003f50 2023-05-15T16:40:30.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1127fff640 1 -- 172.21.15.62:0/3496846296 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f113006d860 con 0x7f1118004d10 2023-05-15T16:40:30.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1127fff640 1 -- 172.21.15.62:0/3496846296 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f111800ba10 con 0x7f11300705c0 2023-05-15T16:40:30.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1134930640 1 --2- 172.21.15.62:0/3496846296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1118003f50 0x7f11180047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:30.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1135131640 1 --2- 172.21.15.62:0/3496846296 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11300705c0 0x7f1118003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:30.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1135932640 1 --2- 172.21.15.62:0/3496846296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1118004d10 0x7f1118005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:30.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1134930640 1 -- 172.21.15.62:0/3496846296 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11300705c0 msgr2=0x7f1118003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:30.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1134930640 1 --2- 172.21.15.62:0/3496846296 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f11300705c0 0x7f1118003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1134930640 1 -- 172.21.15.62:0/3496846296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1118004d10 msgr2=0x7f1118005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:30.502 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1134930640 1 --2- 172.21.15.62:0/3496846296 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1118004d10 0x7f1118005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.491+0000 7f1134930640 1 -- 172.21.15.62:0/3496846296 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1118003530 con 0x7f1118003f50 2023-05-15T16:40:30.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.495+0000 7f1134930640 1 --2- 172.21.15.62:0/3496846296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1118003f50 0x7f11180047d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1128009fc0 tx=0x7f112801cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=866a0c6f9f06fc26 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:30.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.495+0000 7f1127fff640 1 -- 172.21.15.62:0/3496846296 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11280a5cb0 con 0x7f1118003f50 2023-05-15T16:40:30.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.495+0000 7f1127fff640 1 -- 172.21.15.62:0/3496846296 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112800f040 con 0x7f1118003f50 2023-05-15T16:40:30.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.495+0000 7f1127fff640 1 -- 172.21.15.62:0/3496846296 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11280ad680 con 0x7f1118003f50 2023-05-15T16:40:30.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.495+0000 7f1137395640 1 -- 172.21.15.62:0/3496846296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1118003f50 msgr2=0x7f11180047d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:30.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.495+0000 7f1137395640 1 --2- 172.21.15.62:0/3496846296 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1118003f50 0x7f11180047d0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1128009fc0 tx=0x7f112801cca0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.495+0000 7f1135932640 1 -- 172.21.15.62:0/3496846296 reap_dead start 2023-05-15T16:40:30.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.495+0000 7f1137395640 1 -- 172.21.15.62:0/3496846296 shutdown_connections 2023-05-15T16:40:30.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.495+0000 7f1137395640 1 -- 172.21.15.62:0/3496846296 >> 172.21.15.62:0/3496846296 conn(0x7f11300bdce0 msgr2=0x7f11300be0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:30.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.495+0000 7f1137395640 1 -- 172.21.15.62:0/3496846296 shutdown_connections 2023-05-15T16:40:30.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.495+0000 7f1137395640 1 -- 172.21.15.62:0/3496846296 wait complete. 2023-05-15T16:40:30.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.495+0000 7f1137395640 1 Processor -- start 2023-05-15T16:40:30.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.495+0000 7f1137395640 1 -- start start 2023-05-15T16:40:30.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.495+0000 7f1137395640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1118003f50 0x7f11300b35b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.495+0000 7f1137395640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11300b43b0 0x7f11301df770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.508 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.495+0000 7f1137395640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11301dfcb0 0x7f11300b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.495+0000 7f1137395640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11301e0120 con 0x7f11301dfcb0 2023-05-15T16:40:30.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.495+0000 7f1137395640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11301e2cc0 con 0x7f11300b43b0 2023-05-15T16:40:30.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.495+0000 7f1137395640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11301e3840 con 0x7f1118003f50 2023-05-15T16:40:30.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1135932640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11301dfcb0 0x7f11300b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:30.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1135932640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11301dfcb0 0x7f11300b0900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47030/0 (socket says 172.21.15.62:47030) 2023-05-15T16:40:30.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1135932640 1 -- 172.21.15.62:0/2337159434 learned_addr learned my addr 172.21.15.62:0/2337159434 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:30.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1135131640 1 --2- 172.21.15.62:0/2337159434 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1118003f50 0x7f11300b35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:30.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1134930640 1 --2- 172.21.15.62:0/2337159434 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11300b43b0 0x7f11301df770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:30.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1135932640 1 -- 172.21.15.62:0/2337159434 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1118003f50 msgr2=0x7f11300b35b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:30.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1135932640 1 --2- 172.21.15.62:0/2337159434 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1118003f50 0x7f11300b35b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1135932640 1 -- 172.21.15.62:0/2337159434 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11300b43b0 msgr2=0x7f11301df770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:30.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1135932640 1 --2- 172.21.15.62:0/2337159434 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11300b43b0 0x7f11301df770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1135932640 1 -- 172.21.15.62:0/2337159434 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113006e310 con 0x7f11301dfcb0 2023-05-15T16:40:30.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1135932640 1 --2- 172.21.15.62:0/2337159434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11301dfcb0 0x7f11300b0900 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f112000e4d0 tx=0x7f112000e5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:30.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1125ffb640 1 -- 172.21.15.62:0/2337159434 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f112000eb70 con 0x7f11301dfcb0 2023-05-15T16:40:30.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1125ffb640 1 -- 172.21.15.62:0/2337159434 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f112000ecd0 con 0x7f11301dfcb0 2023-05-15T16:40:30.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1137395640 1 -- 172.21.15.62:0/2337159434 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f113006e030 con 0x7f11301dfcb0 2023-05-15T16:40:30.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1125ffb640 1 -- 172.21.15.62:0/2337159434 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1120014430 con 0x7f11301dfcb0 2023-05-15T16:40:30.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1137395640 1 -- 172.21.15.62:0/2337159434 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1130147500 con 0x7f11301dfcb0 2023-05-15T16:40:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1137395640 1 -- 172.21.15.62:0/2337159434 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1130067960 con 0x7f11301dfcb0 2023-05-15T16:40:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1125ffb640 1 -- 172.21.15.62:0/2337159434 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f1120014590 con 0x7f11301dfcb0 2023-05-15T16:40:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1125ffb640 1 --2- 172.21.15.62:0/2337159434 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f111c0653b0 0x7f111c067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1125ffb640 1 -- 172.21.15.62:0/2337159434 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f11200817d0 con 0x7f11301dfcb0 2023-05-15T16:40:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1135131640 1 --2- 172.21.15.62:0/2337159434 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f111c0653b0 0x7f111c067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:30.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.499+0000 7f1135131640 1 --2- 172.21.15.62:0/2337159434 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f111c0653b0 0x7f111c067860 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f112c009890 tx=0x7f112c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:30.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.503+0000 7f1125ffb640 1 -- 172.21.15.62:0/2337159434 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f112004f3c0 con 0x7f11301dfcb0 2023-05-15T16:40:30.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.655+0000 7f1137395640 1 -- 172.21.15.62:0/2337159434 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f113004dbe0 con 0x7f11301dfcb0 2023-05-15T16:40:30.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.659+0000 7f1125ffb640 1 -- 172.21.15.62:0/2337159434 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17811 (secure 0 0 0) 0x7f11200529e0 con 0x7f11301dfcb0 2023-05-15T16:40:30.662 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:30.663 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:40:02.088078+0000","last_up_change":"2023-05-15T16:39:48.597049+0000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-15T16:39:49.394028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-15T16:39:55.208679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-15T16:39:59.547414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-15T16:40:00.055526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37594},{"type":"v1","addr":"172.21.15.62:6825","nonce":37594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37594},{"type":"v1","addr":"172.21.15.62:6827","nonce":37594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37594},{"type":"v1","addr":"172.21.15.62:6831","nonce":37594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37594},{"type":"v1","addr":"172.21.15.62:6829","nonce":37594}]},"public_addr":"172.21.15.62:6825/37594","cluster_addr":"172.21.15.62:6827/37594","heartbeat_back_addr":"172.21.15.62:6831/37594","heartbeat_front_addr":"172.21.15.62:6829/37594","state":["exists","up"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37592},{"type":"v1","addr":"172.21.15.62:6808","nonce":37592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":37592},{"type":"v1","addr":"172.21.15.62:6814","nonce":37592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6821","nonce":37592},{"type":"v1","addr":"172.21.15.62:6823","nonce":37592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37592},{"type":"v1","addr":"172.21.15.62:6818","nonce":37592}]},"public_addr":"172.21.15.62:6808/37592","cluster_addr":"172.21.15.62:6814/37592","heartbeat_back_addr":"172.21.15.62:6823/37592","heartbeat_front_addr":"172.21.15.62:6818/37592","state":["exists","up"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":37591},{"type":"v1","addr":"172.21.15.62:6810","nonce":37591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":37591},{"type":"v1","addr":"172.21.15.62:6815","nonce":37591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37591},{"type":"v1","addr":"172.21.15.62:6822","nonce":37591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":37591},{"type":"v1","addr":"172.21.15.62:6819","nonce":37591}]},"public_addr":"172.21.15.62:6810/37591","cluster_addr":"172.21.15.62:6815/37591","heartbeat_back_addr":"172.21.15.62:6822/37591","heartbeat_front_addr":"172.21.15.62:6819/37591","state":["exists","up"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37593},{"type":"v1","addr":"172.21.15.62:6801","nonce":37593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37593},{"type":"v1","addr":"172.21.15.62:6803","nonce":37593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":37593},{"type":"v1","addr":"172.21.15.62:6812","nonce":37593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37593},{"type":"v1","addr":"172.21.15.62:6805","nonce":37593}]},"public_addr":"172.21.15.62:6801/37593","cluster_addr":"172.21.15.62:6803/37593","heartbeat_back_addr":"172.21.15.62:6812/37593","heartbeat_front_addr":"172.21.15.62:6805/37593","state":["exists","up"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37854},{"type":"v1","addr":"172.21.15.161:6801","nonce":37854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37854},{"type":"v1","addr":"172.21.15.161:6803","nonce":37854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37854},{"type":"v1","addr":"172.21.15.161:6807","nonce":37854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37854},{"type":"v1","addr":"172.21.15.161:6805","nonce":37854}]},"public_addr":"172.21.15.161:6801/37854","cluster_addr":"172.21.15.161:6803/37854","heartbeat_back_addr":"172.21.15.161:6807/37854","heartbeat_front_addr":"172.21.15.161:6805/37854","state":["exists","up"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37855},{"type":"v1","addr":"172.21.15.161:6810","nonce":37855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37855},{"type":"v1","addr":"172.21.15.161:6815","nonce":37855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37855},{"type":"v1","addr":"172.21.15.161:6824","nonce":37855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37855},{"type":"v1","addr":"172.21.15.161:6820","nonce":37855}]},"public_addr":"172.21.15.161:6810/37855","cluster_addr":"172.21.15.161:6815/37855","heartbeat_back_addr":"172.21.15.161:6824/37855","heartbeat_front_addr":"172.21.15.161:6820/37855","state":["exists","up"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":37856},{"type":"v1","addr":"172.21.15.161:6814","nonce":37856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37856},{"type":"v1","addr":"172.21.15.161:6819","nonce":37856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":37856},{"type":"v1","addr":"172.21.15.161:6830","nonce":37856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37856},{"type":"v1","addr":"172.21.15.161:6826","nonce":37856}]},"public_addr":"172.21.15.161:6814/37856","cluster_addr":"172.21.15.161:6819/37856","heartbeat_back_addr":"172.21.15.161:6830/37856","heartbeat_front_addr":"172.21.15.161:6826/37856","state":["exists","up"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":37857},{"type":"v1","addr":"172.21.15.161:6813","nonce":37857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":37857},{"type":"v1","addr":"172.21.15.161:6821","nonce":37857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":37857},{"type":"v1","addr":"172.21.15.161:6831","nonce":37857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":37857},{"type":"v1","addr":"172.21.15.161:6827","nonce":37857}]},"public_addr":"172.21.15.161:6813/37857","cluster_addr":"172.21.15.161:6821/37857","heartbeat_back_addr":"172.21.15.161:6831/37857","heartbeat_front_addr":"172.21.15.161:6827/37857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.592907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.618143+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.641533+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.614355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.579293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.718353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.730135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.792887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:40:30.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.659+0000 7f1137395640 1 -- 172.21.15.62:0/2337159434 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f111c0653b0 msgr2=0x7f111c067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:30.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.659+0000 7f1137395640 1 --2- 172.21.15.62:0/2337159434 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f111c0653b0 0x7f111c067860 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f112c009890 tx=0x7f112c008040 comp rx=0 tx=0).stop 2023-05-15T16:40:30.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.659+0000 7f1137395640 1 -- 172.21.15.62:0/2337159434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11301dfcb0 msgr2=0x7f11300b0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:30.664 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.659+0000 7f1137395640 1 --2- 172.21.15.62:0/2337159434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11301dfcb0 0x7f11300b0900 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f112000e4d0 tx=0x7f112000e5c0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.659+0000 7f1137395640 1 -- 172.21.15.62:0/2337159434 shutdown_connections 2023-05-15T16:40:30.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.659+0000 7f1137395640 1 --2- 172.21.15.62:0/2337159434 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f111c0653b0 0x7f111c067860 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.659+0000 7f1137395640 1 --2- 172.21.15.62:0/2337159434 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f11301dfcb0 0x7f11300b0900 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.659+0000 7f1137395640 1 --2- 172.21.15.62:0/2337159434 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f11300b43b0 0x7f11301df770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.659+0000 7f1137395640 1 --2- 172.21.15.62:0/2337159434 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1118003f50 0x7f11300b35b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.659+0000 7f1137395640 1 -- 172.21.15.62:0/2337159434 >> 172.21.15.62:0/2337159434 conn(0x7f11300bdce0 msgr2=0x7f113006b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:30.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.659+0000 7f1137395640 1 -- 172.21.15.62:0/2337159434 shutdown_connections 2023-05-15T16:40:30.665 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.659+0000 7f1137395640 1 -- 172.21.15.62:0/2337159434 wait complete. 2023-05-15T16:40:30.680 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-05-15T16:40:30.680 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-15T16:40:30.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d95b9640 1 Processor -- start 2023-05-15T16:40:30.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d95b9640 1 -- start start 2023-05-15T16:40:30.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d95b9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d4071a90 0x7f97d40b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d95b9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f97d4144e90 0x7f97d4145310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d95b9640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97d40716b0 con 0x7f97d40b5330 2023-05-15T16:40:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d95b9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97d40b2280 con 0x7f97d4144e90 2023-05-15T16:40:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d95b9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d40afa90 con 0x7f97d4071a90 2023-05-15T16:40:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d2ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f97d40b5330 0x7f97d40b16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32848/0 (socket says 172.21.15.62:32848) 2023-05-15T16:40:30.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d2ffd640 1 -- 172.21.15.62:0/3546552965 learned_addr learned my addr 172.21.15.62:0/3546552965 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:30.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d1ffb640 1 -- 172.21.15.62:0/3546552965 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2275059861 0 0) 0x7f97d40716b0 con 0x7f97d40b5330 2023-05-15T16:40:30.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d1ffb640 1 -- 172.21.15.62:0/3546552965 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97bc003530 con 0x7f97d40b5330 2023-05-15T16:40:30.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d27fc640 1 --2- 172.21.15.62:0/3546552965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d4071a90 0x7f97d40b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:30.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d37fe640 1 --2- 172.21.15.62:0/3546552965 >> v2:172.21.15.161:3300/0 conn(0x7f97d4144e90 0x7f97d4145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:30.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d1ffb640 1 -- 172.21.15.62:0/3546552965 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2466119436 0 0) 0x7f97bc003530 con 0x7f97d40b5330 2023-05-15T16:40:30.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d1ffb640 1 -- 172.21.15.62:0/3546552965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d4071a90 msgr2=0x7f97d40b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:30.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d1ffb640 1 --2- 172.21.15.62:0/3546552965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d4071a90 0x7f97d40b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d1ffb640 1 -- 172.21.15.62:0/3546552965 >> v2:172.21.15.161:3300/0 conn(0x7f97d4144e90 msgr2=0x7f97d4145310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:30.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d1ffb640 1 --2- 172.21.15.62:0/3546552965 >> v2:172.21.15.161:3300/0 conn(0x7f97d4144e90 0x7f97d4145310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d1ffb640 1 -- 172.21.15.62:0/3546552965 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d40b0f00 con 0x7f97d40b5330 2023-05-15T16:40:30.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d1ffb640 1 -- 172.21.15.62:0/3546552965 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7f97c4001680 con 0x7f97d40b5330 2023-05-15T16:40:30.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d1ffb640 1 -- 172.21.15.62:0/3546552965 >> v1:172.21.15.62:6789/0 conn(0x7f97d40b5330 legacy=0x7f97d40b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:30.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d1ffb640 1 --2- 172.21.15.62:0/3546552965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97bc003980 0x7f97bc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d1ffb640 1 --2- 172.21.15.62:0/3546552965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d4071a90 0x7f97bc0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d1ffb640 1 --2- 172.21.15.62:0/3546552965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97bc004d10 0x7f97bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d1ffb640 1 -- 172.21.15.62:0/3546552965 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d40b2280 con 0x7f97bc003980 2023-05-15T16:40:30.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d1ffb640 1 -- 172.21.15.62:0/3546552965 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d40afa90 con 0x7f97bc004d10 2023-05-15T16:40:30.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d1ffb640 1 -- 172.21.15.62:0/3546552965 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97bc00ba40 con 0x7f97d4071a90 2023-05-15T16:40:30.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d2ffd640 1 --2- 172.21.15.62:0/3546552965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97bc003980 0x7f97bc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:30.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d2ffd640 1 -- 172.21.15.62:0/3546552965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d4071a90 msgr2=0x7f97bc0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:30.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d2ffd640 1 --2- 172.21.15.62:0/3546552965 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d4071a90 0x7f97bc0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d2ffd640 1 -- 172.21.15.62:0/3546552965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97bc004d10 msgr2=0x7f97bc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:30.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d2ffd640 1 --2- 172.21.15.62:0/3546552965 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97bc004d10 0x7f97bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.787+0000 7f97d2ffd640 1 -- 172.21.15.62:0/3546552965 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97bc003530 con 0x7f97bc003980 2023-05-15T16:40:30.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d2ffd640 1 --2- 172.21.15.62:0/3546552965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97bc003980 0x7f97bc003d90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f97c400c290 tx=0x7f97c401ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9e7355dad4c50e server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:30.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d1ffb640 1 -- 172.21.15.62:0/3546552965 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c40058e0 con 0x7f97bc003980 2023-05-15T16:40:30.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d1ffb640 1 -- 172.21.15.62:0/3546552965 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c4005a40 con 0x7f97bc003980 2023-05-15T16:40:30.799 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d1ffb640 1 -- 172.21.15.62:0/3546552965 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c4005df0 con 0x7f97bc003980 2023-05-15T16:40:30.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d95b9640 1 -- 172.21.15.62:0/3546552965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97bc003980 msgr2=0x7f97bc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:30.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d95b9640 1 --2- 172.21.15.62:0/3546552965 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97bc003980 0x7f97bc003d90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f97c400c290 tx=0x7f97c401ccb0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d37fe640 1 -- 172.21.15.62:0/3546552965 reap_dead start 2023-05-15T16:40:30.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d95b9640 1 -- 172.21.15.62:0/3546552965 shutdown_connections 2023-05-15T16:40:30.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d95b9640 1 -- 172.21.15.62:0/3546552965 >> 172.21.15.62:0/3546552965 conn(0x7f97d40653f0 msgr2=0x7f97d40697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:30.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d95b9640 1 -- 172.21.15.62:0/3546552965 shutdown_connections 2023-05-15T16:40:30.800 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d95b9640 1 -- 172.21.15.62:0/3546552965 wait complete. 2023-05-15T16:40:30.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d95b9640 1 Processor -- start 2023-05-15T16:40:30.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d95b9640 1 -- start start 2023-05-15T16:40:30.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d95b9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97bc003980 0x7f97d41dfed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d95b9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d413cea0 0x7f97d413d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d95b9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97d4140100 0x7f97d4140570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d95b9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d414d2e0 con 0x7f97bc003980 2023-05-15T16:40:30.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d95b9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97d4140ab0 con 0x7f97d4140100 2023-05-15T16:40:30.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d95b9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97d414c610 con 0x7f97d413cea0 2023-05-15T16:40:30.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97bc003980 0x7f97d41dfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:30.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d2ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97bc003980 0x7f97d41dfed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47050/0 (socket says 172.21.15.62:47050) 2023-05-15T16:40:30.804 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d2ffd640 1 -- 172.21.15.62:0/1146239657 learned_addr learned my addr 172.21.15.62:0/1146239657 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:30.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d37fe640 1 --2- 172.21.15.62:0/1146239657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97d4140100 0x7f97d4140570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:30.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d27fc640 1 --2- 172.21.15.62:0/1146239657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d413cea0 0x7f97d413d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:30.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d2ffd640 1 -- 172.21.15.62:0/1146239657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d413cea0 msgr2=0x7f97d413d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:30.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d2ffd640 1 --2- 172.21.15.62:0/1146239657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d413cea0 0x7f97d413d2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.805 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d2ffd640 1 -- 172.21.15.62:0/1146239657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97d4140100 msgr2=0x7f97d4140570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:30.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d2ffd640 1 --2- 172.21.15.62:0/1146239657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97d4140100 0x7f97d4140570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d2ffd640 1 -- 172.21.15.62:0/1146239657 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97d40b2050 con 0x7f97bc003980 2023-05-15T16:40:30.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d27fc640 1 --2- 172.21.15.62:0/1146239657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d413cea0 0x7f97d413d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:30.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.791+0000 7f97d2ffd640 1 --2- 172.21.15.62:0/1146239657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97bc003980 0x7f97d41dfed0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f97c4007040 tx=0x7f97bc005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:30.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.795+0000 7f97bb7fe640 1 -- 172.21.15.62:0/1146239657 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c4005dd0 con 0x7f97bc003980 2023-05-15T16:40:30.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.795+0000 7f97bb7fe640 1 -- 172.21.15.62:0/1146239657 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97c4001440 con 0x7f97bc003980 2023-05-15T16:40:30.806 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.795+0000 7f97d95b9640 1 -- 172.21.15.62:0/1146239657 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97d40b1ec0 con 0x7f97bc003980 2023-05-15T16:40:30.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.795+0000 7f97bb7fe640 1 -- 172.21.15.62:0/1146239657 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97c40a5810 con 0x7f97bc003980 2023-05-15T16:40:30.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.795+0000 7f97d95b9640 1 -- 172.21.15.62:0/1146239657 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97d414b020 con 0x7f97bc003980 2023-05-15T16:40:30.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.795+0000 7f97d95b9640 1 -- 172.21.15.62:0/1146239657 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97d4067960 con 0x7f97bc003980 2023-05-15T16:40:30.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.795+0000 7f97bb7fe640 1 -- 172.21.15.62:0/1146239657 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f97c40a5970 con 0x7f97bc003980 2023-05-15T16:40:30.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.795+0000 7f97bb7fe640 1 --2- 172.21.15.62:0/1146239657 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f97c0065380 0x7f97c0067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:30.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.795+0000 7f97bb7fe640 1 -- 172.21.15.62:0/1146239657 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f97c411c200 con 0x7f97bc003980 2023-05-15T16:40:30.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.795+0000 7f97d27fc640 1 --2- 172.21.15.62:0/1146239657 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f97c0065380 0x7f97c0067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:30.807 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.795+0000 7f97d27fc640 1 --2- 172.21.15.62:0/1146239657 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f97c0065380 0x7f97c0067830 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f97c8006aa0 tx=0x7f97c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:30.808 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.799+0000 7f97bb7fe640 1 -- 172.21.15.62:0/1146239657 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f97c40e9f10 con 0x7f97bc003980 2023-05-15T16:40:30.988 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.983+0000 7f97d95b9640 1 -- 172.21.15.62:0/1146239657 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97d4148840 con 0x7f97bc003980 2023-05-15T16:40:30.989 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.987+0000 7f97bb7fe640 1 -- 172.21.15.62:0/1146239657 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3889 (secure 0 0 0) 0x7f97c40ed530 con 0x7f97bc003980 2023-05-15T16:40:30.990 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:30.990 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1731611654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1731611654},{"type":"v1","addr":"172.21.15.161:6835","nonce":1731611654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2563537601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2563537601},{"type":"v1","addr":"172.21.15.62:6834","nonce":2563537601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-15T16:40:01.085500+0000","modified":"2023-05-15T16:40:03.744733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/2804159919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2804159919},{"type":"v1","addr":"172.21.15.62:6835","nonce":2804159919}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-15T16:40:30.990 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 7 2023-05-15T16:40:30.991 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.987+0000 7f97d95b9640 1 -- 172.21.15.62:0/1146239657 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f97c0065380 msgr2=0x7f97c0067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:30.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.987+0000 7f97d95b9640 1 --2- 172.21.15.62:0/1146239657 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f97c0065380 0x7f97c0067830 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f97c8006aa0 tx=0x7f97c8008040 comp rx=0 tx=0).stop 2023-05-15T16:40:30.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.987+0000 7f97d95b9640 1 -- 172.21.15.62:0/1146239657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97bc003980 msgr2=0x7f97d41dfed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:30.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.987+0000 7f97d95b9640 1 --2- 172.21.15.62:0/1146239657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97bc003980 0x7f97d41dfed0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f97c4007040 tx=0x7f97bc005800 comp rx=0 tx=0).stop 2023-05-15T16:40:30.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.987+0000 7f97d95b9640 1 -- 172.21.15.62:0/1146239657 shutdown_connections 2023-05-15T16:40:30.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.987+0000 7f97d95b9640 1 --2- 172.21.15.62:0/1146239657 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97d4140100 0x7f97d4140570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.992 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.987+0000 7f97d95b9640 1 --2- 172.21.15.62:0/1146239657 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f97d413cea0 0x7f97d413d2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.987+0000 7f97d95b9640 1 --2- 172.21.15.62:0/1146239657 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f97c0065380 0x7f97c0067830 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.987+0000 7f97d95b9640 1 --2- 172.21.15.62:0/1146239657 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97bc003980 0x7f97d41dfed0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:30.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.987+0000 7f97d95b9640 1 -- 172.21.15.62:0/1146239657 >> 172.21.15.62:0/1146239657 conn(0x7f97d40653f0 msgr2=0x7f97d4150340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:30.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.987+0000 7f97d95b9640 1 -- 172.21.15.62:0/1146239657 shutdown_connections 2023-05-15T16:40:30.993 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:30.987+0000 7f97d95b9640 1 -- 172.21.15.62:0/1146239657 wait complete. 2023-05-15T16:40:31.008 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-15T16:40:31.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.119+0000 7f7e0759e640 1 Processor -- start 2023-05-15T16:40:31.121 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.119+0000 7f7e0759e640 1 -- start start 2023-05-15T16:40:31.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.119+0000 7f7e0759e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7e080bd170 0x7f7e0814d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:31.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.119+0000 7f7e0759e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e080bd5b0 0x7f7e0814d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:31.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.119+0000 7f7e0759e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e080710e0 con 0x7f7e08143d90 2023-05-15T16:40:31.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.119+0000 7f7e0759e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e080713c0 con 0x7f7e080bd170 2023-05-15T16:40:31.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.119+0000 7f7e0759e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e080716a0 con 0x7f7e080bd5b0 2023-05-15T16:40:31.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.119+0000 7f7e06d9d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e080bd5b0 0x7f7e0814d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:31.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.119+0000 7f7dfdd9b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f7e080bd170 0x7f7e0814d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:31.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.119+0000 7f7e0659c640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f7e08143d90 0x7f7e080b8d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.62:56378/0 (socket says 172.21.15.62:56378) 2023-05-15T16:40:31.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.119+0000 7f7e0659c640 1 -- 172.21.15.62:0/2528311448 learned_addr learned my addr 172.21.15.62:0/2528311448 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:31.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.119+0000 7f7e05d9b640 1 -- 172.21.15.62:0/2528311448 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058413889 0 0) 0x7f7e080710e0 con 0x7f7e08143d90 2023-05-15T16:40:31.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.119+0000 7f7e05d9b640 1 -- 172.21.15.62:0/2528311448 --> v1:172.21.15.161:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7df4003530 con 0x7f7e08143d90 2023-05-15T16:40:31.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.119+0000 7f7dfdd9b640 1 -- 172.21.15.62:0/2528311448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e080bd5b0 msgr2=0x7f7e0814d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:31.124 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.119+0000 7f7dfdd9b640 1 --2- 172.21.15.62:0/2528311448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e080bd5b0 0x7f7e0814d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.119+0000 7f7dfdd9b640 1 -- 172.21.15.62:0/2528311448 >> v1:172.21.15.161:6789/0 conn(0x7f7e08143d90 legacy=0x7f7e080b8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:31.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.119+0000 7f7dfdd9b640 1 -- 172.21.15.62:0/2528311448 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e08071980 con 0x7f7e080bd170 2023-05-15T16:40:31.125 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.119+0000 7f7e06d9d640 1 --2- 172.21.15.62:0/2528311448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e080bd5b0 0x7f7e0814d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-15T16:40:31.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7dfdd9b640 1 --2- 172.21.15.62:0/2528311448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e080bd170 0x7f7e0814d160 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7df80097c0 tx=0x7f7df801ec70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eec8d5214b218741 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:31.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e05d9b640 1 -- 172.21.15.62:0/2528311448 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df80a8970 con 0x7f7e080bd170 2023-05-15T16:40:31.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e05d9b640 1 -- 172.21.15.62:0/2528311448 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df80a8ad0 con 0x7f7e080bd170 2023-05-15T16:40:31.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e05d9b640 1 -- 172.21.15.62:0/2528311448 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df80a8e40 con 0x7f7e080bd170 2023-05-15T16:40:31.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e0759e640 1 -- 172.21.15.62:0/2528311448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e080bd170 msgr2=0x7f7e0814d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:31.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e0759e640 1 --2- 172.21.15.62:0/2528311448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e080bd170 0x7f7e0814d160 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f7df80097c0 tx=0x7f7df801ec70 comp rx=0 tx=0).stop 2023-05-15T16:40:31.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e0759e640 1 -- 172.21.15.62:0/2528311448 shutdown_connections 2023-05-15T16:40:31.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e0759e640 1 --2- 172.21.15.62:0/2528311448 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e080bd5b0 0x7f7e0814d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e0759e640 1 --2- 172.21.15.62:0/2528311448 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e080bd170 0x7f7e0814d160 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e0759e640 1 -- 172.21.15.62:0/2528311448 >> 172.21.15.62:0/2528311448 conn(0x7f7e0806b550 msgr2=0x7f7e080bca60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:31.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e0759e640 1 -- 172.21.15.62:0/2528311448 shutdown_connections 2023-05-15T16:40:31.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e0759e640 1 -- 172.21.15.62:0/2528311448 wait complete. 2023-05-15T16:40:31.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e0759e640 1 Processor -- start 2023-05-15T16:40:31.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e0759e640 1 -- start start 2023-05-15T16:40:31.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e0759e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e080bd170 0x7f7e0813a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:31.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e0759e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e080bd5b0 0x7f7e08139130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:31.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e0759e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e08143d90 0x7f7e08132e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:31.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e0759e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e08136710 con 0x7f7e080bd5b0 2023-05-15T16:40:31.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e0759e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e0813a590 con 0x7f7e080bd170 2023-05-15T16:40:31.131 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e0759e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e081386d0 con 0x7f7e08143d90 2023-05-15T16:40:31.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7dfdd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e080bd5b0 0x7f7e08139130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:31.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7dfdd9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e080bd5b0 0x7f7e08139130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47066/0 (socket says 172.21.15.62:47066) 2023-05-15T16:40:31.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7dfdd9b640 1 -- 172.21.15.62:0/2021536246 learned_addr learned my addr 172.21.15.62:0/2021536246 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:31.132 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e0659c640 1 --2- 172.21.15.62:0/2021536246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e080bd170 0x7f7e0813a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:31.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e06d9d640 1 --2- 172.21.15.62:0/2021536246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e08143d90 0x7f7e08132e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:31.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7dfdd9b640 1 -- 172.21.15.62:0/2021536246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e08143d90 msgr2=0x7f7e08132e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:31.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7dfdd9b640 1 --2- 172.21.15.62:0/2021536246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e08143d90 0x7f7e08132e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7dfdd9b640 1 -- 172.21.15.62:0/2021536246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e080bd170 msgr2=0x7f7e0813a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:31.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7dfdd9b640 1 --2- 172.21.15.62:0/2021536246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e080bd170 0x7f7e0813a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7dfdd9b640 1 -- 172.21.15.62:0/2021536246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e00009a70 con 0x7f7e080bd5b0 2023-05-15T16:40:31.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e0659c640 1 --2- 172.21.15.62:0/2021536246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e080bd170 0x7f7e0813a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-15T16:40:31.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7dfdd9b640 1 --2- 172.21.15.62:0/2021536246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e080bd5b0 0x7f7e08139130 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7df801d320 tx=0x7f7df801ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:31.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7dff7fe640 1 -- 172.21.15.62:0/2021536246 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df80b1d50 con 0x7f7e080bd5b0 2023-05-15T16:40:31.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7dff7fe640 1 -- 172.21.15.62:0/2021536246 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df80b9410 con 0x7f7e080bd5b0 2023-05-15T16:40:31.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7e0759e640 1 -- 172.21.15.62:0/2021536246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df8009420 con 0x7f7e080bd5b0 2023-05-15T16:40:31.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.123+0000 7f7dff7fe640 1 -- 172.21.15.62:0/2021536246 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df80b9780 con 0x7f7e080bd5b0 2023-05-15T16:40:31.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.127+0000 7f7e0759e640 1 -- 172.21.15.62:0/2021536246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e0806eec0 con 0x7f7e080bd5b0 2023-05-15T16:40:31.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.127+0000 7f7e0759e640 1 -- 172.21.15.62:0/2021536246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e08139730 con 0x7f7e080bd5b0 2023-05-15T16:40:31.134 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.127+0000 7f7dff7fe640 1 -- 172.21.15.62:0/2021536246 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f7df80b7040 con 0x7f7e080bd5b0 2023-05-15T16:40:31.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.127+0000 7f7dff7fe640 1 --2- 172.21.15.62:0/2021536246 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7de8065380 0x7f7de8067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:31.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.127+0000 7f7dff7fe640 1 -- 172.21.15.62:0/2021536246 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f7df8120490 con 0x7f7e080bd5b0 2023-05-15T16:40:31.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.127+0000 7f7e0659c640 1 --2- 172.21.15.62:0/2021536246 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7de8065380 0x7f7de8067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:31.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.127+0000 7f7e0659c640 1 --2- 172.21.15.62:0/2021536246 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7de8065380 0x7f7de8067830 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7df0005890 tx=0x7f7df0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:31.135 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.131+0000 7f7dff7fe640 1 -- 172.21.15.62:0/2021536246 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f7df80ee1a0 con 0x7f7e080bd5b0 2023-05-15T16:40:31.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.311+0000 7f7e0759e640 1 -- 172.21.15.62:0/2021536246 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e081542d0 con 0x7f7e080bd5b0 2023-05-15T16:40:31.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.311+0000 7f7dff7fe640 1 -- 172.21.15.62:0/2021536246 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+3889 (secure 0 0 0) 0x7f7df80f17c0 con 0x7f7e080bd5b0 2023-05-15T16:40:31.315 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:31.315 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4253,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1731611654","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1731611654},{"type":"v1","addr":"172.21.15.161:6835","nonce":1731611654}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/2563537601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":2563537601},{"type":"v1","addr":"172.21.15.62:6834","nonce":2563537601}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-15T16:40:01.085500+0000","modified":"2023-05-15T16:40:03.744733+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4263},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4263":{"gid":4263,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/2804159919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":2804159919},{"type":"v1","addr":"172.21.15.62:6835","nonce":2804159919}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-05-15T16:40:31.315 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 7 2023-05-15T16:40:31.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.311+0000 7f7e0759e640 1 -- 172.21.15.62:0/2021536246 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7de8065380 msgr2=0x7f7de8067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:31.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.311+0000 7f7e0759e640 1 --2- 172.21.15.62:0/2021536246 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7de8065380 0x7f7de8067830 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f7df0005890 tx=0x7f7df0009040 comp rx=0 tx=0).stop 2023-05-15T16:40:31.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.311+0000 7f7e0759e640 1 -- 172.21.15.62:0/2021536246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e080bd5b0 msgr2=0x7f7e08139130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:31.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.311+0000 7f7e0759e640 1 --2- 172.21.15.62:0/2021536246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e080bd5b0 0x7f7e08139130 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7df801d320 tx=0x7f7df801ba10 comp rx=0 tx=0).stop 2023-05-15T16:40:31.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.311+0000 7f7e0759e640 1 -- 172.21.15.62:0/2021536246 shutdown_connections 2023-05-15T16:40:31.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.311+0000 7f7e0759e640 1 --2- 172.21.15.62:0/2021536246 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7e08143d90 0x7f7e08132e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.311+0000 7f7e0759e640 1 --2- 172.21.15.62:0/2021536246 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7de8065380 0x7f7de8067830 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.311+0000 7f7e0759e640 1 --2- 172.21.15.62:0/2021536246 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7e080bd5b0 0x7f7e08139130 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.311+0000 7f7e0759e640 1 --2- 172.21.15.62:0/2021536246 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7e080bd170 0x7f7e0813a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.311+0000 7f7e0759e640 1 -- 172.21.15.62:0/2021536246 >> 172.21.15.62:0/2021536246 conn(0x7f7e0806b550 msgr2=0x7f7e080b8b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:31.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.311+0000 7f7e0759e640 1 -- 172.21.15.62:0/2021536246 shutdown_connections 2023-05-15T16:40:31.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.311+0000 7f7e0759e640 1 -- 172.21.15.62:0/2021536246 wait complete. 2023-05-15T16:40:31.333 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-15T16:40:31.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.439+0000 7f1af257d640 1 Processor -- start 2023-05-15T16:40:31.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.439+0000 7f1af257d640 1 -- start start 2023-05-15T16:40:31.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1af257d640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f1aec140b30 0x7f1aec0b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:31.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1af257d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aec0b3660 con 0x7f1aec071a00 2023-05-15T16:40:31.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1af257d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aec0b7c60 con 0x7f1aec149df0 2023-05-15T16:40:31.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1af257d640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aec0afd30 con 0x7f1aec140b30 2023-05-15T16:40:31.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1af0b1a640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1aec071a00 0x7f1aec0b7550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32856/0 (socket says 172.21.15.62:32856) 2023-05-15T16:40:31.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1af0b1a640 1 -- 172.21.15.62:0/3238996463 learned_addr learned my addr 172.21.15.62:0/3238996463 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:31.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aebfff640 1 --2- 172.21.15.62:0/3238996463 >> v2:172.21.15.161:3300/0 conn(0x7f1aec140b30 0x7f1aec0b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:31.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeaffd640 1 -- 172.21.15.62:0/3238996463 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892508330 0 0) 0x7f1aec0b3660 con 0x7f1aec071a00 2023-05-15T16:40:31.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeaffd640 1 -- 172.21.15.62:0/3238996463 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ad4003530 con 0x7f1aec071a00 2023-05-15T16:40:31.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeaffd640 1 -- 172.21.15.62:0/3238996463 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1581299024 0 0) 0x7f1ad4003530 con 0x7f1aec071a00 2023-05-15T16:40:31.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeaffd640 1 -- 172.21.15.62:0/3238996463 >> v2:172.21.15.161:3300/0 conn(0x7f1aec140b30 msgr2=0x7f1aec0b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:31.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeaffd640 1 --2- 172.21.15.62:0/3238996463 >> v2:172.21.15.161:3300/0 conn(0x7f1aec140b30 0x7f1aec0b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeaffd640 1 -- 172.21.15.62:0/3238996463 >> v1:172.21.15.161:6789/0 conn(0x7f1aec149df0 legacy=0x7f1aec0b3af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:31.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeaffd640 1 -- 172.21.15.62:0/3238996463 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec0b3330 con 0x7f1aec071a00 2023-05-15T16:40:31.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeaffd640 1 -- 172.21.15.62:0/3238996463 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7f1ae4001680 con 0x7f1aec071a00 2023-05-15T16:40:31.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeaffd640 1 -- 172.21.15.62:0/3238996463 >> v1:172.21.15.62:6789/0 conn(0x7f1aec071a00 legacy=0x7f1aec0b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:31.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeaffd640 1 --2- 172.21.15.62:0/3238996463 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ad4003980 0x7f1ad4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:31.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeaffd640 1 --2- 172.21.15.62:0/3238996463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad40047d0 0x7f1ad4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:31.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeaffd640 1 --2- 172.21.15.62:0/3238996463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ad4005180 0x7f1ad400b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:31.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeaffd640 1 -- 172.21.15.62:0/3238996463 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec0afd30 con 0x7f1ad40047d0 2023-05-15T16:40:31.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeaffd640 1 -- 172.21.15.62:0/3238996463 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad400e1f0 con 0x7f1ad4005180 2023-05-15T16:40:31.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeaffd640 1 -- 172.21.15.62:0/3238996463 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ad400bfb0 con 0x7f1ad4003980 2023-05-15T16:40:31.450 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeb7fe640 1 --2- 172.21.15.62:0/3238996463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad40047d0 0x7f1ad4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:31.452 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1af0b1a640 1 --2- 172.21.15.62:0/3238996463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ad4005180 0x7f1ad400b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:31.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeb7fe640 1 -- 172.21.15.62:0/3238996463 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ad4003980 msgr2=0x7f1ad4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:31.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeb7fe640 1 --2- 172.21.15.62:0/3238996463 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1ad4003980 0x7f1ad4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeb7fe640 1 -- 172.21.15.62:0/3238996463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ad4005180 msgr2=0x7f1ad400b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:31.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeb7fe640 1 --2- 172.21.15.62:0/3238996463 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ad4005180 0x7f1ad400b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeb7fe640 1 -- 172.21.15.62:0/3238996463 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ad4003530 con 0x7f1ad40047d0 2023-05-15T16:40:31.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1af0b1a640 1 -- 172.21.15.62:0/3238996463 reap_dead start 2023-05-15T16:40:31.453 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.443+0000 7f1aeb7fe640 1 --2- 172.21.15.62:0/3238996463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad40047d0 0x7f1ad4004c40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0001750 tx=0x7f1ae001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=821d9d1c43f70f1a server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:31.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1aeaffd640 1 -- 172.21.15.62:0/3238996463 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae00052d0 con 0x7f1ad40047d0 2023-05-15T16:40:31.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1aeaffd640 1 -- 172.21.15.62:0/3238996463 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae00a7050 con 0x7f1ad40047d0 2023-05-15T16:40:31.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1aeaffd640 1 -- 172.21.15.62:0/3238996463 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae0003600 con 0x7f1ad40047d0 2023-05-15T16:40:31.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af257d640 1 -- 172.21.15.62:0/3238996463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad40047d0 msgr2=0x7f1ad4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:31.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af257d640 1 --2- 172.21.15.62:0/3238996463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad40047d0 0x7f1ad4004c40 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f1ae0001750 tx=0x7f1ae001c3a0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af257d640 1 -- 172.21.15.62:0/3238996463 shutdown_connections 2023-05-15T16:40:31.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af257d640 1 --2- 172.21.15.62:0/3238996463 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1ad40047d0 0x7f1ad4004c40 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.454 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af257d640 1 -- 172.21.15.62:0/3238996463 >> 172.21.15.62:0/3238996463 conn(0x7f1aec0653f0 msgr2=0x7f1aec0697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:31.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af257d640 1 -- 172.21.15.62:0/3238996463 shutdown_connections 2023-05-15T16:40:31.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af257d640 1 -- 172.21.15.62:0/3238996463 wait complete. 2023-05-15T16:40:31.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af257d640 1 Processor -- start 2023-05-15T16:40:31.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af257d640 1 -- start start 2023-05-15T16:40:31.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af257d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ad40047d0 0x7f1aec0b1b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:31.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af257d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aec13cef0 0x7f1aec0b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:31.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af257d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aec0b0970 0x7f1aec1de510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:31.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af257d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec13ae50 con 0x7f1aec0b0970 2023-05-15T16:40:31.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af257d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec148e80 con 0x7f1ad40047d0 2023-05-15T16:40:31.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af257d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aec0b0de0 con 0x7f1aec13cef0 2023-05-15T16:40:31.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af0b1a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aec0b0970 0x7f1aec1de510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:31.456 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af0b1a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aec0b0970 0x7f1aec1de510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47080/0 (socket says 172.21.15.62:47080) 2023-05-15T16:40:31.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af0b1a640 1 -- 172.21.15.62:0/3082097545 learned_addr learned my addr 172.21.15.62:0/3082097545 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:31.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1aeb7fe640 1 --2- 172.21.15.62:0/3082097545 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aec13cef0 0x7f1aec0b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:31.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1aebfff640 1 --2- 172.21.15.62:0/3082097545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ad40047d0 0x7f1aec0b1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:31.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af0b1a640 1 -- 172.21.15.62:0/3082097545 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aec13cef0 msgr2=0x7f1aec0b0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:31.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af0b1a640 1 --2- 172.21.15.62:0/3082097545 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aec13cef0 0x7f1aec0b0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.457 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af0b1a640 1 -- 172.21.15.62:0/3082097545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ad40047d0 msgr2=0x7f1aec0b1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:31.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af0b1a640 1 --2- 172.21.15.62:0/3082097545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ad40047d0 0x7f1aec0b1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af0b1a640 1 -- 172.21.15.62:0/3082097545 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aec0b5dd0 con 0x7f1aec0b0970 2023-05-15T16:40:31.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af0b1a640 1 --2- 172.21.15.62:0/3082097545 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aec0b0970 0x7f1aec1de510 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4000fc0 tx=0x7f1ae400d600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:31.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1ae8ff9640 1 -- 172.21.15.62:0/3082097545 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae400dde0 con 0x7f1aec0b0970 2023-05-15T16:40:31.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1ae8ff9640 1 -- 172.21.15.62:0/3082097545 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ae40070d0 con 0x7f1aec0b0970 2023-05-15T16:40:31.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1ae8ff9640 1 -- 172.21.15.62:0/3082097545 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4007480 con 0x7f1aec0b0970 2023-05-15T16:40:31.458 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af257d640 1 -- 172.21.15.62:0/3082097545 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aec140f00 con 0x7f1aec0b0970 2023-05-15T16:40:31.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af257d640 1 -- 172.21.15.62:0/3082097545 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aec0b5f60 con 0x7f1aec0b0970 2023-05-15T16:40:31.459 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.447+0000 7f1af257d640 1 -- 172.21.15.62:0/3082097545 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aec067960 con 0x7f1aec0b0970 2023-05-15T16:40:31.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.451+0000 7f1ae8ff9640 1 -- 172.21.15.62:0/3082097545 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f1ae40047f0 con 0x7f1aec0b0970 2023-05-15T16:40:31.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.451+0000 7f1ae8ff9640 1 --2- 172.21.15.62:0/3082097545 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1ad8065380 0x7f1ad8067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:31.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.451+0000 7f1ae8ff9640 1 -- 172.21.15.62:0/3082097545 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f1ae4081860 con 0x7f1aec0b0970 2023-05-15T16:40:31.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.451+0000 7f1aebfff640 1 --2- 172.21.15.62:0/3082097545 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1ad8065380 0x7f1ad8067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:31.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.451+0000 7f1aebfff640 1 --2- 172.21.15.62:0/3082097545 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1ad8065380 0x7f1ad8067830 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0073f0 tx=0x7f1adc00b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:31.460 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.455+0000 7f1ae8ff9640 1 -- 172.21.15.62:0/3082097545 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f1ae404f570 con 0x7f1aec0b0970 2023-05-15T16:40:31.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.603+0000 7f1af257d640 1 -- 172.21.15.62:0/3082097545 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1aec0af950 con 0x7f1aec0b0970 2023-05-15T16:40:31.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.603+0000 7f1ae8ff9640 1 -- 172.21.15.62:0/3082097545 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+17811 (secure 0 0 0) 0x7f1ae401a070 con 0x7f1aec0b0970 2023-05-15T16:40:31.609 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:31.610 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":23,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:40:02.088078+0000","last_up_change":"2023-05-15T16:39:48.597049+0000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-15T16:39:49.394028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-15T16:39:55.208679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-05-15T16:39:59.547414+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-05-15T16:40:00.055526+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37594},{"type":"v1","addr":"172.21.15.62:6825","nonce":37594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37594},{"type":"v1","addr":"172.21.15.62:6827","nonce":37594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37594},{"type":"v1","addr":"172.21.15.62:6831","nonce":37594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37594},{"type":"v1","addr":"172.21.15.62:6829","nonce":37594}]},"public_addr":"172.21.15.62:6825/37594","cluster_addr":"172.21.15.62:6827/37594","heartbeat_back_addr":"172.21.15.62:6831/37594","heartbeat_front_addr":"172.21.15.62:6829/37594","state":["exists","up"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37592},{"type":"v1","addr":"172.21.15.62:6808","nonce":37592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":37592},{"type":"v1","addr":"172.21.15.62:6814","nonce":37592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6821","nonce":37592},{"type":"v1","addr":"172.21.15.62:6823","nonce":37592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37592},{"type":"v1","addr":"172.21.15.62:6818","nonce":37592}]},"public_addr":"172.21.15.62:6808/37592","cluster_addr":"172.21.15.62:6814/37592","heartbeat_back_addr":"172.21.15.62:6823/37592","heartbeat_front_addr":"172.21.15.62:6818/37592","state":["exists","up"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":37591},{"type":"v1","addr":"172.21.15.62:6810","nonce":37591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":37591},{"type":"v1","addr":"172.21.15.62:6815","nonce":37591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37591},{"type":"v1","addr":"172.21.15.62:6822","nonce":37591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":37591},{"type":"v1","addr":"172.21.15.62:6819","nonce":37591}]},"public_addr":"172.21.15.62:6810/37591","cluster_addr":"172.21.15.62:6815/37591","heartbeat_back_addr":"172.21.15.62:6822/37591","heartbeat_front_addr":"172.21.15.62:6819/37591","state":["exists","up"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37593},{"type":"v1","addr":"172.21.15.62:6801","nonce":37593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37593},{"type":"v1","addr":"172.21.15.62:6803","nonce":37593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":37593},{"type":"v1","addr":"172.21.15.62:6812","nonce":37593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37593},{"type":"v1","addr":"172.21.15.62:6805","nonce":37593}]},"public_addr":"172.21.15.62:6801/37593","cluster_addr":"172.21.15.62:6803/37593","heartbeat_back_addr":"172.21.15.62:6812/37593","heartbeat_front_addr":"172.21.15.62:6805/37593","state":["exists","up"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37854},{"type":"v1","addr":"172.21.15.161:6801","nonce":37854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37854},{"type":"v1","addr":"172.21.15.161:6803","nonce":37854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37854},{"type":"v1","addr":"172.21.15.161:6807","nonce":37854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37854},{"type":"v1","addr":"172.21.15.161:6805","nonce":37854}]},"public_addr":"172.21.15.161:6801/37854","cluster_addr":"172.21.15.161:6803/37854","heartbeat_back_addr":"172.21.15.161:6807/37854","heartbeat_front_addr":"172.21.15.161:6805/37854","state":["exists","up"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37855},{"type":"v1","addr":"172.21.15.161:6810","nonce":37855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37855},{"type":"v1","addr":"172.21.15.161:6815","nonce":37855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37855},{"type":"v1","addr":"172.21.15.161:6824","nonce":37855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37855},{"type":"v1","addr":"172.21.15.161:6820","nonce":37855}]},"public_addr":"172.21.15.161:6810/37855","cluster_addr":"172.21.15.161:6815/37855","heartbeat_back_addr":"172.21.15.161:6824/37855","heartbeat_front_addr":"172.21.15.161:6820/37855","state":["exists","up"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":37856},{"type":"v1","addr":"172.21.15.161:6814","nonce":37856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37856},{"type":"v1","addr":"172.21.15.161:6819","nonce":37856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":37856},{"type":"v1","addr":"172.21.15.161:6830","nonce":37856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37856},{"type":"v1","addr":"172.21.15.161:6826","nonce":37856}]},"public_addr":"172.21.15.161:6814/37856","cluster_addr":"172.21.15.161:6819/37856","heartbeat_back_addr":"172.21.15.161:6830/37856","heartbeat_front_addr":"172.21.15.161:6826/37856","state":["exists","up"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":37857},{"type":"v1","addr":"172.21.15.161:6813","nonce":37857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":37857},{"type":"v1","addr":"172.21.15.161:6821","nonce":37857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":37857},{"type":"v1","addr":"172.21.15.161:6831","nonce":37857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":37857},{"type":"v1","addr":"172.21.15.161:6827","nonce":37857}]},"public_addr":"172.21.15.161:6813/37857","cluster_addr":"172.21.15.161:6821/37857","heartbeat_back_addr":"172.21.15.161:6831/37857","heartbeat_front_addr":"172.21.15.161:6827/37857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.592907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.618143+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.641533+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.614355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.579293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.718353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.730135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.792887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:40:31.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.607+0000 7f1af257d640 1 -- 172.21.15.62:0/3082097545 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1ad8065380 msgr2=0x7f1ad8067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:31.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.607+0000 7f1af257d640 1 --2- 172.21.15.62:0/3082097545 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1ad8065380 0x7f1ad8067830 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f1adc0073f0 tx=0x7f1adc00b040 comp rx=0 tx=0).stop 2023-05-15T16:40:31.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.607+0000 7f1af257d640 1 -- 172.21.15.62:0/3082097545 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aec0b0970 msgr2=0x7f1aec1de510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:31.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.607+0000 7f1af257d640 1 --2- 172.21.15.62:0/3082097545 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aec0b0970 0x7f1aec1de510 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4000fc0 tx=0x7f1ae400d600 comp rx=0 tx=0).stop 2023-05-15T16:40:31.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.607+0000 7f1af257d640 1 -- 172.21.15.62:0/3082097545 shutdown_connections 2023-05-15T16:40:31.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.607+0000 7f1af257d640 1 --2- 172.21.15.62:0/3082097545 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1ad8065380 0x7f1ad8067830 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.607+0000 7f1af257d640 1 --2- 172.21.15.62:0/3082097545 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1aec0b0970 0x7f1aec1de510 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.607+0000 7f1af257d640 1 --2- 172.21.15.62:0/3082097545 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1aec13cef0 0x7f1aec0b0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.607+0000 7f1af257d640 1 --2- 172.21.15.62:0/3082097545 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1ad40047d0 0x7f1aec0b1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.607+0000 7f1af257d640 1 -- 172.21.15.62:0/3082097545 >> 172.21.15.62:0/3082097545 conn(0x7f1aec0653f0 msgr2=0x7f1aec0b99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:31.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.607+0000 7f1af257d640 1 -- 172.21.15.62:0/3082097545 shutdown_connections 2023-05-15T16:40:31.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.607+0000 7f1af257d640 1 -- 172.21.15.62:0/3082097545 wait complete. 2023-05-15T16:40:31.627 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-05-15T16:40:31.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.739+0000 7f31222ed640 1 Processor -- start 2023-05-15T16:40:31.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.739+0000 7f31222ed640 1 -- start start 2023-05-15T16:40:31.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.739+0000 7f31222ed640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f311c0b5330 0x7f311c0b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:31.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.739+0000 7f31222ed640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f311c144e90 0x7f311c145310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:31.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.739+0000 7f31222ed640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f311c0716b0 con 0x7f311c071a90 2023-05-15T16:40:31.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.739+0000 7f31222ed640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f311c0b2280 con 0x7f311c144e90 2023-05-15T16:40:31.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.739+0000 7f31222ed640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f311c0afa90 con 0x7f311c0b5330 2023-05-15T16:40:31.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.739+0000 7f312088a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f311c144e90 0x7f311c145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:31.745 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.739+0000 7f311b7fe640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f311c071a90 0x7f311c0b16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:32862/0 (socket says 172.21.15.62:32862) 2023-05-15T16:40:31.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.739+0000 7f311b7fe640 1 -- 172.21.15.62:0/3579495964 learned_addr learned my addr 172.21.15.62:0/3579495964 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:31.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.739+0000 7f312088a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f311c144e90 0x7f311c145310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47084/0 (socket says 172.21.15.62:47084) 2023-05-15T16:40:31.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.739+0000 7f311bfff640 1 --2- 172.21.15.62:0/3579495964 >> v2:172.21.15.161:3300/0 conn(0x7f311c0b5330 0x7f311c0b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:31.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.739+0000 7f312088a640 1 -- 172.21.15.62:0/3579495964 >> v2:172.21.15.161:3300/0 conn(0x7f311c0b5330 msgr2=0x7f311c0b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:31.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.739+0000 7f312088a640 1 --2- 172.21.15.62:0/3579495964 >> v2:172.21.15.161:3300/0 conn(0x7f311c0b5330 0x7f311c0b5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.739+0000 7f312088a640 1 -- 172.21.15.62:0/3579495964 >> v1:172.21.15.62:6789/0 conn(0x7f311c071a90 legacy=0x7f311c0b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:31.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.739+0000 7f312088a640 1 -- 172.21.15.62:0/3579495964 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f311c0b0f00 con 0x7f311c144e90 2023-05-15T16:40:31.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f312088a640 1 --2- 172.21.15.62:0/3579495964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f311c144e90 0x7f311c145310 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f311c0b95d0 tx=0x7f311401f0f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1baf74d549816444 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:31.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f311affd640 1 -- 172.21.15.62:0/3579495964 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31140b0440 con 0x7f311c144e90 2023-05-15T16:40:31.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f311affd640 1 -- 172.21.15.62:0/3579495964 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31140b05a0 con 0x7f311c144e90 2023-05-15T16:40:31.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f311affd640 1 -- 172.21.15.62:0/3579495964 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31140b0930 con 0x7f311c144e90 2023-05-15T16:40:31.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f31222ed640 1 -- 172.21.15.62:0/3579495964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f311c144e90 msgr2=0x7f311c145310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:31.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f31222ed640 1 --2- 172.21.15.62:0/3579495964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f311c144e90 0x7f311c145310 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f311c0b95d0 tx=0x7f311401f0f0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f31222ed640 1 -- 172.21.15.62:0/3579495964 shutdown_connections 2023-05-15T16:40:31.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f31222ed640 1 --2- 172.21.15.62:0/3579495964 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f311c144e90 0x7f311c145310 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f31222ed640 1 --2- 172.21.15.62:0/3579495964 >> v2:172.21.15.161:3300/0 conn(0x7f311c0b5330 0x7f311c0b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f31222ed640 1 -- 172.21.15.62:0/3579495964 >> 172.21.15.62:0/3579495964 conn(0x7f311c0653f0 msgr2=0x7f311c0697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:31.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f31222ed640 1 -- 172.21.15.62:0/3579495964 shutdown_connections 2023-05-15T16:40:31.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f31222ed640 1 -- 172.21.15.62:0/3579495964 wait complete. 2023-05-15T16:40:31.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f31222ed640 1 Processor -- start 2023-05-15T16:40:31.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f31222ed640 1 -- start start 2023-05-15T16:40:31.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f31222ed640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f311c071a90 0x7f311c149ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:31.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f31222ed640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f311c0b5330 0x7f311c13f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:31.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f31222ed640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f311c144e90 0x7f311c138c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:31.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f31222ed640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c13fb00 con 0x7f311c071a90 2023-05-15T16:40:31.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f31222ed640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f311c148630 con 0x7f311c0b5330 2023-05-15T16:40:31.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f31222ed640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f311c148d20 con 0x7f311c144e90 2023-05-15T16:40:31.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f311bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f311c071a90 0x7f311c149ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:31.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f311bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f311c071a90 0x7f311c149ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47086/0 (socket says 172.21.15.62:47086) 2023-05-15T16:40:31.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f311bfff640 1 -- 172.21.15.62:0/229302285 learned_addr learned my addr 172.21.15.62:0/229302285 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:31.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f311bfff640 1 -- 172.21.15.62:0/229302285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f311c144e90 msgr2=0x7f311c138c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:31.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f311bfff640 1 --2- 172.21.15.62:0/229302285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f311c144e90 0x7f311c138c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f311bfff640 1 -- 172.21.15.62:0/229302285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f311c0b5330 msgr2=0x7f311c13f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:31.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f311b7fe640 1 --2- 172.21.15.62:0/229302285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f311c0b5330 0x7f311c13f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:31.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f311bfff640 1 --2- 172.21.15.62:0/229302285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f311c0b5330 0x7f311c13f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:31.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f311bfff640 1 -- 172.21.15.62:0/229302285 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3114009a70 con 0x7f311c071a90 2023-05-15T16:40:31.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f311bfff640 1 --2- 172.21.15.62:0/229302285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f311c071a90 0x7f311c149ae0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f310c00c7f0 tx=0x7f310c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:31.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f3118ff9640 1 -- 172.21.15.62:0/229302285 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c004220 con 0x7f311c071a90 2023-05-15T16:40:31.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f3118ff9640 1 -- 172.21.15.62:0/229302285 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f310c0043a0 con 0x7f311c071a90 2023-05-15T16:40:31.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f31222ed640 1 -- 172.21.15.62:0/229302285 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f311c0b11a0 con 0x7f311c071a90 2023-05-15T16:40:31.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f3118ff9640 1 -- 172.21.15.62:0/229302285 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f310c004510 con 0x7f311c071a90 2023-05-15T16:40:31.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.743+0000 7f31222ed640 1 -- 172.21.15.62:0/229302285 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f311c0af7b0 con 0x7f311c071a90 2023-05-15T16:40:31.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.747+0000 7f31222ed640 1 -- 172.21.15.62:0/229302285 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f311c14a020 con 0x7f311c071a90 2023-05-15T16:40:31.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.747+0000 7f3118ff9640 1 -- 172.21.15.62:0/229302285 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f310c003860 con 0x7f311c071a90 2023-05-15T16:40:31.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.747+0000 7f3118ff9640 1 --2- 172.21.15.62:0/229302285 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3108065380 0x7f3108067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:31.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.747+0000 7f3118ff9640 1 -- 172.21.15.62:0/229302285 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f310c082590 con 0x7f311c071a90 2023-05-15T16:40:31.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.747+0000 7f311b7fe640 1 --2- 172.21.15.62:0/229302285 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3108065380 0x7f3108067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:31.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.747+0000 7f311b7fe640 1 --2- 172.21.15.62:0/229302285 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3108065380 0x7f3108067830 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f311c148040 tx=0x7f3110009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:31.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.751+0000 7f3118ff9640 1 -- 172.21.15.62:0/229302285 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f310c0502a0 con 0x7f311c071a90 2023-05-15T16:40:31.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:31.935+0000 7f31222ed640 1 -- 172.21.15.62:0/229302285 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f311c0b1ec0 con 0x7f311c071a90 2023-05-15T16:40:32.590 INFO:tasks.ceph.mon.a.smithi062.stderr:2023-05-15T16:40:32.587+0000 7f39917a5640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-05-15T16:40:32.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.599+0000 7f3118ff9640 1 -- 172.21.15.62:0/229302285 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) v1 ==== 161+0+0 (secure 0 0 0) 0x7f310c0538c0 con 0x7f311c071a90 2023-05-15T16:40:32.604 INFO:teuthology.orchestra.run.smithi062.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-05-15T16:40:32.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.603+0000 7f31222ed640 1 -- 172.21.15.62:0/229302285 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3108065380 msgr2=0x7f3108067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:32.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.603+0000 7f31222ed640 1 --2- 172.21.15.62:0/229302285 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3108065380 0x7f3108067830 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f311c148040 tx=0x7f3110009040 comp rx=0 tx=0).stop 2023-05-15T16:40:32.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.603+0000 7f31222ed640 1 -- 172.21.15.62:0/229302285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f311c071a90 msgr2=0x7f311c149ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:32.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.603+0000 7f31222ed640 1 --2- 172.21.15.62:0/229302285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f311c071a90 0x7f311c149ae0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f310c00c7f0 tx=0x7f310c00ccb0 comp rx=0 tx=0).stop 2023-05-15T16:40:32.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.603+0000 7f31222ed640 1 -- 172.21.15.62:0/229302285 shutdown_connections 2023-05-15T16:40:32.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.603+0000 7f31222ed640 1 --2- 172.21.15.62:0/229302285 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f311c144e90 0x7f311c138c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:32.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.603+0000 7f31222ed640 1 --2- 172.21.15.62:0/229302285 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f311c0b5330 0x7f311c13f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:32.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.603+0000 7f31222ed640 1 --2- 172.21.15.62:0/229302285 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3108065380 0x7f3108067830 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:32.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.603+0000 7f31222ed640 1 --2- 172.21.15.62:0/229302285 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f311c071a90 0x7f311c149ae0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:32.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.603+0000 7f31222ed640 1 -- 172.21.15.62:0/229302285 >> 172.21.15.62:0/229302285 conn(0x7f311c0653f0 msgr2=0x7f311c0697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:32.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.603+0000 7f31222ed640 1 -- 172.21.15.62:0/229302285 shutdown_connections 2023-05-15T16:40:32.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.603+0000 7f31222ed640 1 -- 172.21.15.62:0/229302285 wait complete. 2023-05-15T16:40:32.612 INFO:tasks.ceph.mds.a.smithi062.stderr: -4430> 2023-05-15T16:40:02.815+0000 7f64d26cd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-15T16:40:32.628 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-05-15T16:40:32.659 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2023-05-15T16:40:32.753 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.751+0000 7f04eb00a640 1 Processor -- start 2023-05-15T16:40:32.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.751+0000 7f04eb00a640 1 -- start start 2023-05-15T16:40:32.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.751+0000 7f04eb00a640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f04e40b7910 0x7f04e40b4b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:32.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.751+0000 7f04eb00a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f04e40b5e70 0x7f04e4144170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:32.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.751+0000 7f04eb00a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04e40b3220 con 0x7f04e40b86a0 2023-05-15T16:40:32.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.751+0000 7f04eb00a640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e40b5a50 con 0x7f04e40b7910 2023-05-15T16:40:32.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.751+0000 7f04eb00a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04e40b1610 con 0x7f04e40b5e70 2023-05-15T16:40:32.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.751+0000 7f04e8da6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f04e40b7910 0x7f04e40b4b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:32.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.751+0000 7f04e8da6640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f04e40b7910 0x7f04e40b4b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47118/0 (socket says 172.21.15.62:47118) 2023-05-15T16:40:32.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.751+0000 7f04e8da6640 1 -- 172.21.15.62:0/1431527449 learned_addr learned my addr 172.21.15.62:0/1431527449 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:32.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.751+0000 7f04e3fff640 1 --2- 172.21.15.62:0/1431527449 >> v2:172.21.15.161:3300/0 conn(0x7f04e40b5e70 0x7f04e4144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:32.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.751+0000 7f04e8da6640 1 -- 172.21.15.62:0/1431527449 >> v2:172.21.15.161:3300/0 conn(0x7f04e40b5e70 msgr2=0x7f04e4144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:32.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.751+0000 7f04e8da6640 1 --2- 172.21.15.62:0/1431527449 >> v2:172.21.15.161:3300/0 conn(0x7f04e40b5e70 0x7f04e4144170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:32.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.751+0000 7f04e8da6640 1 -- 172.21.15.62:0/1431527449 >> v1:172.21.15.161:6789/0 conn(0x7f04e40b86a0 legacy=0x7f04e40b8ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:32.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.751+0000 7f04e8da6640 1 -- 172.21.15.62:0/1431527449 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04e40b4710 con 0x7f04e40b7910 2023-05-15T16:40:32.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.751+0000 7f04e8da6640 1 --2- 172.21.15.62:0/1431527449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04e40b7910 0x7f04e40b4b30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f04e406a630 tx=0x7f04d801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c98198419062e69e server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:32.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04e37fe640 1 -- 172.21.15.62:0/1431527449 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d80a89b0 con 0x7f04e40b7910 2023-05-15T16:40:32.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04e37fe640 1 -- 172.21.15.62:0/1431527449 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d80a8b10 con 0x7f04e40b7910 2023-05-15T16:40:32.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04e37fe640 1 -- 172.21.15.62:0/1431527449 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d80a8ea0 con 0x7f04e40b7910 2023-05-15T16:40:32.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04eb00a640 1 -- 172.21.15.62:0/1431527449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04e40b7910 msgr2=0x7f04e40b4b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:32.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04eb00a640 1 --2- 172.21.15.62:0/1431527449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04e40b7910 0x7f04e40b4b30 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f04e406a630 tx=0x7f04d801ecb0 comp rx=0 tx=0).stop 2023-05-15T16:40:32.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04eb00a640 1 -- 172.21.15.62:0/1431527449 shutdown_connections 2023-05-15T16:40:32.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04eb00a640 1 --2- 172.21.15.62:0/1431527449 >> v2:172.21.15.161:3300/0 conn(0x7f04e40b5e70 0x7f04e4144170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:32.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04eb00a640 1 --2- 172.21.15.62:0/1431527449 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04e40b7910 0x7f04e40b4b30 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:32.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04eb00a640 1 -- 172.21.15.62:0/1431527449 >> 172.21.15.62:0/1431527449 conn(0x7f04e40697b0 msgr2=0x7f04e4069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:32.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04eb00a640 1 -- 172.21.15.62:0/1431527449 shutdown_connections 2023-05-15T16:40:32.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04eb00a640 1 -- 172.21.15.62:0/1431527449 wait complete. 2023-05-15T16:40:32.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04eb00a640 1 Processor -- start 2023-05-15T16:40:32.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04eb00a640 1 -- start start 2023-05-15T16:40:32.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04eb00a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04e40b5e70 0x7f04e413eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:32.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04eb00a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e40b7910 0x7f04e41e0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:32.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04eb00a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e40b86a0 0x7f04e41e0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:32.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04eb00a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e413f530 con 0x7f04e40b5e70 2023-05-15T16:40:32.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04eb00a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04e41468d0 con 0x7f04e40b7910 2023-05-15T16:40:32.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04eb00a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04e413d8f0 con 0x7f04e40b86a0 2023-05-15T16:40:32.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04e8da6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04e40b5e70 0x7f04e413eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:32.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04e8da6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04e40b5e70 0x7f04e413eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47120/0 (socket says 172.21.15.62:47120) 2023-05-15T16:40:32.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04e8da6640 1 -- 172.21.15.62:0/3815274805 learned_addr learned my addr 172.21.15.62:0/3815274805 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:32.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04e95a7640 1 --2- 172.21.15.62:0/3815274805 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e40b86a0 0x7f04e41e0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:32.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04e3fff640 1 --2- 172.21.15.62:0/3815274805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e40b7910 0x7f04e41e0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:32.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04e8da6640 1 -- 172.21.15.62:0/3815274805 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e40b86a0 msgr2=0x7f04e41e0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:32.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04e8da6640 1 --2- 172.21.15.62:0/3815274805 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e40b86a0 0x7f04e41e0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:32.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04e8da6640 1 -- 172.21.15.62:0/3815274805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e40b7910 msgr2=0x7f04e41e0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:32.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04e8da6640 1 --2- 172.21.15.62:0/3815274805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e40b7910 0x7f04e41e0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:32.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04e8da6640 1 -- 172.21.15.62:0/3815274805 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04d80094d0 con 0x7f04e40b5e70 2023-05-15T16:40:32.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04e3fff640 1 --2- 172.21.15.62:0/3815274805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e40b7910 0x7f04e41e0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:32.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04e8da6640 1 --2- 172.21.15.62:0/3815274805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04e40b5e70 0x7f04e413eff0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f04d80b3040 tx=0x7f04d801ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:32.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04e17fa640 1 -- 172.21.15.62:0/3815274805 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d80a89b0 con 0x7f04e40b5e70 2023-05-15T16:40:32.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04e17fa640 1 -- 172.21.15.62:0/3815274805 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04d80bb480 con 0x7f04e40b5e70 2023-05-15T16:40:32.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04eb00a640 1 -- 172.21.15.62:0/3815274805 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04e40b2a90 con 0x7f04e40b5e70 2023-05-15T16:40:32.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04e17fa640 1 -- 172.21.15.62:0/3815274805 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04d80bb830 con 0x7f04e40b5e70 2023-05-15T16:40:32.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.755+0000 7f04eb00a640 1 -- 172.21.15.62:0/3815274805 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04e40b34c0 con 0x7f04e40b5e70 2023-05-15T16:40:32.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.759+0000 7f04eb00a640 1 -- 172.21.15.62:0/3815274805 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04e40b2cf0 con 0x7f04e40b5e70 2023-05-15T16:40:32.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.759+0000 7f04e17fa640 1 -- 172.21.15.62:0/3815274805 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f04d80bb990 con 0x7f04e40b5e70 2023-05-15T16:40:32.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.759+0000 7f04e17fa640 1 --2- 172.21.15.62:0/3815274805 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f04d0065380 0x7f04d0067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:32.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.759+0000 7f04e17fa640 1 -- 172.21.15.62:0/3815274805 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f04d8121990 con 0x7f04e40b5e70 2023-05-15T16:40:32.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.759+0000 7f04e3fff640 1 --2- 172.21.15.62:0/3815274805 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f04d0065380 0x7f04d0067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:32.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.759+0000 7f04e3fff640 1 --2- 172.21.15.62:0/3815274805 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f04d0065380 0x7f04d0067830 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f04e4149150 tx=0x7f04d4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:32.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.763+0000 7f04e17fa640 1 -- 172.21.15.62:0/3815274805 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f04d80ef600 con 0x7f04e40b5e70 2023-05-15T16:40:32.950 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:32.947+0000 7f04eb00a640 1 -- 172.21.15.62:0/3815274805 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f04e40b2cf0 con 0x7f04e40b5e70 2023-05-15T16:40:33.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.607+0000 7f04e17fa640 1 -- 172.21.15.62:0/3815274805 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7f04d80b5020 con 0x7f04e40b5e70 2023-05-15T16:40:33.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.607+0000 7f04eb00a640 1 -- 172.21.15.62:0/3815274805 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f04d0065380 msgr2=0x7f04d0067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:33.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.607+0000 7f04eb00a640 1 --2- 172.21.15.62:0/3815274805 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f04d0065380 0x7f04d0067830 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f04e4149150 tx=0x7f04d4008040 comp rx=0 tx=0).stop 2023-05-15T16:40:33.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.607+0000 7f04eb00a640 1 -- 172.21.15.62:0/3815274805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04e40b5e70 msgr2=0x7f04e413eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:33.614 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.607+0000 7f04eb00a640 1 --2- 172.21.15.62:0/3815274805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04e40b5e70 0x7f04e413eff0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f04d80b3040 tx=0x7f04d801ba50 comp rx=0 tx=0).stop 2023-05-15T16:40:33.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.607+0000 7f04eb00a640 1 -- 172.21.15.62:0/3815274805 shutdown_connections 2023-05-15T16:40:33.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.611+0000 7f04eb00a640 1 --2- 172.21.15.62:0/3815274805 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f04e40b86a0 0x7f04e41e0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:33.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.611+0000 7f04eb00a640 1 --2- 172.21.15.62:0/3815274805 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f04e40b7910 0x7f04e41e0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:33.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.611+0000 7f04eb00a640 1 --2- 172.21.15.62:0/3815274805 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f04d0065380 0x7f04d0067830 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:33.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.611+0000 7f04eb00a640 1 --2- 172.21.15.62:0/3815274805 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f04e40b5e70 0x7f04e413eff0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:33.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.611+0000 7f04eb00a640 1 -- 172.21.15.62:0/3815274805 >> 172.21.15.62:0/3815274805 conn(0x7f04e40697b0 msgr2=0x7f04e40b65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:33.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.611+0000 7f04eb00a640 1 -- 172.21.15.62:0/3815274805 shutdown_connections 2023-05-15T16:40:33.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.611+0000 7f04eb00a640 1 -- 172.21.15.62:0/3815274805 wait complete. 2023-05-15T16:40:33.633 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-05-15T16:40:33.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.811+0000 7f6c7ee14640 1 Processor -- start 2023-05-15T16:40:33.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.811+0000 7f6c7ee14640 1 -- start start 2023-05-15T16:40:33.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.811+0000 7f6c7ee14640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c780b7d30 0x7f6c78147b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:33.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.811+0000 7f6c7ee14640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6c780b6700 0x7f6c78148080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:33.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.811+0000 7f6c7ee14640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c7806e760 con 0x7f6c780b5300 2023-05-15T16:40:33.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.811+0000 7f6c7ee14640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c7806ed30 con 0x7f6c780b6700 2023-05-15T16:40:33.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.811+0000 7f6c7ee14640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c780b6f00 con 0x7f6c780b7d30 2023-05-15T16:40:33.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.811+0000 7f6c7d3b1640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6c780b6700 0x7f6c78148080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:33.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.811+0000 7f6c7cbb0640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f6c780b5300 0x7f6c78141890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.62:56402/0 (socket says 172.21.15.62:56402) 2023-05-15T16:40:33.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.811+0000 7f6c6ffff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c780b7d30 0x7f6c78147b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:33.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.811+0000 7f6c7cbb0640 1 -- 172.21.15.62:0/384566475 learned_addr learned my addr 172.21.15.62:0/384566475 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:33.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.811+0000 7f6c7d3b1640 1 -- 172.21.15.62:0/384566475 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c780b7d30 msgr2=0x7f6c78147b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:33.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.811+0000 7f6c7d3b1640 1 --2- 172.21.15.62:0/384566475 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c780b7d30 0x7f6c78147b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:33.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.811+0000 7f6c7d3b1640 1 -- 172.21.15.62:0/384566475 >> v1:172.21.15.161:6789/0 conn(0x7f6c780b5300 legacy=0x7f6c78141890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:33.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.811+0000 7f6c7d3b1640 1 -- 172.21.15.62:0/384566475 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c780b6c20 con 0x7f6c780b6700 2023-05-15T16:40:33.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.811+0000 7f6c6ffff640 1 --2- 172.21.15.62:0/384566475 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c780b7d30 0x7f6c78147b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-15T16:40:33.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.815+0000 7f6c7d3b1640 1 --2- 172.21.15.62:0/384566475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c780b6700 0x7f6c78148080 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009d90 tx=0x7f6c7001f130 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5be883d08cab30a4 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:33.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.815+0000 7f6c6f7fe640 1 -- 172.21.15.62:0/384566475 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c700af600 con 0x7f6c780b6700 2023-05-15T16:40:33.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.815+0000 7f6c6f7fe640 1 -- 172.21.15.62:0/384566475 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c700ab050 con 0x7f6c780b6700 2023-05-15T16:40:33.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.815+0000 7f6c6f7fe640 1 -- 172.21.15.62:0/384566475 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c700af980 con 0x7f6c780b6700 2023-05-15T16:40:33.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.815+0000 7f6c7ee14640 1 -- 172.21.15.62:0/384566475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c780b6700 msgr2=0x7f6c78148080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:33.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.815+0000 7f6c7ee14640 1 --2- 172.21.15.62:0/384566475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c780b6700 0x7f6c78148080 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6c70009d90 tx=0x7f6c7001f130 comp rx=0 tx=0).stop 2023-05-15T16:40:33.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.815+0000 7f6c7ee14640 1 -- 172.21.15.62:0/384566475 shutdown_connections 2023-05-15T16:40:33.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.815+0000 7f6c7ee14640 1 --2- 172.21.15.62:0/384566475 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c780b6700 0x7f6c78148080 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:33.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.815+0000 7f6c7ee14640 1 --2- 172.21.15.62:0/384566475 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c780b7d30 0x7f6c78147b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:33.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.815+0000 7f6c7ee14640 1 -- 172.21.15.62:0/384566475 >> 172.21.15.62:0/384566475 conn(0x7f6c780697b0 msgr2=0x7f6c78069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:33.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.815+0000 7f6c7ee14640 1 -- 172.21.15.62:0/384566475 shutdown_connections 2023-05-15T16:40:33.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.815+0000 7f6c7ee14640 1 -- 172.21.15.62:0/384566475 wait complete. 2023-05-15T16:40:33.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.815+0000 7f6c7ee14640 1 Processor -- start 2023-05-15T16:40:33.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c7ee14640 1 -- start start 2023-05-15T16:40:33.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c7ee14640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c780b5300 0x7f6c78142390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:33.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c7ee14640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c780b6700 0x7f6c780bbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:33.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c7ee14640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c780b7d30 0x7f6c780702d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:33.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c7ee14640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c780bc0f0 con 0x7f6c780b7d30 2023-05-15T16:40:33.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c7ee14640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7806fe40 con 0x7f6c780b6700 2023-05-15T16:40:33.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c7ee14640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c780bc800 con 0x7f6c780b5300 2023-05-15T16:40:33.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c7d3b1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c780b7d30 0x7f6c780702d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:33.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c7d3b1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c780b7d30 0x7f6c780702d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:47136/0 (socket says 172.21.15.62:47136) 2023-05-15T16:40:33.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c7d3b1640 1 -- 172.21.15.62:0/1581777500 learned_addr learned my addr 172.21.15.62:0/1581777500 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:33.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c6ffff640 1 --2- 172.21.15.62:0/1581777500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c780b6700 0x7f6c780bbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:33.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c7cbb0640 1 --2- 172.21.15.62:0/1581777500 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c780b5300 0x7f6c78142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:33.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c7d3b1640 1 -- 172.21.15.62:0/1581777500 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c780b5300 msgr2=0x7f6c78142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:33.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c7d3b1640 1 --2- 172.21.15.62:0/1581777500 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c780b5300 0x7f6c78142390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:33.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c7d3b1640 1 -- 172.21.15.62:0/1581777500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c780b6700 msgr2=0x7f6c780bbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:33.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c7d3b1640 1 --2- 172.21.15.62:0/1581777500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c780b6700 0x7f6c780bbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:33.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c7d3b1640 1 -- 172.21.15.62:0/1581777500 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c68009420 con 0x7f6c780b7d30 2023-05-15T16:40:33.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c7d3b1640 1 --2- 172.21.15.62:0/1581777500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c780b7d30 0x7f6c780702d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6c7001d7e0 tx=0x7f6c7001bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:33.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c6d7fa640 1 -- 172.21.15.62:0/1581777500 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c70009450 con 0x7f6c780b7d30 2023-05-15T16:40:33.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c6d7fa640 1 -- 172.21.15.62:0/1581777500 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c700b9410 con 0x7f6c780b7d30 2023-05-15T16:40:33.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c6d7fa640 1 -- 172.21.15.62:0/1581777500 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c700b97a0 con 0x7f6c780b7d30 2023-05-15T16:40:33.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c7ee14640 1 -- 172.21.15.62:0/1581777500 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c70009a70 con 0x7f6c780b7d30 2023-05-15T16:40:33.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c7ee14640 1 -- 172.21.15.62:0/1581777500 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c78141fa0 con 0x7f6c780b7d30 2023-05-15T16:40:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c7ee14640 1 -- 172.21.15.62:0/1581777500 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c7806e3f0 con 0x7f6c780b7d30 2023-05-15T16:40:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c6d7fa640 1 -- 172.21.15.62:0/1581777500 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f6c700b6050 con 0x7f6c780b7d30 2023-05-15T16:40:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c6d7fa640 1 --2- 172.21.15.62:0/1581777500 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6c640653b0 0x7f6c64067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c6d7fa640 1 -- 172.21.15.62:0/1581777500 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6148+0+0 (secure 0 0 0) 0x7f6c70120d30 con 0x7f6c780b7d30 2023-05-15T16:40:33.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.819+0000 7f6c7cbb0640 1 --2- 172.21.15.62:0/1581777500 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6c640653b0 0x7f6c64067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:33.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.823+0000 7f6c7cbb0640 1 --2- 172.21.15.62:0/1581777500 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6c640653b0 0x7f6c64067860 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6c74005890 tx=0x7f6c74009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:33.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.823+0000 7f6c6d7fa640 1 -- 172.21.15.62:0/1581777500 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f6c700ee9e0 con 0x7f6c780b7d30 2023-05-15T16:40:33.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:33.971+0000 7f6c7ee14640 1 -- 172.21.15.62:0/1581777500 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6c780b56d0 con 0x7f6c780b7d30 2023-05-15T16:40:34.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.691+0000 7f6c6d7fa640 1 -- 172.21.15.62:0/1581777500 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6c700b40d0 con 0x7f6c780b7d30 2023-05-15T16:40:34.695 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' removed 2023-05-15T16:40:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.695+0000 7f6c7ee14640 1 -- 172.21.15.62:0/1581777500 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6c640653b0 msgr2=0x7f6c64067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:34.700 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.695+0000 7f6c7ee14640 1 --2- 172.21.15.62:0/1581777500 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6c640653b0 0x7f6c64067860 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6c74005890 tx=0x7f6c74009040 comp rx=0 tx=0).stop 2023-05-15T16:40:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.695+0000 7f6c7ee14640 1 -- 172.21.15.62:0/1581777500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c780b7d30 msgr2=0x7f6c780702d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.695+0000 7f6c7ee14640 1 --2- 172.21.15.62:0/1581777500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c780b7d30 0x7f6c780702d0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f6c7001d7e0 tx=0x7f6c7001bed0 comp rx=0 tx=0).stop 2023-05-15T16:40:34.701 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.695+0000 7f6c7ee14640 1 -- 172.21.15.62:0/1581777500 shutdown_connections 2023-05-15T16:40:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.699+0000 7f6c7ee14640 1 --2- 172.21.15.62:0/1581777500 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6c640653b0 0x7f6c64067860 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.699+0000 7f6c7ee14640 1 --2- 172.21.15.62:0/1581777500 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6c780b7d30 0x7f6c780702d0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.699+0000 7f6c7ee14640 1 --2- 172.21.15.62:0/1581777500 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6c780b6700 0x7f6c780bbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.699+0000 7f6c7ee14640 1 --2- 172.21.15.62:0/1581777500 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6c780b5300 0x7f6c78142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.699+0000 7f6c7ee14640 1 -- 172.21.15.62:0/1581777500 >> 172.21.15.62:0/1581777500 conn(0x7f6c780697b0 msgr2=0x7f6c7813fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:34.702 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.699+0000 7f6c7ee14640 1 -- 172.21.15.62:0/1581777500 shutdown_connections 2023-05-15T16:40:34.704 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.699+0000 7f6c7ee14640 1 -- 172.21.15.62:0/1581777500 wait complete. 2023-05-15T16:40:34.733 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-05-15T16:40:34.859 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.855+0000 7f268b8ab640 1 Processor -- start 2023-05-15T16:40:34.860 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.855+0000 7f268b8ab640 1 -- start start 2023-05-15T16:40:34.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.855+0000 7f268b8ab640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f26840b7780 0x7f26840b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:34.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.855+0000 7f268b8ab640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26840b83d0 0x7f26840b87f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:34.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.855+0000 7f268b8ab640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26840b8d30 con 0x7f26840b51b0 2023-05-15T16:40:34.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.855+0000 7f268b8ab640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26841473c0 con 0x7f26840b7780 2023-05-15T16:40:34.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.855+0000 7f268b8ab640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2684146810 con 0x7f26840b83d0 2023-05-15T16:40:34.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.855+0000 7f2689647640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f26840b7780 0x7f26840b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:34.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.855+0000 7f2689647640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f26840b7780 0x7f26840b4c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60328/0 (socket says 172.21.15.62:60328) 2023-05-15T16:40:34.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.855+0000 7f2689647640 1 -- 172.21.15.62:0/4041188566 learned_addr learned my addr 172.21.15.62:0/4041188566 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:34.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.855+0000 7f2688e46640 1 --1- 172.21.15.62:0/4041188566 >> v1:172.21.15.62:6789/0 conn(0x7f26840b51b0 0x7f2684140680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:57986/0 (socket says 172.21.15.62:57986) 2023-05-15T16:40:34.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.855+0000 7f2689647640 1 -- 172.21.15.62:0/4041188566 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26840b83d0 msgr2=0x7f26840b87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:34.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.855+0000 7f2689e48640 1 --2- 172.21.15.62:0/4041188566 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26840b83d0 0x7f26840b87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:34.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.855+0000 7f2689647640 1 --2- 172.21.15.62:0/4041188566 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26840b83d0 0x7f26840b87f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:34.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.855+0000 7f2689647640 1 -- 172.21.15.62:0/4041188566 >> v1:172.21.15.62:6789/0 conn(0x7f26840b51b0 legacy=0x7f2684140680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:34.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.855+0000 7f2689647640 1 -- 172.21.15.62:0/4041188566 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2684146a90 con 0x7f26840b7780 2023-05-15T16:40:34.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.859+0000 7f2689647640 1 --2- 172.21.15.62:0/4041188566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26840b7780 0x7f26840b4c70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2680009870 tx=0x7f268001c510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731e2ec2b8a90bb2 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:34.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.859+0000 7f267bfff640 1 -- 172.21.15.62:0/4041188566 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26800ab620 con 0x7f26840b7780 2023-05-15T16:40:34.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.859+0000 7f267bfff640 1 -- 172.21.15.62:0/4041188566 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26800ab780 con 0x7f26840b7780 2023-05-15T16:40:34.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.859+0000 7f267bfff640 1 -- 172.21.15.62:0/4041188566 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26800abb10 con 0x7f26840b7780 2023-05-15T16:40:34.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.859+0000 7f268b8ab640 1 -- 172.21.15.62:0/4041188566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26840b7780 msgr2=0x7f26840b4c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:34.865 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.859+0000 7f268b8ab640 1 --2- 172.21.15.62:0/4041188566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26840b7780 0x7f26840b4c70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2680009870 tx=0x7f268001c510 comp rx=0 tx=0).stop 2023-05-15T16:40:34.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.859+0000 7f268b8ab640 1 -- 172.21.15.62:0/4041188566 shutdown_connections 2023-05-15T16:40:34.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.859+0000 7f268b8ab640 1 --2- 172.21.15.62:0/4041188566 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26840b83d0 0x7f26840b87f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:34.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.859+0000 7f268b8ab640 1 --2- 172.21.15.62:0/4041188566 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26840b7780 0x7f26840b4c70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:34.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.859+0000 7f268b8ab640 1 -- 172.21.15.62:0/4041188566 >> 172.21.15.62:0/4041188566 conn(0x7f26840697b0 msgr2=0x7f2684069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:34.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.859+0000 7f268b8ab640 1 -- 172.21.15.62:0/4041188566 shutdown_connections 2023-05-15T16:40:34.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.859+0000 7f268b8ab640 1 -- 172.21.15.62:0/4041188566 wait complete. 2023-05-15T16:40:34.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f268b8ab640 1 Processor -- start 2023-05-15T16:40:34.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f268b8ab640 1 -- start start 2023-05-15T16:40:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f268b8ab640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26840b51b0 0x7f268413a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f268b8ab640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26840b7780 0x7f26841335a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f268b8ab640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26840b83d0 0x7f2684133ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f268b8ab640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f268413af20 con 0x7f26840b7780 2023-05-15T16:40:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f268b8ab640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2684133110 con 0x7f26840b83d0 2023-05-15T16:40:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f268b8ab640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2684132b00 con 0x7f26840b51b0 2023-05-15T16:40:34.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f2688e46640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26840b7780 0x7f26841335a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:34.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f2688e46640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26840b7780 0x7f26841335a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60340/0 (socket says 172.21.15.62:60340) 2023-05-15T16:40:34.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f2688e46640 1 -- 172.21.15.62:0/2949846135 learned_addr learned my addr 172.21.15.62:0/2949846135 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:34.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f2689647640 1 --2- 172.21.15.62:0/2949846135 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26840b51b0 0x7f268413a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:34.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f2688e46640 1 -- 172.21.15.62:0/2949846135 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26840b51b0 msgr2=0x7f268413a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:34.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f2688e46640 1 --2- 172.21.15.62:0/2949846135 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26840b51b0 0x7f268413a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:34.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f2688e46640 1 -- 172.21.15.62:0/2949846135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26840b83d0 msgr2=0x7f2684133ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:34.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f2688e46640 1 --2- 172.21.15.62:0/2949846135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26840b83d0 0x7f2684133ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:34.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f2688e46640 1 -- 172.21.15.62:0/2949846135 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26800094d0 con 0x7f26840b7780 2023-05-15T16:40:34.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f2688e46640 1 --2- 172.21.15.62:0/2949846135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26840b7780 0x7f26841335a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f267400c490 tx=0x7f267400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:34.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f2679ffb640 1 -- 172.21.15.62:0/2949846135 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674007480 con 0x7f26840b7780 2023-05-15T16:40:34.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f2679ffb640 1 -- 172.21.15.62:0/2949846135 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2674007600 con 0x7f26840b7780 2023-05-15T16:40:34.871 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f2679ffb640 1 -- 172.21.15.62:0/2949846135 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2674004a30 con 0x7f26840b7780 2023-05-15T16:40:34.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f268b8ab640 1 -- 172.21.15.62:0/2949846135 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2684140d90 con 0x7f26840b7780 2023-05-15T16:40:34.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f268b8ab640 1 -- 172.21.15.62:0/2949846135 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26840b7b50 con 0x7f26840b7780 2023-05-15T16:40:34.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f268b8ab640 1 -- 172.21.15.62:0/2949846135 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2684140f20 con 0x7f26840b7780 2023-05-15T16:40:34.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f2679ffb640 1 -- 172.21.15.62:0/2949846135 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f2674004b90 con 0x7f26840b7780 2023-05-15T16:40:34.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f2679ffb640 1 --2- 172.21.15.62:0/2949846135 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f2668065380 0x7f2668067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:34.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.863+0000 7f2679ffb640 1 -- 172.21.15.62:0/2949846135 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 5710+0+0 (secure 0 0 0) 0x7f2674081660 con 0x7f26840b7780 2023-05-15T16:40:34.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.867+0000 7f2689647640 1 --2- 172.21.15.62:0/2949846135 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f2668065380 0x7f2668067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:34.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.867+0000 7f2689647640 1 --2- 172.21.15.62:0/2949846135 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f2668065380 0x7f2668067830 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f26800af000 tx=0x7f2680008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:34.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:34.867+0000 7f2679ffb640 1 -- 172.21.15.62:0/2949846135 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f267404f3a0 con 0x7f26840b7780 2023-05-15T16:40:35.025 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.023+0000 7f268b8ab640 1 -- 172.21.15.62:0/2949846135 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f26840b8d30 con 0x7f26840b7780 2023-05-15T16:40:35.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.711+0000 7f2679ffb640 1 -- 172.21.15.62:0/2949846135 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) v1 ==== 169+0+0 (secure 0 0 0) 0x7f26840b8d30 con 0x7f26840b7780 2023-05-15T16:40:35.718 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' removed 2023-05-15T16:40:35.728 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.723+0000 7f268b8ab640 1 -- 172.21.15.62:0/2949846135 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f2668065380 msgr2=0x7f2668067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:35.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.723+0000 7f268b8ab640 1 --2- 172.21.15.62:0/2949846135 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f2668065380 0x7f2668067830 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f26800af000 tx=0x7f2680008040 comp rx=0 tx=0).stop 2023-05-15T16:40:35.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.723+0000 7f268b8ab640 1 -- 172.21.15.62:0/2949846135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26840b7780 msgr2=0x7f26841335a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:35.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.723+0000 7f268b8ab640 1 --2- 172.21.15.62:0/2949846135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26840b7780 0x7f26841335a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f267400c490 tx=0x7f267400c950 comp rx=0 tx=0).stop 2023-05-15T16:40:35.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.723+0000 7f268b8ab640 1 -- 172.21.15.62:0/2949846135 shutdown_connections 2023-05-15T16:40:35.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.723+0000 7f268b8ab640 1 --2- 172.21.15.62:0/2949846135 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f26840b83d0 0x7f2684133ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:35.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.723+0000 7f268b8ab640 1 --2- 172.21.15.62:0/2949846135 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f2668065380 0x7f2668067830 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:35.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.723+0000 7f268b8ab640 1 --2- 172.21.15.62:0/2949846135 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f26840b7780 0x7f26841335a0 secure :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f267400c490 tx=0x7f267400c950 comp rx=0 tx=0).stop 2023-05-15T16:40:35.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.723+0000 7f268b8ab640 1 --2- 172.21.15.62:0/2949846135 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f26840b51b0 0x7f268413a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:35.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.723+0000 7f268b8ab640 1 -- 172.21.15.62:0/2949846135 >> 172.21.15.62:0/2949846135 conn(0x7f26840697b0 msgr2=0x7f26840b3020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:35.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.727+0000 7f268b8ab640 1 -- 172.21.15.62:0/2949846135 shutdown_connections 2023-05-15T16:40:35.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.731+0000 7f268b8ab640 1 -- 172.21.15.62:0/2949846135 wait complete. 2023-05-15T16:40:35.757 INFO:tasks.ceph.mds.a:Restarting daemon 2023-05-15T16:40:35.758 INFO:tasks.ceph.mds.a:Stopping old one... 2023-05-15T16:40:35.758 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-05-15T16:40:35.758 INFO:teuthology.orchestra.run:waiting for 300 2023-05-15T16:40:35.759 INFO:tasks.ceph.mds.c:Restarting daemon 2023-05-15T16:40:35.759 INFO:tasks.ceph.mds.c:Stopping old one... 2023-05-15T16:40:35.759 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-05-15T16:40:35.759 INFO:teuthology.orchestra.run:waiting for 300 2023-05-15T16:40:35.759 INFO:tasks.ceph.mds.b:Restarting daemon 2023-05-15T16:40:35.760 INFO:tasks.ceph.mds.b:Stopping old one... 2023-05-15T16:40:35.760 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-05-15T16:40:35.760 INFO:teuthology.orchestra.run:waiting for 300 2023-05-15T16:40:35.768 INFO:tasks.ceph.mds.a:Stopped 2023-05-15T16:40:35.768 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-05-15T16:40:35.773 INFO:tasks.ceph.mds.c:Stopped 2023-05-15T16:40:35.773 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-05-15T16:40:35.778 INFO:tasks.ceph.mds.b:Stopped 2023-05-15T16:40:35.778 DEBUG:teuthology.orchestra.run.smithi161:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-05-15T16:40:35.818 INFO:tasks.ceph.mds.a:Started 2023-05-15T16:40:35.818 DEBUG:teuthology.parallel:result is None 2023-05-15T16:40:35.819 INFO:tasks.ceph.mds.c:Started 2023-05-15T16:40:35.820 DEBUG:teuthology.parallel:result is None 2023-05-15T16:40:35.820 INFO:tasks.ceph.mds.b:Started 2023-05-15T16:40:35.821 DEBUG:teuthology.parallel:result is None 2023-05-15T16:40:35.821 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-05-15T16:40:35.886 INFO:tasks.ceph.mds.a.smithi062.stdout:starting mds.a at 2023-05-15T16:40:35.887 INFO:tasks.ceph.mds.c.smithi062.stdout:starting mds.c at 2023-05-15T16:40:35.892 INFO:tasks.ceph.mds.b.smithi161.stdout:starting mds.b at 2023-05-15T16:40:35.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.955+0000 7fdd9d766640 1 Processor -- start 2023-05-15T16:40:35.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.955+0000 7fdd9d766640 1 -- start start 2023-05-15T16:40:35.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.955+0000 7fdd9d766640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdd980bcd90 0x7fdd9814a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:35.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.955+0000 7fdd9d766640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd9806b050 0x7fdd9814a630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:35.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.955+0000 7fdd9d766640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd98149c50 con 0x7fdd980ba900 2023-05-15T16:40:35.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.955+0000 7fdd9d766640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd9806aca0 con 0x7fdd980bcd90 2023-05-15T16:40:35.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.955+0000 7fdd9d766640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9806b530 con 0x7fdd9806b050 2023-05-15T16:40:35.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.955+0000 7fdd967fc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd9806b050 0x7fdd9814a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:35.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.955+0000 7fdd96ffd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fdd980bcd90 0x7fdd9814a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:35.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.955+0000 7fdd967fc640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd9806b050 0x7fdd9814a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.62:37766/0 (socket says 172.21.15.62:37766) 2023-05-15T16:40:35.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.955+0000 7fdd967fc640 1 -- 172.21.15.62:0/1854479953 learned_addr learned my addr 172.21.15.62:0/1854479953 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:35.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.955+0000 7fdd967fc640 1 -- 172.21.15.62:0/1854479953 >> v2:172.21.15.161:3300/0 conn(0x7fdd980bcd90 msgr2=0x7fdd9814a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:35.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.955+0000 7fdd967fc640 1 --2- 172.21.15.62:0/1854479953 >> v2:172.21.15.161:3300/0 conn(0x7fdd980bcd90 0x7fdd9814a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:35.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.955+0000 7fdd967fc640 1 -- 172.21.15.62:0/1854479953 >> v1:172.21.15.161:6789/0 conn(0x7fdd980ba900 legacy=0x7fdd9814d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:35.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.955+0000 7fdd967fc640 1 -- 172.21.15.62:0/1854479953 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9806b810 con 0x7fdd9806b050 2023-05-15T16:40:35.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.959+0000 7fdd96ffd640 1 --2- 172.21.15.62:0/1854479953 >> v2:172.21.15.161:3300/0 conn(0x7fdd980bcd90 0x7fdd9814a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-15T16:40:35.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.959+0000 7fdd967fc640 1 --2- 172.21.15.62:0/1854479953 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd9806b050 0x7fdd9814a630 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009870 tx=0x7fdd8c01c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24ab70b9543de963 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:35.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.959+0000 7fdd95ffb640 1 -- 172.21.15.62:0/1854479953 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0ab600 con 0x7fdd9806b050 2023-05-15T16:40:35.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.959+0000 7fdd95ffb640 1 -- 172.21.15.62:0/1854479953 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c0a7050 con 0x7fdd9806b050 2023-05-15T16:40:35.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.959+0000 7fdd95ffb640 1 -- 172.21.15.62:0/1854479953 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0ab980 con 0x7fdd9806b050 2023-05-15T16:40:35.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd9d766640 1 -- 172.21.15.62:0/1854479953 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd9806b050 msgr2=0x7fdd9814a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:35.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd9d766640 1 --2- 172.21.15.62:0/1854479953 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd9806b050 0x7fdd9814a630 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c009870 tx=0x7fdd8c01c540 comp rx=0 tx=0).stop 2023-05-15T16:40:35.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd9d766640 1 -- 172.21.15.62:0/1854479953 shutdown_connections 2023-05-15T16:40:35.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd9d766640 1 --2- 172.21.15.62:0/1854479953 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd9806b050 0x7fdd9814a630 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:35.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd9d766640 1 --2- 172.21.15.62:0/1854479953 >> v2:172.21.15.161:3300/0 conn(0x7fdd980bcd90 0x7fdd9814a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:35.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd9d766640 1 -- 172.21.15.62:0/1854479953 >> 172.21.15.62:0/1854479953 conn(0x7fdd980bff80 msgr2=0x7fdd980c0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:35.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd9d766640 1 -- 172.21.15.62:0/1854479953 shutdown_connections 2023-05-15T16:40:35.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd9d766640 1 -- 172.21.15.62:0/1854479953 wait complete. 2023-05-15T16:40:35.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd9d766640 1 Processor -- start 2023-05-15T16:40:35.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd9d766640 1 -- start start 2023-05-15T16:40:35.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd9d766640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd9806b050 0x7fdd980b3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:35.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd9d766640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd980ba900 0x7fdd981464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:35.970 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd9d766640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd980bcd90 0x7fdd98147aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd9d766640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9814b6d0 con 0x7fdd980ba900 2023-05-15T16:40:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd9d766640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd980b3580 con 0x7fdd980bcd90 2023-05-15T16:40:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd9d766640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd98145f20 con 0x7fdd9806b050 2023-05-15T16:40:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd967fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd980ba900 0x7fdd981464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd967fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd980ba900 0x7fdd981464c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60370/0 (socket says 172.21.15.62:60370) 2023-05-15T16:40:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd967fc640 1 -- 172.21.15.62:0/1792594495 learned_addr learned my addr 172.21.15.62:0/1792594495 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:35.971 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd977fe640 1 --2- 172.21.15.62:0/1792594495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd980bcd90 0x7fdd98147aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd96ffd640 1 --2- 172.21.15.62:0/1792594495 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd9806b050 0x7fdd980b3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd967fc640 1 -- 172.21.15.62:0/1792594495 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd9806b050 msgr2=0x7fdd980b3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd967fc640 1 --2- 172.21.15.62:0/1792594495 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd9806b050 0x7fdd980b3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd967fc640 1 -- 172.21.15.62:0/1792594495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd980bcd90 msgr2=0x7fdd98147aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd967fc640 1 --2- 172.21.15.62:0/1792594495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd980bcd90 0x7fdd98147aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd967fc640 1 -- 172.21.15.62:0/1792594495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd88009420 con 0x7fdd980ba900 2023-05-15T16:40:35.972 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd967fc640 1 --2- 172.21.15.62:0/1792594495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd980ba900 0x7fdd981464c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c01abf0 tx=0x7fdd8c0192e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:35.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd7f7fe640 1 -- 172.21.15.62:0/1792594495 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0b6440 con 0x7fdd980ba900 2023-05-15T16:40:35.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd7f7fe640 1 -- 172.21.15.62:0/1792594495 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c0b65c0 con 0x7fdd980ba900 2023-05-15T16:40:35.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd9d766640 1 -- 172.21.15.62:0/1792594495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd8c0094d0 con 0x7fdd980ba900 2023-05-15T16:40:35.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd7f7fe640 1 -- 172.21.15.62:0/1792594495 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0b6970 con 0x7fdd980ba900 2023-05-15T16:40:35.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.963+0000 7fdd9d766640 1 -- 172.21.15.62:0/1792594495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd98157510 con 0x7fdd980ba900 2023-05-15T16:40:35.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.967+0000 7fdd9d766640 1 -- 172.21.15.62:0/1792594495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd9809f5f0 con 0x7fdd980ba900 2023-05-15T16:40:35.973 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.967+0000 7fdd7f7fe640 1 -- 172.21.15.62:0/1792594495 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fdd8c0b2040 con 0x7fdd980ba900 2023-05-15T16:40:35.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.967+0000 7fdd7f7fe640 1 --2- 172.21.15.62:0/1792594495 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fdd84065380 0x7fdd84067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:35.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.967+0000 7fdd7f7fe640 1 -- 172.21.15.62:0/1792594495 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5296+0+0 (secure 0 0 0) 0x7fdd8c11bb70 con 0x7fdd980ba900 2023-05-15T16:40:35.974 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.967+0000 7fdd96ffd640 1 --2- 172.21.15.62:0/1792594495 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fdd84065380 0x7fdd84067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:35.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.967+0000 7fdd96ffd640 1 --2- 172.21.15.62:0/1792594495 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fdd84065380 0x7fdd84067830 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdd88009c50 tx=0x7fdd88009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:35.975 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:35.971+0000 7fdd7f7fe640 1 -- 172.21.15.62:0/1792594495 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fdd8c0e9b10 con 0x7fdd980ba900 2023-05-15T16:40:36.153 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:36.151+0000 7fdd9d766640 1 -- 172.21.15.62:0/1792594495 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fdd981576a0 con 0x7fdd980ba900 2023-05-15T16:40:36.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:36.931+0000 7fdd7f7fe640 1 -- 172.21.15.62:0/1792594495 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v30) v1 ==== 97+0+0 (secure 0 0 0) 0x7fdd8c0bc080 con 0x7fdd980ba900 2023-05-15T16:40:36.935 INFO:teuthology.orchestra.run.smithi062.stderr: removed all blocklist entries 2023-05-15T16:40:36.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:36.935+0000 7fdd9d766640 1 -- 172.21.15.62:0/1792594495 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fdd84065380 msgr2=0x7fdd84067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:36.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:36.935+0000 7fdd9d766640 1 --2- 172.21.15.62:0/1792594495 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fdd84065380 0x7fdd84067830 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fdd88009c50 tx=0x7fdd88009190 comp rx=0 tx=0).stop 2023-05-15T16:40:36.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:36.935+0000 7fdd9d766640 1 -- 172.21.15.62:0/1792594495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd980ba900 msgr2=0x7fdd981464c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:36.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:36.935+0000 7fdd9d766640 1 --2- 172.21.15.62:0/1792594495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd980ba900 0x7fdd981464c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c01abf0 tx=0x7fdd8c0192e0 comp rx=0 tx=0).stop 2023-05-15T16:40:36.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:36.935+0000 7fdd9d766640 1 -- 172.21.15.62:0/1792594495 shutdown_connections 2023-05-15T16:40:36.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:36.935+0000 7fdd9d766640 1 --2- 172.21.15.62:0/1792594495 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fdd980bcd90 0x7fdd98147aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:36.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:36.935+0000 7fdd9d766640 1 --2- 172.21.15.62:0/1792594495 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fdd84065380 0x7fdd84067830 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:36.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:36.935+0000 7fdd9d766640 1 --2- 172.21.15.62:0/1792594495 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fdd980ba900 0x7fdd981464c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:36.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:36.935+0000 7fdd9d766640 1 --2- 172.21.15.62:0/1792594495 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fdd9806b050 0x7fdd980b3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:36.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:36.935+0000 7fdd9d766640 1 -- 172.21.15.62:0/1792594495 >> 172.21.15.62:0/1792594495 conn(0x7fdd980bff80 msgr2=0x7fdd980bdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:36.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:36.935+0000 7fdd9d766640 1 -- 172.21.15.62:0/1792594495 shutdown_connections 2023-05-15T16:40:36.940 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:36.935+0000 7fdd9d766640 1 -- 172.21.15.62:0/1792594495 wait complete. 2023-05-15T16:40:36.962 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-05-15T16:40:37.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.091+0000 7f7ccc360640 1 Processor -- start 2023-05-15T16:40:37.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.091+0000 7f7ccc360640 1 -- start start 2023-05-15T16:40:37.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.091+0000 7f7ccc360640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc406b050 0x7f7cc41524e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:37.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.091+0000 7f7ccc360640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc4149c50 con 0x7f7cc414a800 2023-05-15T16:40:37.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.091+0000 7f7ccc360640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc406aca0 con 0x7f7cc40bcd90 2023-05-15T16:40:37.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.091+0000 7f7ccc360640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc406b530 con 0x7f7cc406b050 2023-05-15T16:40:37.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.091+0000 7f7cca8fd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f7cc414a800 0x7f7cc4154a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58010/0 (socket says 172.21.15.62:58010) 2023-05-15T16:40:37.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.091+0000 7f7cca8fd640 1 -- 172.21.15.62:0/1850481083 learned_addr learned my addr 172.21.15.62:0/1850481083 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:37.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.091+0000 7f7cc98fb640 1 --2- 172.21.15.62:0/1850481083 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc406b050 0x7f7cc41524e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:37.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.091+0000 7f7cc90fa640 1 -- 172.21.15.62:0/1850481083 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 571132369 0 0) 0x7f7cc4149c50 con 0x7f7cc414a800 2023-05-15T16:40:37.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.091+0000 7f7cc90fa640 1 -- 172.21.15.62:0/1850481083 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7cb0003530 con 0x7f7cc414a800 2023-05-15T16:40:37.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cc90fa640 1 -- 172.21.15.62:0/1850481083 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 635456392 0 0) 0x7f7cb0003530 con 0x7f7cc414a800 2023-05-15T16:40:37.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cc90fa640 1 -- 172.21.15.62:0/1850481083 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc406b050 msgr2=0x7f7cc41524e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:37.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cc90fa640 1 --2- 172.21.15.62:0/1850481083 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc406b050 0x7f7cc41524e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cc90fa640 1 -- 172.21.15.62:0/1850481083 >> v1:172.21.15.161:6789/0 conn(0x7f7cc40bcd90 legacy=0x7f7cc414a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:37.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cc90fa640 1 -- 172.21.15.62:0/1850481083 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc406b810 con 0x7f7cc414a800 2023-05-15T16:40:37.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cc90fa640 1 -- 172.21.15.62:0/1850481083 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7f7cbc001a00 con 0x7f7cc414a800 2023-05-15T16:40:37.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cc90fa640 1 -- 172.21.15.62:0/1850481083 >> v1:172.21.15.62:6789/0 conn(0x7f7cc414a800 legacy=0x7f7cc4154a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:37.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cc90fa640 1 --2- 172.21.15.62:0/1850481083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cb00039b0 0x7f7cb0003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:37.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cc90fa640 1 --2- 172.21.15.62:0/1850481083 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc406b050 0x7f7cb00047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:37.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cc90fa640 1 --2- 172.21.15.62:0/1850481083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cb0004d10 0x7f7cb0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:37.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cc90fa640 1 -- 172.21.15.62:0/1850481083 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc406b530 con 0x7f7cb0004d10 2023-05-15T16:40:37.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cc90fa640 1 -- 172.21.15.62:0/1850481083 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb000b990 con 0x7f7cb00039b0 2023-05-15T16:40:37.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cc90fa640 1 -- 172.21.15.62:0/1850481083 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cb000bb20 con 0x7f7cc406b050 2023-05-15T16:40:37.103 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cca8fd640 1 --2- 172.21.15.62:0/1850481083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cb0004d10 0x7f7cb0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:37.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cca0fc640 1 --2- 172.21.15.62:0/1850481083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cb00039b0 0x7f7cb0003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:37.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cc98fb640 1 --2- 172.21.15.62:0/1850481083 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc406b050 0x7f7cb00047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:37.104 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cca8fd640 1 -- 172.21.15.62:0/1850481083 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc406b050 msgr2=0x7f7cb00047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:37.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cca8fd640 1 --2- 172.21.15.62:0/1850481083 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc406b050 0x7f7cb00047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cca8fd640 1 -- 172.21.15.62:0/1850481083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cb00039b0 msgr2=0x7f7cb0003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:37.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cca8fd640 1 --2- 172.21.15.62:0/1850481083 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cb00039b0 0x7f7cb0003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.105 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cca8fd640 1 -- 172.21.15.62:0/1850481083 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cb0003530 con 0x7f7cb0004d10 2023-05-15T16:40:37.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cca8fd640 1 --2- 172.21.15.62:0/1850481083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cb0004d10 0x7f7cb0005180 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7cc414ac60 tx=0x7f7cbc01fa60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8dc0bdca9c5675 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:37.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cc90fa640 1 -- 172.21.15.62:0/1850481083 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc0aa690 con 0x7f7cb0004d10 2023-05-15T16:40:37.106 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cc90fa640 1 -- 172.21.15.62:0/1850481083 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cbc0aa810 con 0x7f7cb0004d10 2023-05-15T16:40:37.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cc90fa640 1 -- 172.21.15.62:0/1850481083 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cbc0aabc0 con 0x7f7cb0004d10 2023-05-15T16:40:37.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7ccc360640 1 -- 172.21.15.62:0/1850481083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cb0004d10 msgr2=0x7f7cb0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:37.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7ccc360640 1 --2- 172.21.15.62:0/1850481083 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cb0004d10 0x7f7cb0005180 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f7cc414ac60 tx=0x7f7cbc01fa60 comp rx=0 tx=0).stop 2023-05-15T16:40:37.107 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7cca8fd640 1 -- 172.21.15.62:0/1850481083 reap_dead start 2023-05-15T16:40:37.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7ccc360640 1 -- 172.21.15.62:0/1850481083 shutdown_connections 2023-05-15T16:40:37.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7ccc360640 1 -- 172.21.15.62:0/1850481083 >> 172.21.15.62:0/1850481083 conn(0x7f7cc40bff80 msgr2=0x7f7cc40c0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:37.108 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7ccc360640 1 -- 172.21.15.62:0/1850481083 shutdown_connections 2023-05-15T16:40:37.109 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.095+0000 7f7ccc360640 1 -- 172.21.15.62:0/1850481083 wait complete. 2023-05-15T16:40:37.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7ccc360640 1 Processor -- start 2023-05-15T16:40:37.113 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7ccc360640 1 -- start start 2023-05-15T16:40:37.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7ccc360640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc40b0b50 0x7f7cc40a36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:37.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7ccc360640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cc41461d0 0x7f7cc41e2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:37.114 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7ccc360640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cc40b0f20 0x7f7cc4148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:37.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7ccc360640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc4142e30 con 0x7f7cc41461d0 2023-05-15T16:40:37.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7ccc360640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc40a3000 con 0x7f7cc40b0f20 2023-05-15T16:40:37.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7ccc360640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc40be840 con 0x7f7cc40b0b50 2023-05-15T16:40:37.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7cc98fb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cc41461d0 0x7f7cc41e2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:37.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7cc98fb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cc41461d0 0x7f7cc41e2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60378/0 (socket says 172.21.15.62:60378) 2023-05-15T16:40:37.115 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7cc98fb640 1 -- 172.21.15.62:0/815991822 learned_addr learned my addr 172.21.15.62:0/815991822 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:37.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7cca8fd640 1 --2- 172.21.15.62:0/815991822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cc40b0f20 0x7f7cc4148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:37.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7cca0fc640 1 --2- 172.21.15.62:0/815991822 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc40b0b50 0x7f7cc40a36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:37.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7cc98fb640 1 -- 172.21.15.62:0/815991822 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc40b0b50 msgr2=0x7f7cc40a36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:37.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7cc98fb640 1 --2- 172.21.15.62:0/815991822 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc40b0b50 0x7f7cc40a36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7cc98fb640 1 -- 172.21.15.62:0/815991822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cc40b0f20 msgr2=0x7f7cc4148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:37.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7cc98fb640 1 --2- 172.21.15.62:0/815991822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cc40b0f20 0x7f7cc4148af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.116 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7cc98fb640 1 -- 172.21.15.62:0/815991822 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc41475d0 con 0x7f7cc41461d0 2023-05-15T16:40:37.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7cc98fb640 1 --2- 172.21.15.62:0/815991822 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cc41461d0 0x7f7cc41e2f30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8011590 tx=0x7f7cb8011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:37.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7cb6ffd640 1 -- 172.21.15.62:0/815991822 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8004220 con 0x7f7cc41461d0 2023-05-15T16:40:37.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7cb6ffd640 1 -- 172.21.15.62:0/815991822 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb8004380 con 0x7f7cc41461d0 2023-05-15T16:40:37.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7cb6ffd640 1 -- 172.21.15.62:0/815991822 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8015870 con 0x7f7cc41461d0 2023-05-15T16:40:37.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7ccc360640 1 -- 172.21.15.62:0/815991822 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc406baf0 con 0x7f7cc41461d0 2023-05-15T16:40:37.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7ccc360640 1 -- 172.21.15.62:0/815991822 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc409f5f0 con 0x7f7cc41461d0 2023-05-15T16:40:37.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.099+0000 7f7ccc360640 1 -- 172.21.15.62:0/815991822 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc4067960 con 0x7f7cc41461d0 2023-05-15T16:40:37.117 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.103+0000 7f7cb6ffd640 1 -- 172.21.15.62:0/815991822 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f7cb80159d0 con 0x7f7cc41461d0 2023-05-15T16:40:37.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.103+0000 7f7cb6ffd640 1 --2- 172.21.15.62:0/815991822 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7ca8065380 0x7f7ca8067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:37.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.103+0000 7f7cb6ffd640 1 -- 172.21.15.62:0/815991822 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f7cb8082680 con 0x7f7cc41461d0 2023-05-15T16:40:37.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.103+0000 7f7cca0fc640 1 --2- 172.21.15.62:0/815991822 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7ca8065380 0x7f7ca8067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:37.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.103+0000 7f7cca0fc640 1 --2- 172.21.15.62:0/815991822 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7ca8065380 0x7f7ca8067830 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00016f0 tx=0x7f7cc0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:37.118 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.107+0000 7f7cb6ffd640 1 -- 172.21.15.62:0/815991822 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f7cb80506e0 con 0x7f7cc41461d0 2023-05-15T16:40:37.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.311+0000 7f7ccc360640 1 -- 172.21.15.62:0/815991822 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f7cc404dc10 con 0x7f7cc41461d0 2023-05-15T16:40:37.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.311+0000 7f7cb6ffd640 1 -- 172.21.15.62:0/815991822 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+5491 (secure 0 0 0) 0x7f7cb8053d00 con 0x7f7cc41461d0 2023-05-15T16:40:37.317 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:37.317 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-05-15T16:40:37.317 INFO:teuthology.orchestra.run.smithi062.stdout: "auth_dump": [ 2023-05-15T16:40:37.318 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:37.318 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.a", 2023-05-15T16:40:37.318 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAhYGJk2/I+MRAAcO6R1pDb3VfbSdorPDtNgw==", 2023-05-15T16:40:37.318 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-05-15T16:40:37.318 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-05-15T16:40:37.318 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-05-15T16:40:37.318 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-05-15T16:40:37.319 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-05-15T16:40:37.319 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.319 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:40:37.319 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:37.319 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.b", 2023-05-15T16:40:37.319 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAiYGJkNewoBBAAI36Q4uePTK+cPkKnlS14EA==", 2023-05-15T16:40:37.319 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-05-15T16:40:37.319 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-05-15T16:40:37.320 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-05-15T16:40:37.320 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-05-15T16:40:37.320 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-05-15T16:40:37.320 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.320 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:40:37.320 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:37.320 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mds.c", 2023-05-15T16:40:37.321 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAhYGJkqF6TORAAfJq5SNyhPikDQPsWiWFFbQ==", 2023-05-15T16:40:37.321 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-05-15T16:40:37.321 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-05-15T16:40:37.321 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-05-15T16:40:37.321 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-05-15T16:40:37.321 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-05-15T16:40:37.321 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.321 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:40:37.322 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:37.322 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.0", 2023-05-15T16:40:37.322 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAlYGJkRUDlBBAAGlRXjba9zx4V+IwgEwN5CQ==", 2023-05-15T16:40:37.322 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-05-15T16:40:37.322 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-05-15T16:40:37.322 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-05-15T16:40:37.322 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-05-15T16:40:37.323 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.323 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:40:37.323 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:37.323 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.1", 2023-05-15T16:40:37.323 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAoYGJkPxe/CxAAuq6TPlGzKC6pHeAtNDyZiQ==", 2023-05-15T16:40:37.323 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-05-15T16:40:37.324 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-05-15T16:40:37.324 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-05-15T16:40:37.324 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-05-15T16:40:37.324 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.324 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:40:37.324 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:37.324 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.2", 2023-05-15T16:40:37.325 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQArYGJkU5U7FRAAhXTl1/yw7QGzySVGVLEffg==", 2023-05-15T16:40:37.325 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-05-15T16:40:37.325 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-05-15T16:40:37.325 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-05-15T16:40:37.325 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-05-15T16:40:37.325 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.325 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:40:37.325 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:37.326 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.3", 2023-05-15T16:40:37.326 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAuYGJkAKf4HRAAQRcpmVL4TCswScbw+xle4Q==", 2023-05-15T16:40:37.326 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-05-15T16:40:37.326 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-05-15T16:40:37.326 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-05-15T16:40:37.326 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-05-15T16:40:37.326 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.327 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:40:37.327 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:37.327 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.4", 2023-05-15T16:40:37.327 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA0YGJkyT1QIRAAjwyKqwRQ31wvmrAxTJ5UEg==", 2023-05-15T16:40:37.327 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-05-15T16:40:37.327 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-05-15T16:40:37.327 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-05-15T16:40:37.327 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-05-15T16:40:37.328 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.328 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:40:37.328 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:37.328 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.5", 2023-05-15T16:40:37.328 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA3YGJk7XxNKBAAtQ44ZzLNV3PZl8ox2yWICQ==", 2023-05-15T16:40:37.328 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-05-15T16:40:37.328 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-05-15T16:40:37.329 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-05-15T16:40:37.329 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-05-15T16:40:37.329 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.329 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:40:37.329 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:37.329 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.6", 2023-05-15T16:40:37.329 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA6YGJk1FdkMBAAsgJepb0ixJFYbuX5jcAHYg==", 2023-05-15T16:40:37.329 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-05-15T16:40:37.330 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-05-15T16:40:37.330 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-05-15T16:40:37.330 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-05-15T16:40:37.330 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.330 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:40:37.330 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:37.330 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "osd.7", 2023-05-15T16:40:37.331 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQA9YGJk+8cNNxAAMeiWy45Ha8RhQIhfEoXu+A==", 2023-05-15T16:40:37.331 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-05-15T16:40:37.331 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow profile osd", 2023-05-15T16:40:37.331 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile osd", 2023-05-15T16:40:37.331 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-05-15T16:40:37.331 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.331 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:40:37.331 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:37.332 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.0", 2023-05-15T16:40:37.332 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAiYGJksBNpChAASLhAE8Y4f8Ce2qdh2v00gw==", 2023-05-15T16:40:37.332 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-05-15T16:40:37.332 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow", 2023-05-15T16:40:37.332 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow r", 2023-05-15T16:40:37.332 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow rw", 2023-05-15T16:40:37.332 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow rwx" 2023-05-15T16:40:37.332 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.333 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:40:37.333 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:37.333 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.admin", 2023-05-15T16:40:37.333 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAhYGJk1aNnFBAAZ/I0oN2lXWsDFvNv3rKzbQ==", 2023-05-15T16:40:37.333 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-05-15T16:40:37.333 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2023-05-15T16:40:37.333 INFO:teuthology.orchestra.run.smithi062.stdout: "mgr": "allow *", 2023-05-15T16:40:37.334 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow *", 2023-05-15T16:40:37.334 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-05-15T16:40:37.334 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.334 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:40:37.334 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:37.334 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-mds", 2023-05-15T16:40:37.334 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBIYGJk+iQeLRAAEh8cT4eR1LpsRy+13IZXDg==", 2023-05-15T16:40:37.334 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-05-15T16:40:37.335 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-mds" 2023-05-15T16:40:37.335 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.335 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:40:37.335 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:37.335 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-mgr", 2023-05-15T16:40:37.335 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBIYGJkkkEeLRAAHZdzUVBQA90O4wqn2ZyFsg==", 2023-05-15T16:40:37.335 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-05-15T16:40:37.335 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-mgr" 2023-05-15T16:40:37.336 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.336 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:40:37.336 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:37.336 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-osd", 2023-05-15T16:40:37.336 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBIYGJkQlkeLRAAtEBmd6QwuAg+DhSZzksGZg==", 2023-05-15T16:40:37.336 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-05-15T16:40:37.336 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-osd" 2023-05-15T16:40:37.337 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.337 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:40:37.337 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:37.337 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-rbd", 2023-05-15T16:40:37.337 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBIYGJk9HAeLRAAD/FEladjgoSpiSY1ubKceQ==", 2023-05-15T16:40:37.337 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-05-15T16:40:37.337 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-rbd" 2023-05-15T16:40:37.337 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.338 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:40:37.338 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:37.338 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-05-15T16:40:37.338 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBIYGJkqogeLRAAHrSI7+9yh2Ec52di6VYpHA==", 2023-05-15T16:40:37.338 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-05-15T16:40:37.338 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-05-15T16:40:37.338 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.338 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:40:37.339 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:37.339 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "client.bootstrap-rgw", 2023-05-15T16:40:37.339 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQBIYGJkcqEeLRAAXYzM56l5JnHtbiz0ZlSONQ==", 2023-05-15T16:40:37.339 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-05-15T16:40:37.339 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile bootstrap-rgw" 2023-05-15T16:40:37.339 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.339 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:40:37.340 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:37.340 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.x", 2023-05-15T16:40:37.340 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAhYGJkqJ/YLRAAmu7z8uKQqCLeSfVR3RLqfA==", 2023-05-15T16:40:37.340 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-05-15T16:40:37.340 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2023-05-15T16:40:37.340 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2023-05-15T16:40:37.340 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-05-15T16:40:37.340 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.341 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:40:37.341 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:37.341 INFO:teuthology.orchestra.run.smithi062.stdout: "entity": "mgr.y", 2023-05-15T16:40:37.341 INFO:teuthology.orchestra.run.smithi062.stdout: "key": "AQAhYGJked/bKhAA0XJWcKW75rnJK7YRKHY1Mw==", 2023-05-15T16:40:37.341 INFO:teuthology.orchestra.run.smithi062.stdout: "caps": { 2023-05-15T16:40:37.341 INFO:teuthology.orchestra.run.smithi062.stdout: "mds": "allow *", 2023-05-15T16:40:37.341 INFO:teuthology.orchestra.run.smithi062.stdout: "mon": "allow profile mgr", 2023-05-15T16:40:37.341 INFO:teuthology.orchestra.run.smithi062.stdout: "osd": "allow *" 2023-05-15T16:40:37.342 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.342 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:37.342 INFO:teuthology.orchestra.run.smithi062.stdout: ] 2023-05-15T16:40:37.342 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-05-15T16:40:37.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.315+0000 7f7ccc360640 1 -- 172.21.15.62:0/815991822 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7ca8065380 msgr2=0x7f7ca8067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:37.343 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.315+0000 7f7ccc360640 1 --2- 172.21.15.62:0/815991822 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7ca8065380 0x7f7ca8067830 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00016f0 tx=0x7f7cc0009040 comp rx=0 tx=0).stop 2023-05-15T16:40:37.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.315+0000 7f7ccc360640 1 -- 172.21.15.62:0/815991822 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cc41461d0 msgr2=0x7f7cc41e2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:37.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.315+0000 7f7ccc360640 1 --2- 172.21.15.62:0/815991822 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cc41461d0 0x7f7cc41e2f30 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f7cb8011590 tx=0x7f7cb8011a50 comp rx=0 tx=0).stop 2023-05-15T16:40:37.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.315+0000 7f7ccc360640 1 -- 172.21.15.62:0/815991822 shutdown_connections 2023-05-15T16:40:37.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.315+0000 7f7ccc360640 1 --2- 172.21.15.62:0/815991822 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f7cc40b0f20 0x7f7cc4148af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.315+0000 7f7ccc360640 1 --2- 172.21.15.62:0/815991822 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f7ca8065380 0x7f7ca8067830 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.315+0000 7f7ccc360640 1 --2- 172.21.15.62:0/815991822 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f7cc41461d0 0x7f7cc41e2f30 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.344 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.315+0000 7f7ccc360640 1 --2- 172.21.15.62:0/815991822 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f7cc40b0b50 0x7f7cc40a36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.315+0000 7f7ccc360640 1 -- 172.21.15.62:0/815991822 >> 172.21.15.62:0/815991822 conn(0x7f7cc40bff80 msgr2=0x7f7cc40bb760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:37.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.315+0000 7f7ccc360640 1 -- 172.21.15.62:0/815991822 shutdown_connections 2023-05-15T16:40:37.345 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.315+0000 7f7ccc360640 1 -- 172.21.15.62:0/815991822 wait complete. 2023-05-15T16:40:37.345 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-05-15T16:40:37.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.463+0000 7f4eaf446640 1 Processor -- start 2023-05-15T16:40:37.467 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.463+0000 7f4eaf446640 1 -- start start 2023-05-15T16:40:37.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.463+0000 7f4eaf446640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4ea80b9e50 0x7f4ea8147a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:37.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.463+0000 7f4eaf446640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ea814af30 0x7f4ea8147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:37.468 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.463+0000 7f4eaf446640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea8071da0 con 0x7f4ea8141990 2023-05-15T16:40:37.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.463+0000 7f4eaf446640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea814b3c0 con 0x7f4ea80b9e50 2023-05-15T16:40:37.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.463+0000 7f4eaf446640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea814b6a0 con 0x7f4ea814af30 2023-05-15T16:40:37.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.463+0000 7f4eac9e1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4ea80b9e50 0x7f4ea8147a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:37.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.463+0000 7f4eac9e1640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4ea80b9e50 0x7f4ea8147a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60388/0 (socket says 172.21.15.62:60388) 2023-05-15T16:40:37.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.463+0000 7f4eac9e1640 1 -- 172.21.15.62:0/325005323 learned_addr learned my addr 172.21.15.62:0/325005323 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:37.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.463+0000 7f4eac9e1640 1 -- 172.21.15.62:0/325005323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ea814af30 msgr2=0x7f4ea8147fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:37.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.463+0000 7f4ead9e3640 1 --2- 172.21.15.62:0/325005323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ea814af30 0x7f4ea8147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:37.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.463+0000 7f4eac9e1640 1 --2- 172.21.15.62:0/325005323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ea814af30 0x7f4ea8147fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.463+0000 7f4eac9e1640 1 -- 172.21.15.62:0/325005323 >> v1:172.21.15.161:6789/0 conn(0x7f4ea8141990 legacy=0x7f4ea8071690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:37.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.463+0000 7f4eac9e1640 1 -- 172.21.15.62:0/325005323 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea814b980 con 0x7f4ea80b9e50 2023-05-15T16:40:37.470 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.463+0000 7f4ead9e3640 1 --2- 172.21.15.62:0/325005323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ea814af30 0x7f4ea8147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:37.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4eac9e1640 1 --2- 172.21.15.62:0/325005323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea80b9e50 0x7f4ea8147a90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009870 tx=0x7f4e9c01ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6200f76ed321b96 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:37.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4ea7fff640 1 -- 172.21.15.62:0/325005323 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0a8a30 con 0x7f4ea80b9e50 2023-05-15T16:40:37.471 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4ea7fff640 1 -- 172.21.15.62:0/325005323 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c0a8b90 con 0x7f4ea80b9e50 2023-05-15T16:40:37.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4ea7fff640 1 -- 172.21.15.62:0/325005323 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0b0440 con 0x7f4ea80b9e50 2023-05-15T16:40:37.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4eaf446640 1 -- 172.21.15.62:0/325005323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea80b9e50 msgr2=0x7f4ea8147a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:37.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4eaf446640 1 --2- 172.21.15.62:0/325005323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea80b9e50 0x7f4ea8147a90 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c009870 tx=0x7f4e9c01ed30 comp rx=0 tx=0).stop 2023-05-15T16:40:37.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4eaf446640 1 -- 172.21.15.62:0/325005323 shutdown_connections 2023-05-15T16:40:37.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4eaf446640 1 --2- 172.21.15.62:0/325005323 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ea814af30 0x7f4ea8147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4eaf446640 1 --2- 172.21.15.62:0/325005323 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea80b9e50 0x7f4ea8147a90 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4eaf446640 1 -- 172.21.15.62:0/325005323 >> 172.21.15.62:0/325005323 conn(0x7f4ea806a8c0 msgr2=0x7f4ea806acc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:37.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4eaf446640 1 -- 172.21.15.62:0/325005323 shutdown_connections 2023-05-15T16:40:37.473 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4eaf446640 1 -- 172.21.15.62:0/325005323 wait complete. 2023-05-15T16:40:37.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4eaf446640 1 Processor -- start 2023-05-15T16:40:37.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4eaf446640 1 -- start start 2023-05-15T16:40:37.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4eaf446640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ea8141990 0x7f4ea814a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:37.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4eaf446640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea814af30 0x7f4ea81de810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:37.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4eaf446640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ea81ded50 0x7f4ea8140d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:37.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4eaf446640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea814aa10 con 0x7f4ea814af30 2023-05-15T16:40:37.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4eaf446640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea81df1d0 con 0x7f4ea81ded50 2023-05-15T16:40:37.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4eaf446640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80a9070 con 0x7f4ea8141990 2023-05-15T16:40:37.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4eac9e1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea814af30 0x7f4ea81de810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:37.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4eac9e1640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea814af30 0x7f4ea81de810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60400/0 (socket says 172.21.15.62:60400) 2023-05-15T16:40:37.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.467+0000 7f4eac9e1640 1 -- 172.21.15.62:0/2176314191 learned_addr learned my addr 172.21.15.62:0/2176314191 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:37.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.471+0000 7f4ead9e3640 1 --2- 172.21.15.62:0/2176314191 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ea81ded50 0x7f4ea8140d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:37.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.471+0000 7f4ead1e2640 1 --2- 172.21.15.62:0/2176314191 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ea8141990 0x7f4ea814a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:37.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.471+0000 7f4eac9e1640 1 -- 172.21.15.62:0/2176314191 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ea8141990 msgr2=0x7f4ea814a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:37.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.471+0000 7f4eac9e1640 1 --2- 172.21.15.62:0/2176314191 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ea8141990 0x7f4ea814a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.471+0000 7f4eac9e1640 1 -- 172.21.15.62:0/2176314191 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ea81ded50 msgr2=0x7f4ea8140d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:37.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.471+0000 7f4eac9e1640 1 --2- 172.21.15.62:0/2176314191 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ea81ded50 0x7f4ea8140d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.471+0000 7f4eac9e1640 1 -- 172.21.15.62:0/2176314191 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e9c0094d0 con 0x7f4ea814af30 2023-05-15T16:40:37.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.471+0000 7f4ead1e2640 1 --2- 172.21.15.62:0/2176314191 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ea8141990 0x7f4ea814a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:37.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.471+0000 7f4eac9e1640 1 --2- 172.21.15.62:0/2176314191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea814af30 0x7f4ea81de810 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0b3040 tx=0x7f4e9c01bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:37.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.471+0000 7f4ea5ffb640 1 -- 172.21.15.62:0/2176314191 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0be070 con 0x7f4ea814af30 2023-05-15T16:40:37.477 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.471+0000 7f4ea5ffb640 1 -- 172.21.15.62:0/2176314191 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e9c0ba400 con 0x7f4ea814af30 2023-05-15T16:40:37.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.471+0000 7f4eaf446640 1 -- 172.21.15.62:0/2176314191 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea80b79e0 con 0x7f4ea814af30 2023-05-15T16:40:37.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.471+0000 7f4ea5ffb640 1 -- 172.21.15.62:0/2176314191 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e9c0ba7b0 con 0x7f4ea814af30 2023-05-15T16:40:37.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.471+0000 7f4eaf446640 1 -- 172.21.15.62:0/2176314191 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea814bc60 con 0x7f4ea814af30 2023-05-15T16:40:37.478 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.471+0000 7f4eaf446640 1 -- 172.21.15.62:0/2176314191 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ea80b7b70 con 0x7f4ea814af30 2023-05-15T16:40:37.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.471+0000 7f4ea5ffb640 1 -- 172.21.15.62:0/2176314191 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f4e9c0ba910 con 0x7f4ea814af30 2023-05-15T16:40:37.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.471+0000 7f4ea5ffb640 1 --2- 172.21.15.62:0/2176314191 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4e94065380 0x7f4e94067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:37.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.471+0000 7f4ea5ffb640 1 -- 172.21.15.62:0/2176314191 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f4e9c1210b0 con 0x7f4ea814af30 2023-05-15T16:40:37.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.471+0000 7f4ead1e2640 1 --2- 172.21.15.62:0/2176314191 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4e94065380 0x7f4e94067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:37.479 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.471+0000 7f4ead1e2640 1 --2- 172.21.15.62:0/2176314191 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4e94065380 0x7f4e94067830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4e98007fd0 tx=0x7f4e98009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:37.480 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.475+0000 7f4ea5ffb640 1 -- 172.21.15.62:0/2176314191 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f4e9c0ef1f0 con 0x7f4ea814af30 2023-05-15T16:40:37.681 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.679+0000 7f4eaf446640 1 -- 172.21.15.62:0/2176314191 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f4ea80b4840 con 0x7f4ea814af30 2023-05-15T16:40:37.690 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.687+0000 7f4ea5ffb640 1 -- 172.21.15.62:0/2176314191 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4e9c0f2810 con 0x7f4ea814af30 2023-05-15T16:40:37.691 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.687+0000 7f4eaf446640 1 -- 172.21.15.62:0/2176314191 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4e94065380 msgr2=0x7f4e94067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:37.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.687+0000 7f4eaf446640 1 --2- 172.21.15.62:0/2176314191 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4e94065380 0x7f4e94067830 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f4e98007fd0 tx=0x7f4e98009040 comp rx=0 tx=0).stop 2023-05-15T16:40:37.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.687+0000 7f4eaf446640 1 -- 172.21.15.62:0/2176314191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea814af30 msgr2=0x7f4ea81de810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:37.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.687+0000 7f4eaf446640 1 --2- 172.21.15.62:0/2176314191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea814af30 0x7f4ea81de810 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c0b3040 tx=0x7f4e9c01bad0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.687+0000 7f4eaf446640 1 -- 172.21.15.62:0/2176314191 shutdown_connections 2023-05-15T16:40:37.692 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.687+0000 7f4eaf446640 1 --2- 172.21.15.62:0/2176314191 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4ea81ded50 0x7f4ea8140d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.687+0000 7f4eaf446640 1 --2- 172.21.15.62:0/2176314191 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4e94065380 0x7f4e94067830 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.687+0000 7f4eaf446640 1 --2- 172.21.15.62:0/2176314191 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4ea814af30 0x7f4ea81de810 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.687+0000 7f4eaf446640 1 --2- 172.21.15.62:0/2176314191 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4ea8141990 0x7f4ea814a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.693 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.687+0000 7f4eaf446640 1 -- 172.21.15.62:0/2176314191 >> 172.21.15.62:0/2176314191 conn(0x7f4ea806a8c0 msgr2=0x7f4ea80b5840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:37.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.687+0000 7f4eaf446640 1 -- 172.21.15.62:0/2176314191 shutdown_connections 2023-05-15T16:40:37.694 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.687+0000 7f4eaf446640 1 -- 172.21.15.62:0/2176314191 wait complete. 2023-05-15T16:40:37.707 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-05-15T16:40:37.822 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.819+0000 7f8f9ab1d640 1 Processor -- start 2023-05-15T16:40:37.823 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.819+0000 7f8f9ab1d640 1 -- start start 2023-05-15T16:40:37.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.819+0000 7f8f9ab1d640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f8f940b9060 0x7f8f940ba030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:37.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.819+0000 7f8f9ab1d640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f94148950 con 0x7f8f941450d0 2023-05-15T16:40:37.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.819+0000 7f8f9ab1d640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f94070cd0 con 0x7f8f94147af0 2023-05-15T16:40:37.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.819+0000 7f8f9ab1d640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f940b5570 con 0x7f8f940b9060 2023-05-15T16:40:37.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.819+0000 7f8f988b9640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f8f941450d0 0x7f8f940705c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58024/0 (socket says 172.21.15.62:58024) 2023-05-15T16:40:37.824 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.819+0000 7f8f988b9640 1 -- 172.21.15.62:0/3490995910 learned_addr learned my addr 172.21.15.62:0/3490995910 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:37.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.819+0000 7f8f990ba640 1 --2- 172.21.15.62:0/3490995910 >> v2:172.21.15.62:3300/0 conn(0x7f8f940b9060 0x7f8f940ba030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:37.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.819+0000 7f8f937fe640 1 -- 172.21.15.62:0/3490995910 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 329757879 0 0) 0x7f8f94148950 con 0x7f8f941450d0 2023-05-15T16:40:37.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.819+0000 7f8f937fe640 1 -- 172.21.15.62:0/3490995910 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8f7c003530 con 0x7f8f941450d0 2023-05-15T16:40:37.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.819+0000 7f8f990ba640 1 -- 172.21.15.62:0/3490995910 >> v1:172.21.15.161:6789/0 conn(0x7f8f94147af0 legacy=0x7f8f940b8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:37.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.819+0000 7f8f990ba640 1 -- 172.21.15.62:0/3490995910 >> v1:172.21.15.62:6789/0 conn(0x7f8f941450d0 legacy=0x7f8f940705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:37.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.819+0000 7f8f990ba640 1 -- 172.21.15.62:0/3490995910 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f94148020 con 0x7f8f940b9060 2023-05-15T16:40:37.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f990ba640 1 --2- 172.21.15.62:0/3490995910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f940b9060 0x7f8f940ba030 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009d90 tx=0x7f8f8c01c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbf9ed79dac774fc server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:37.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f937fe640 1 -- 172.21.15.62:0/3490995910 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c0a5950 con 0x7f8f940b9060 2023-05-15T16:40:37.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f937fe640 1 -- 172.21.15.62:0/3490995910 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c0a5ab0 con 0x7f8f940b9060 2023-05-15T16:40:37.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f937fe640 1 -- 172.21.15.62:0/3490995910 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c0a5e40 con 0x7f8f940b9060 2023-05-15T16:40:37.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f9ab1d640 1 -- 172.21.15.62:0/3490995910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f940b9060 msgr2=0x7f8f940ba030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:37.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f9ab1d640 1 --2- 172.21.15.62:0/3490995910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f940b9060 0x7f8f940ba030 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009d90 tx=0x7f8f8c01c890 comp rx=0 tx=0).stop 2023-05-15T16:40:37.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f9ab1d640 1 -- 172.21.15.62:0/3490995910 shutdown_connections 2023-05-15T16:40:37.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f9ab1d640 1 --2- 172.21.15.62:0/3490995910 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f940b9060 0x7f8f940ba030 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f9ab1d640 1 -- 172.21.15.62:0/3490995910 >> 172.21.15.62:0/3490995910 conn(0x7f8f940bde20 msgr2=0x7f8f940be220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:37.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f9ab1d640 1 -- 172.21.15.62:0/3490995910 shutdown_connections 2023-05-15T16:40:37.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f9ab1d640 1 -- 172.21.15.62:0/3490995910 wait complete. 2023-05-15T16:40:37.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f9ab1d640 1 Processor -- start 2023-05-15T16:40:37.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f9ab1d640 1 -- start start 2023-05-15T16:40:37.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f9ab1d640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f940b9060 0x7f8f941517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:37.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f9ab1d640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f941450d0 0x7f8f9406ada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:37.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f9ab1d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f94147af0 0x7f8f9406b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:37.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f9ab1d640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f94151ce0 con 0x7f8f94147af0 2023-05-15T16:40:37.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f9ab1d640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f940b0a00 con 0x7f8f941450d0 2023-05-15T16:40:37.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f9ab1d640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f941463f0 con 0x7f8f940b9060 2023-05-15T16:40:37.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f990ba640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f94147af0 0x7f8f9406b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:37.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f990ba640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f94147af0 0x7f8f9406b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60422/0 (socket says 172.21.15.62:60422) 2023-05-15T16:40:37.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.823+0000 7f8f990ba640 1 -- 172.21.15.62:0/97570230 learned_addr learned my addr 172.21.15.62:0/97570230 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:37.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.827+0000 7f8f988b9640 1 --2- 172.21.15.62:0/97570230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f940b9060 0x7f8f941517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:37.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.827+0000 7f8f93fff640 1 --2- 172.21.15.62:0/97570230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f941450d0 0x7f8f9406ada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:37.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.827+0000 7f8f990ba640 1 -- 172.21.15.62:0/97570230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f940b9060 msgr2=0x7f8f941517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:37.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.827+0000 7f8f990ba640 1 --2- 172.21.15.62:0/97570230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f940b9060 0x7f8f941517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.827+0000 7f8f990ba640 1 -- 172.21.15.62:0/97570230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f941450d0 msgr2=0x7f8f9406ada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:37.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.827+0000 7f8f990ba640 1 --2- 172.21.15.62:0/97570230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f941450d0 0x7f8f9406ada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:37.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.827+0000 7f8f990ba640 1 -- 172.21.15.62:0/97570230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f8c009a70 con 0x7f8f94147af0 2023-05-15T16:40:37.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.827+0000 7f8f990ba640 1 --2- 172.21.15.62:0/97570230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f94147af0 0x7f8f9406b2e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009d90 tx=0x7f8f8c019630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:37.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.827+0000 7f8f917fa640 1 -- 172.21.15.62:0/97570230 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c0add90 con 0x7f8f94147af0 2023-05-15T16:40:37.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.827+0000 7f8f917fa640 1 -- 172.21.15.62:0/97570230 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f8c009450 con 0x7f8f94147af0 2023-05-15T16:40:37.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.827+0000 7f8f917fa640 1 -- 172.21.15.62:0/97570230 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f8c0b9690 con 0x7f8f94147af0 2023-05-15T16:40:37.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.827+0000 7f8f9ab1d640 1 -- 172.21.15.62:0/97570230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f941454a0 con 0x7f8f94147af0 2023-05-15T16:40:37.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.827+0000 7f8f9ab1d640 1 -- 172.21.15.62:0/97570230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f9406ce50 con 0x7f8f94147af0 2023-05-15T16:40:37.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.827+0000 7f8f9ab1d640 1 -- 172.21.15.62:0/97570230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f94155ba0 con 0x7f8f94147af0 2023-05-15T16:40:37.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.827+0000 7f8f917fa640 1 -- 172.21.15.62:0/97570230 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f8f8c0b97f0 con 0x7f8f94147af0 2023-05-15T16:40:37.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.827+0000 7f8f917fa640 1 --2- 172.21.15.62:0/97570230 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8f80065380 0x7f8f80067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:37.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.827+0000 7f8f917fa640 1 -- 172.21.15.62:0/97570230 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f8f8c11dc60 con 0x7f8f94147af0 2023-05-15T16:40:37.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.827+0000 7f8f988b9640 1 --2- 172.21.15.62:0/97570230 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8f80065380 0x7f8f80067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:37.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.827+0000 7f8f988b9640 1 --2- 172.21.15.62:0/97570230 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8f80065380 0x7f8f80067830 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8f840011f0 tx=0x7f8f84009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:37.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:37.831+0000 7f8f917fa640 1 -- 172.21.15.62:0/97570230 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f8f8c0ebcc0 con 0x7f8f94147af0 2023-05-15T16:40:38.042 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.039+0000 7f8f9ab1d640 1 -- 172.21.15.62:0/97570230 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f8f9406aa90 con 0x7f8f94147af0 2023-05-15T16:40:38.047 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.043+0000 7f8f917fa640 1 -- 172.21.15.62:0/97570230 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8f8c0ef2e0 con 0x7f8f94147af0 2023-05-15T16:40:38.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.047+0000 7f8f9ab1d640 1 -- 172.21.15.62:0/97570230 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8f80065380 msgr2=0x7f8f80067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:38.049 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.047+0000 7f8f9ab1d640 1 --2- 172.21.15.62:0/97570230 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8f80065380 0x7f8f80067830 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8f840011f0 tx=0x7f8f84009040 comp rx=0 tx=0).stop 2023-05-15T16:40:38.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.047+0000 7f8f9ab1d640 1 -- 172.21.15.62:0/97570230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f94147af0 msgr2=0x7f8f9406b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:38.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.047+0000 7f8f9ab1d640 1 --2- 172.21.15.62:0/97570230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f94147af0 0x7f8f9406b2e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f8f8c009d90 tx=0x7f8f8c019630 comp rx=0 tx=0).stop 2023-05-15T16:40:38.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.047+0000 7f8f9ab1d640 1 -- 172.21.15.62:0/97570230 shutdown_connections 2023-05-15T16:40:38.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.047+0000 7f8f9ab1d640 1 --2- 172.21.15.62:0/97570230 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f8f80065380 0x7f8f80067830 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.047+0000 7f8f9ab1d640 1 --2- 172.21.15.62:0/97570230 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f8f94147af0 0x7f8f9406b2e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.047+0000 7f8f9ab1d640 1 --2- 172.21.15.62:0/97570230 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f8f941450d0 0x7f8f9406ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.050 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.047+0000 7f8f9ab1d640 1 --2- 172.21.15.62:0/97570230 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f8f940b9060 0x7f8f941517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.047+0000 7f8f9ab1d640 1 -- 172.21.15.62:0/97570230 >> 172.21.15.62:0/97570230 conn(0x7f8f940bde20 msgr2=0x7f8f941439d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:38.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.047+0000 7f8f9ab1d640 1 -- 172.21.15.62:0/97570230 shutdown_connections 2023-05-15T16:40:38.051 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.047+0000 7f8f9ab1d640 1 -- 172.21.15.62:0/97570230 wait complete. 2023-05-15T16:40:38.065 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-05-15T16:40:38.174 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.171+0000 7fc42d503640 1 Processor -- start 2023-05-15T16:40:38.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.171+0000 7fc42d503640 1 -- start start 2023-05-15T16:40:38.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.171+0000 7fc42d503640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4280b5330 0x7fc4280b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:38.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.171+0000 7fc42d503640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc428071a90 0x7fc4280b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:38.175 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.171+0000 7fc42d503640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4280716b0 con 0x7fc428144e90 2023-05-15T16:40:38.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.171+0000 7fc42d503640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4280b2280 con 0x7fc428071a90 2023-05-15T16:40:38.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.171+0000 7fc42d503640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4280afa90 con 0x7fc4280b5330 2023-05-15T16:40:38.176 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.171+0000 7fc4267fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc428071a90 0x7fc4280b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:38.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.171+0000 7fc426ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4280b5330 0x7fc4280b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:38.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.171+0000 7fc4267fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc428071a90 0x7fc4280b16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.62:51420/0 (socket says 172.21.15.62:51420) 2023-05-15T16:40:38.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.171+0000 7fc4277fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fc428144e90 0x7fc4280b8540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.62:60474/0 (socket says 172.21.15.62:60474) 2023-05-15T16:40:38.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.171+0000 7fc4267fc640 1 -- 172.21.15.62:0/4063648270 learned_addr learned my addr 172.21.15.62:0/4063648270 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:38.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.171+0000 7fc426ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4280b5330 0x7fc4280b5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.62:37834/0 (socket says 172.21.15.62:37834) 2023-05-15T16:40:38.177 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.171+0000 7fc426ffd640 1 -- 172.21.15.62:0/4063648270 >> v2:172.21.15.161:3300/0 conn(0x7fc428071a90 msgr2=0x7fc4280b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:38.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.171+0000 7fc426ffd640 1 --2- 172.21.15.62:0/4063648270 >> v2:172.21.15.161:3300/0 conn(0x7fc428071a90 0x7fc4280b16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.171+0000 7fc426ffd640 1 -- 172.21.15.62:0/4063648270 >> v1:172.21.15.161:6789/0 conn(0x7fc428144e90 legacy=0x7fc4280b8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:38.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.171+0000 7fc426ffd640 1 -- 172.21.15.62:0/4063648270 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4280b0f00 con 0x7fc4280b5330 2023-05-15T16:40:38.178 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.171+0000 7fc4267fc640 1 --2- 172.21.15.62:0/4063648270 >> v2:172.21.15.161:3300/0 conn(0x7fc428071a90 0x7fc4280b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-15T16:40:38.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.175+0000 7fc426ffd640 1 --2- 172.21.15.62:0/4063648270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4280b5330 0x7fc4280b5700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc418009d90 tx=0x7fc41801c920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a498f7955aeb8618 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:38.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.175+0000 7fc425ffb640 1 -- 172.21.15.62:0/4063648270 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4180a59e0 con 0x7fc4280b5330 2023-05-15T16:40:38.179 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.175+0000 7fc425ffb640 1 -- 172.21.15.62:0/4063648270 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4180a5b40 con 0x7fc4280b5330 2023-05-15T16:40:38.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.175+0000 7fc425ffb640 1 -- 172.21.15.62:0/4063648270 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4180ad440 con 0x7fc4280b5330 2023-05-15T16:40:38.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.175+0000 7fc42d503640 1 -- 172.21.15.62:0/4063648270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4280b5330 msgr2=0x7fc4280b5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:38.180 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.175+0000 7fc42d503640 1 --2- 172.21.15.62:0/4063648270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4280b5330 0x7fc4280b5700 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fc418009d90 tx=0x7fc41801c920 comp rx=0 tx=0).stop 2023-05-15T16:40:38.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.175+0000 7fc42d503640 1 -- 172.21.15.62:0/4063648270 shutdown_connections 2023-05-15T16:40:38.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.175+0000 7fc42d503640 1 --2- 172.21.15.62:0/4063648270 >> v2:172.21.15.161:3300/0 conn(0x7fc428071a90 0x7fc4280b16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.175+0000 7fc42d503640 1 --2- 172.21.15.62:0/4063648270 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc4280b5330 0x7fc4280b5700 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.175+0000 7fc42d503640 1 -- 172.21.15.62:0/4063648270 >> 172.21.15.62:0/4063648270 conn(0x7fc4280653f0 msgr2=0x7fc4280697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:38.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.175+0000 7fc42d503640 1 -- 172.21.15.62:0/4063648270 shutdown_connections 2023-05-15T16:40:38.181 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.175+0000 7fc42d503640 1 -- 172.21.15.62:0/4063648270 wait complete. 2023-05-15T16:40:38.183 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc42d503640 1 Processor -- start 2023-05-15T16:40:38.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc42d503640 1 -- start start 2023-05-15T16:40:38.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc42d503640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc428071a90 0x7fc428143a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:38.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc42d503640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4280b5330 0x7fc42813e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:38.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc42d503640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc428144e90 0x7fc428145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:38.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc42d503640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc428143f70 con 0x7fc4280b5330 2023-05-15T16:40:38.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc42d503640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc428142d00 con 0x7fc428071a90 2023-05-15T16:40:38.184 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc42d503640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc42813e970 con 0x7fc428144e90 2023-05-15T16:40:38.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc4267fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4280b5330 0x7fc42813e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:38.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc4267fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4280b5330 0x7fc42813e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60434/0 (socket says 172.21.15.62:60434) 2023-05-15T16:40:38.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc4267fc640 1 -- 172.21.15.62:0/1636814440 learned_addr learned my addr 172.21.15.62:0/1636814440 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:38.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc426ffd640 1 --2- 172.21.15.62:0/1636814440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc428071a90 0x7fc428143a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:38.185 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc4277fe640 1 --2- 172.21.15.62:0/1636814440 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc428144e90 0x7fc428145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc4267fc640 1 -- 172.21.15.62:0/1636814440 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc428144e90 msgr2=0x7fc428145c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc4267fc640 1 --2- 172.21.15.62:0/1636814440 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc428144e90 0x7fc428145c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc4267fc640 1 -- 172.21.15.62:0/1636814440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc428071a90 msgr2=0x7fc428143a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc4267fc640 1 --2- 172.21.15.62:0/1636814440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc428071a90 0x7fc428143a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc4267fc640 1 -- 172.21.15.62:0/1636814440 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4100094d0 con 0x7fc4280b5330 2023-05-15T16:40:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc4267fc640 1 --2- 172.21.15.62:0/1636814440 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4280b5330 0x7fc42813e430 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc41000e9d0 tx=0x7fc41000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:38.186 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc41f7fe640 1 -- 172.21.15.62:0/1636814440 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc41000ca60 con 0x7fc4280b5330 2023-05-15T16:40:38.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc41f7fe640 1 -- 172.21.15.62:0/1636814440 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc41000cbc0 con 0x7fc4280b5330 2023-05-15T16:40:38.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc42d503640 1 -- 172.21.15.62:0/1636814440 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc418009a70 con 0x7fc4280b5330 2023-05-15T16:40:38.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc41f7fe640 1 -- 172.21.15.62:0/1636814440 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc410013470 con 0x7fc4280b5330 2023-05-15T16:40:38.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc42d503640 1 -- 172.21.15.62:0/1636814440 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4280b1c00 con 0x7fc4280b5330 2023-05-15T16:40:38.187 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc42d503640 1 -- 172.21.15.62:0/1636814440 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4281456a0 con 0x7fc4280b5330 2023-05-15T16:40:38.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc41f7fe640 1 -- 172.21.15.62:0/1636814440 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fc4100135d0 con 0x7fc4280b5330 2023-05-15T16:40:38.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc41f7fe640 1 --2- 172.21.15.62:0/1636814440 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc408065380 0x7fc408067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:38.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc41f7fe640 1 -- 172.21.15.62:0/1636814440 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc4100827c0 con 0x7fc4280b5330 2023-05-15T16:40:38.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.179+0000 7fc426ffd640 1 --2- 172.21.15.62:0/1636814440 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc408065380 0x7fc408067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:38.188 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.183+0000 7fc426ffd640 1 --2- 172.21.15.62:0/1636814440 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc408065380 0x7fc408067830 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc4180af000 tx=0x7fc4180a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:38.189 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.183+0000 7fc41f7fe640 1 -- 172.21.15.62:0/1636814440 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fc4100507a0 con 0x7fc4280b5330 2023-05-15T16:40:38.392 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.387+0000 7fc42d503640 1 -- 172.21.15.62:0/1636814440 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fc4280b1ec0 con 0x7fc4280b5330 2023-05-15T16:40:38.400 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.395+0000 7fc41f7fe640 1 -- 172.21.15.62:0/1636814440 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc410053dc0 con 0x7fc4280b5330 2023-05-15T16:40:38.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.399+0000 7fc42d503640 1 -- 172.21.15.62:0/1636814440 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc408065380 msgr2=0x7fc408067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:38.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.399+0000 7fc42d503640 1 --2- 172.21.15.62:0/1636814440 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc408065380 0x7fc408067830 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc4180af000 tx=0x7fc4180a7070 comp rx=0 tx=0).stop 2023-05-15T16:40:38.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.399+0000 7fc42d503640 1 -- 172.21.15.62:0/1636814440 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4280b5330 msgr2=0x7fc42813e430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:38.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.399+0000 7fc42d503640 1 --2- 172.21.15.62:0/1636814440 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4280b5330 0x7fc42813e430 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fc41000e9d0 tx=0x7fc41000ee90 comp rx=0 tx=0).stop 2023-05-15T16:40:38.402 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.399+0000 7fc42d503640 1 -- 172.21.15.62:0/1636814440 shutdown_connections 2023-05-15T16:40:38.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.399+0000 7fc42d503640 1 --2- 172.21.15.62:0/1636814440 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc428144e90 0x7fc428145c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.399+0000 7fc42d503640 1 --2- 172.21.15.62:0/1636814440 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc408065380 0x7fc408067830 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.399+0000 7fc42d503640 1 --2- 172.21.15.62:0/1636814440 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc4280b5330 0x7fc42813e430 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.399+0000 7fc42d503640 1 --2- 172.21.15.62:0/1636814440 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc428071a90 0x7fc428143a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.399+0000 7fc42d503640 1 -- 172.21.15.62:0/1636814440 >> 172.21.15.62:0/1636814440 conn(0x7fc4280653f0 msgr2=0x7fc4280b7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:38.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.399+0000 7fc42d503640 1 -- 172.21.15.62:0/1636814440 shutdown_connections 2023-05-15T16:40:38.403 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.399+0000 7fc42d503640 1 -- 172.21.15.62:0/1636814440 wait complete. 2023-05-15T16:40:38.417 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-05-15T16:40:38.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.523+0000 7f4762b02640 1 Processor -- start 2023-05-15T16:40:38.526 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.523+0000 7f4762b02640 1 -- start start 2023-05-15T16:40:38.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.523+0000 7f4762b02640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f475c148820 0x7f475c0b8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:38.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.523+0000 7f4762b02640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f475c071140 0x7f475c152370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:38.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.523+0000 7f4762b02640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f475c070410 con 0x7f475c0b83c0 2023-05-15T16:40:38.527 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.523+0000 7f4762b02640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f475c071ce0 con 0x7f475c071140 2023-05-15T16:40:38.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.523+0000 7f4762b02640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475c0697b0 con 0x7f475c148820 2023-05-15T16:40:38.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.523+0000 7f476109f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f475c071140 0x7f475c152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:38.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.523+0000 7f476089e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f475c148820 0x7f475c0b8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:38.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.523+0000 7f475bfff640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f475c0b83c0 0x7f475c070a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.62:60488/0 (socket says 172.21.15.62:60488) 2023-05-15T16:40:38.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.523+0000 7f476109f640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f475c071140 0x7f475c152370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.62:51434/0 (socket says 172.21.15.62:51434) 2023-05-15T16:40:38.528 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.523+0000 7f476109f640 1 -- 172.21.15.62:0/1475644058 learned_addr learned my addr 172.21.15.62:0/1475644058 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:38.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.523+0000 7f476109f640 1 -- 172.21.15.62:0/1475644058 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f475c148820 msgr2=0x7f475c0b8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:38.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.523+0000 7f476109f640 1 --2- 172.21.15.62:0/1475644058 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f475c148820 0x7f475c0b8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.529 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.523+0000 7f476109f640 1 -- 172.21.15.62:0/1475644058 >> v1:172.21.15.161:6789/0 conn(0x7f475c0b83c0 legacy=0x7f475c070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:38.530 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.523+0000 7f476109f640 1 -- 172.21.15.62:0/1475644058 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f475c069a90 con 0x7f475c071140 2023-05-15T16:40:38.531 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f476109f640 1 --2- 172.21.15.62:0/1475644058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f475c071140 0x7f475c152370 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4754009e50 tx=0x7f475401f1f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c58270e2577ba269 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:38.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f475b7fe640 1 -- 172.21.15.62:0/1475644058 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47540af400 con 0x7f475c071140 2023-05-15T16:40:38.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f475b7fe640 1 -- 172.21.15.62:0/1475644058 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47540ab050 con 0x7f475c071140 2023-05-15T16:40:38.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f475b7fe640 1 -- 172.21.15.62:0/1475644058 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47540af780 con 0x7f475c071140 2023-05-15T16:40:38.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f4762b02640 1 -- 172.21.15.62:0/1475644058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f475c071140 msgr2=0x7f475c152370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:38.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f4762b02640 1 --2- 172.21.15.62:0/1475644058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f475c071140 0x7f475c152370 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4754009e50 tx=0x7f475401f1f0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f4762b02640 1 -- 172.21.15.62:0/1475644058 shutdown_connections 2023-05-15T16:40:38.532 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f4762b02640 1 --2- 172.21.15.62:0/1475644058 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f475c071140 0x7f475c152370 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f4762b02640 1 --2- 172.21.15.62:0/1475644058 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f475c148820 0x7f475c0b8c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f4762b02640 1 -- 172.21.15.62:0/1475644058 >> 172.21.15.62:0/1475644058 conn(0x7f475c06cf80 msgr2=0x7f475c06d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:38.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f4762b02640 1 -- 172.21.15.62:0/1475644058 shutdown_connections 2023-05-15T16:40:38.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f4762b02640 1 -- 172.21.15.62:0/1475644058 wait complete. 2023-05-15T16:40:38.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f4762b02640 1 Processor -- start 2023-05-15T16:40:38.533 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f4762b02640 1 -- start start 2023-05-15T16:40:38.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f4762b02640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f475c071140 0x7f475c0b1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:38.535 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f4762b02640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f475c0b83c0 0x7f475c1e28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:38.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f4762b02640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f475c148820 0x7f475c0b6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:38.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f4762b02640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c0b38b0 con 0x7f475c0b83c0 2023-05-15T16:40:38.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f4762b02640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c0b6940 con 0x7f475c148820 2023-05-15T16:40:38.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f4762b02640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f475c1d31c0 con 0x7f475c071140 2023-05-15T16:40:38.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f475bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f475c0b83c0 0x7f475c1e28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:38.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f475bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f475c0b83c0 0x7f475c1e28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60438/0 (socket says 172.21.15.62:60438) 2023-05-15T16:40:38.536 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f475bfff640 1 -- 172.21.15.62:0/1258513683 learned_addr learned my addr 172.21.15.62:0/1258513683 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:38.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f476109f640 1 --2- 172.21.15.62:0/1258513683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f475c148820 0x7f475c0b6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:38.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f476089e640 1 --2- 172.21.15.62:0/1258513683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f475c071140 0x7f475c0b1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:38.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f475bfff640 1 -- 172.21.15.62:0/1258513683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f475c071140 msgr2=0x7f475c0b1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:38.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f475bfff640 1 --2- 172.21.15.62:0/1258513683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f475c071140 0x7f475c0b1bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.537 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f475bfff640 1 -- 172.21.15.62:0/1258513683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f475c148820 msgr2=0x7f475c0b6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:38.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f475bfff640 1 --2- 172.21.15.62:0/1258513683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f475c148820 0x7f475c0b6400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f475bfff640 1 -- 172.21.15.62:0/1258513683 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4754009b30 con 0x7f475c0b83c0 2023-05-15T16:40:38.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f476089e640 1 --2- 172.21.15.62:0/1258513683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f475c071140 0x7f475c0b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-15T16:40:38.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.527+0000 7f475bfff640 1 --2- 172.21.15.62:0/1258513683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f475c0b83c0 0x7f475c1e28b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f475000c450 tx=0x7f475000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:38.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.531+0000 7f47597fa640 1 -- 172.21.15.62:0/1258513683 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4750007480 con 0x7f475c0b83c0 2023-05-15T16:40:38.538 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.531+0000 7f4762b02640 1 -- 172.21.15.62:0/1258513683 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475c070050 con 0x7f475c0b83c0 2023-05-15T16:40:38.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.531+0000 7f47597fa640 1 -- 172.21.15.62:0/1258513683 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47500075e0 con 0x7f475c0b83c0 2023-05-15T16:40:38.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.531+0000 7f47597fa640 1 -- 172.21.15.62:0/1258513683 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4750004a30 con 0x7f475c0b83c0 2023-05-15T16:40:38.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.531+0000 7f4762b02640 1 -- 172.21.15.62:0/1258513683 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475c069d70 con 0x7f475c0b83c0 2023-05-15T16:40:38.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.531+0000 7f4762b02640 1 -- 172.21.15.62:0/1258513683 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475c0701e0 con 0x7f475c0b83c0 2023-05-15T16:40:38.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.531+0000 7f47597fa640 1 -- 172.21.15.62:0/1258513683 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f4750004b90 con 0x7f475c0b83c0 2023-05-15T16:40:38.539 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.531+0000 7f47597fa640 1 --2- 172.21.15.62:0/1258513683 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4748065380 0x7f4748067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:38.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.531+0000 7f47597fa640 1 -- 172.21.15.62:0/1258513683 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f47500814d0 con 0x7f475c0b83c0 2023-05-15T16:40:38.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.531+0000 7f476089e640 1 --2- 172.21.15.62:0/1258513683 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4748065380 0x7f4748067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:38.540 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.531+0000 7f476089e640 1 --2- 172.21.15.62:0/1258513683 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4748065380 0x7f4748067830 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f474c009bb0 tx=0x7f474c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:38.541 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.535+0000 7f47597fa640 1 -- 172.21.15.62:0/1258513683 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f475004f560 con 0x7f475c0b83c0 2023-05-15T16:40:38.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.735+0000 7f4762b02640 1 -- 172.21.15.62:0/1258513683 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f475c0b3610 con 0x7f475c0b83c0 2023-05-15T16:40:38.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.743+0000 7f47597fa640 1 -- 172.21.15.62:0/1258513683 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7f475c0b3610 con 0x7f475c0b83c0 2023-05-15T16:40:38.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.743+0000 7f4762b02640 1 -- 172.21.15.62:0/1258513683 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4748065380 msgr2=0x7f4748067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:38.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.743+0000 7f4762b02640 1 --2- 172.21.15.62:0/1258513683 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4748065380 0x7f4748067830 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f474c009bb0 tx=0x7f474c008040 comp rx=0 tx=0).stop 2023-05-15T16:40:38.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.743+0000 7f4762b02640 1 -- 172.21.15.62:0/1258513683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f475c0b83c0 msgr2=0x7f475c1e28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:38.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.743+0000 7f4762b02640 1 --2- 172.21.15.62:0/1258513683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f475c0b83c0 0x7f475c1e28b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f475000c450 tx=0x7f475000c910 comp rx=0 tx=0).stop 2023-05-15T16:40:38.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.743+0000 7f4762b02640 1 -- 172.21.15.62:0/1258513683 shutdown_connections 2023-05-15T16:40:38.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.743+0000 7f4762b02640 1 --2- 172.21.15.62:0/1258513683 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f475c148820 0x7f475c0b6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.743+0000 7f4762b02640 1 --2- 172.21.15.62:0/1258513683 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4748065380 0x7f4748067830 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.743+0000 7f4762b02640 1 --2- 172.21.15.62:0/1258513683 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f475c0b83c0 0x7f475c1e28b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.743+0000 7f4762b02640 1 --2- 172.21.15.62:0/1258513683 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f475c071140 0x7f475c0b1bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.743+0000 7f4762b02640 1 -- 172.21.15.62:0/1258513683 >> 172.21.15.62:0/1258513683 conn(0x7f475c06cf80 msgr2=0x7f475c1479e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:38.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.743+0000 7f4762b02640 1 -- 172.21.15.62:0/1258513683 shutdown_connections 2023-05-15T16:40:38.752 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.743+0000 7f4762b02640 1 -- 172.21.15.62:0/1258513683 wait complete. 2023-05-15T16:40:38.764 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-05-15T16:40:38.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b4393e640 1 Processor -- start 2023-05-15T16:40:38.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b4393e640 1 -- start start 2023-05-15T16:40:38.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b4393e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f6b3c14a8d0 0x7f6b3c1554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:38.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b4393e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b3c149d30 con 0x7f6b3c06b050 2023-05-15T16:40:38.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b4393e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b3c06b5e0 con 0x7f6b3c0bcd70 2023-05-15T16:40:38.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b4393e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b3c06b8c0 con 0x7f6b3c14a8d0 2023-05-15T16:40:38.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b40ed9640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f6b3c06b050 0x7f6b3c14a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58032/0 (socket says 172.21.15.62:58032) 2023-05-15T16:40:38.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b40ed9640 1 -- 172.21.15.62:0/1730062050 learned_addr learned my addr 172.21.15.62:0/1730062050 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:38.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b41edb640 1 --2- 172.21.15.62:0/1730062050 >> v2:172.21.15.161:3300/0 conn(0x7f6b3c14a8d0 0x7f6b3c1554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:38.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b33fff640 1 -- 172.21.15.62:0/1730062050 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 536185271 0 0) 0x7f6b3c149d30 con 0x7f6b3c06b050 2023-05-15T16:40:38.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b33fff640 1 -- 172.21.15.62:0/1730062050 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b28003530 con 0x7f6b3c06b050 2023-05-15T16:40:38.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b33fff640 1 -- 172.21.15.62:0/1730062050 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1821805112 0 0) 0x7f6b28003530 con 0x7f6b3c06b050 2023-05-15T16:40:38.878 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b33fff640 1 -- 172.21.15.62:0/1730062050 >> v2:172.21.15.161:3300/0 conn(0x7f6b3c14a8d0 msgr2=0x7f6b3c1554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:38.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b33fff640 1 --2- 172.21.15.62:0/1730062050 >> v2:172.21.15.161:3300/0 conn(0x7f6b3c14a8d0 0x7f6b3c1554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b33fff640 1 -- 172.21.15.62:0/1730062050 >> v1:172.21.15.161:6789/0 conn(0x7f6b3c0bcd70 legacy=0x7f6b3c0badc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:38.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b33fff640 1 -- 172.21.15.62:0/1730062050 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3c06bba0 con 0x7f6b3c06b050 2023-05-15T16:40:38.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b33fff640 1 -- 172.21.15.62:0/1730062050 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7f6b2c001680 con 0x7f6b3c06b050 2023-05-15T16:40:38.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b41edb640 1 --2- 172.21.15.62:0/1730062050 >> v2:172.21.15.161:3300/0 conn(0x7f6b3c14a8d0 0x7f6b3c1554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-15T16:40:38.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b33fff640 1 -- 172.21.15.62:0/1730062050 >> v1:172.21.15.62:6789/0 conn(0x7f6b3c06b050 legacy=0x7f6b3c14a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:38.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b33fff640 1 --2- 172.21.15.62:0/1730062050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b28003980 0x7f6b28003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:38.879 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b33fff640 1 --2- 172.21.15.62:0/1730062050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b280047d0 0x7f6b28004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:38.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b33fff640 1 --2- 172.21.15.62:0/1730062050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b28005180 0x7f6b2800b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:38.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b33fff640 1 -- 172.21.15.62:0/1730062050 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c06b8c0 con 0x7f6b28003980 2023-05-15T16:40:38.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b33fff640 1 -- 172.21.15.62:0/1730062050 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2800c110 con 0x7f6b280047d0 2023-05-15T16:40:38.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b33fff640 1 -- 172.21.15.62:0/1730062050 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b2800c2d0 con 0x7f6b28005180 2023-05-15T16:40:38.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b416da640 1 --2- 172.21.15.62:0/1730062050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b28003980 0x7f6b28003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:38.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b40ed9640 1 --2- 172.21.15.62:0/1730062050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b280047d0 0x7f6b28004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:38.880 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b416da640 1 -- 172.21.15.62:0/1730062050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b28005180 msgr2=0x7f6b2800b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:38.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b416da640 1 --2- 172.21.15.62:0/1730062050 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b28005180 0x7f6b2800b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b416da640 1 -- 172.21.15.62:0/1730062050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b280047d0 msgr2=0x7f6b28004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:38.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b416da640 1 --2- 172.21.15.62:0/1730062050 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b280047d0 0x7f6b28004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b41edb640 1 -- 172.21.15.62:0/1730062050 reap_dead start 2023-05-15T16:40:38.881 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.871+0000 7f6b416da640 1 -- 172.21.15.62:0/1730062050 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b28003530 con 0x7f6b28003980 2023-05-15T16:40:38.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b416da640 1 --2- 172.21.15.62:0/1730062050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b28003980 0x7f6b28003d90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6b38001750 tx=0x7f6b3801c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4419531ea5120aa server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:38.884 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b33fff640 1 -- 172.21.15.62:0/1730062050 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b380052d0 con 0x7f6b28003980 2023-05-15T16:40:38.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b33fff640 1 -- 172.21.15.62:0/1730062050 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b380a7050 con 0x7f6b28003980 2023-05-15T16:40:38.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b33fff640 1 -- 172.21.15.62:0/1730062050 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b38003600 con 0x7f6b28003980 2023-05-15T16:40:38.886 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b4393e640 1 -- 172.21.15.62:0/1730062050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b28003980 msgr2=0x7f6b28003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:38.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b4393e640 1 --2- 172.21.15.62:0/1730062050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b28003980 0x7f6b28003d90 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f6b38001750 tx=0x7f6b3801c380 comp rx=0 tx=0).stop 2023-05-15T16:40:38.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b4393e640 1 -- 172.21.15.62:0/1730062050 shutdown_connections 2023-05-15T16:40:38.887 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b4393e640 1 --2- 172.21.15.62:0/1730062050 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b28003980 0x7f6b28003d90 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b4393e640 1 -- 172.21.15.62:0/1730062050 >> 172.21.15.62:0/1730062050 conn(0x7f6b3c0bff80 msgr2=0x7f6b3c0c0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:38.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b4393e640 1 -- 172.21.15.62:0/1730062050 shutdown_connections 2023-05-15T16:40:38.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b4393e640 1 -- 172.21.15.62:0/1730062050 wait complete. 2023-05-15T16:40:38.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b4393e640 1 Processor -- start 2023-05-15T16:40:38.888 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b4393e640 1 -- start start 2023-05-15T16:40:38.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b4393e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b28003980 0x7f6b3c0a23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:38.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b4393e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b3c1e2c60 0x7f6b3c1e3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:38.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b4393e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b3c0a4d00 0x7f6b3c0a5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:38.889 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b4393e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c0a2910 con 0x7f6b3c0a4d00 2023-05-15T16:40:38.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b4393e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c0a0b70 con 0x7f6b3c1e2c60 2023-05-15T16:40:38.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b4393e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c0a5840 con 0x7f6b28003980 2023-05-15T16:40:38.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b41edb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b3c0a4d00 0x7f6b3c0a5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:38.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b41edb640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b3c0a4d00 0x7f6b3c0a5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60456/0 (socket says 172.21.15.62:60456) 2023-05-15T16:40:38.890 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b41edb640 1 -- 172.21.15.62:0/325550931 learned_addr learned my addr 172.21.15.62:0/325550931 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:38.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.875+0000 7f6b416da640 1 --2- 172.21.15.62:0/325550931 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b28003980 0x7f6b3c0a23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:38.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.879+0000 7f6b40ed9640 1 --2- 172.21.15.62:0/325550931 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b3c1e2c60 0x7f6b3c1e3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:38.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.879+0000 7f6b41edb640 1 -- 172.21.15.62:0/325550931 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b28003980 msgr2=0x7f6b3c0a23d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:38.891 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.879+0000 7f6b41edb640 1 --2- 172.21.15.62:0/325550931 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b28003980 0x7f6b3c0a23d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.879+0000 7f6b41edb640 1 -- 172.21.15.62:0/325550931 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b3c1e2c60 msgr2=0x7f6b3c1e3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:38.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.879+0000 7f6b41edb640 1 --2- 172.21.15.62:0/325550931 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b3c1e2c60 0x7f6b3c1e3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:38.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.879+0000 7f6b41edb640 1 -- 172.21.15.62:0/325550931 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3c0baf50 con 0x7f6b3c0a4d00 2023-05-15T16:40:38.892 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.879+0000 7f6b41edb640 1 --2- 172.21.15.62:0/325550931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b3c0a4d00 0x7f6b3c0a5170 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c14ad30 tx=0x7f6b34007d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:38.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.879+0000 7f6b31ffb640 1 -- 172.21.15.62:0/325550931 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b34012760 con 0x7f6b3c0a4d00 2023-05-15T16:40:38.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.879+0000 7f6b31ffb640 1 -- 172.21.15.62:0/325550931 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3400f040 con 0x7f6b3c0a4d00 2023-05-15T16:40:38.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.879+0000 7f6b4393e640 1 -- 172.21.15.62:0/325550931 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b3c0badc0 con 0x7f6b3c0a4d00 2023-05-15T16:40:38.893 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.879+0000 7f6b31ffb640 1 -- 172.21.15.62:0/325550931 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b34012b00 con 0x7f6b3c0a4d00 2023-05-15T16:40:38.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.879+0000 7f6b4393e640 1 -- 172.21.15.62:0/325550931 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3c0bb0e0 con 0x7f6b3c0a4d00 2023-05-15T16:40:38.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.879+0000 7f6b4393e640 1 -- 172.21.15.62:0/325550931 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b3c067960 con 0x7f6b3c0a4d00 2023-05-15T16:40:38.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.879+0000 7f6b31ffb640 1 -- 172.21.15.62:0/325550931 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f6b34012c60 con 0x7f6b3c0a4d00 2023-05-15T16:40:38.894 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.879+0000 7f6b31ffb640 1 --2- 172.21.15.62:0/325550931 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6b20065380 0x7f6b20067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:38.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.879+0000 7f6b31ffb640 1 -- 172.21.15.62:0/325550931 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f6b34081c20 con 0x7f6b3c0a4d00 2023-05-15T16:40:38.895 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.879+0000 7f6b416da640 1 --2- 172.21.15.62:0/325550931 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6b20065380 0x7f6b20067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:38.896 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.879+0000 7f6b416da640 1 --2- 172.21.15.62:0/325550931 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6b20065380 0x7f6b20067830 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b280057b0 tx=0x7f6b380011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:38.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:38.883+0000 7f6b31ffb640 1 -- 172.21.15.62:0/325550931 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f6b3404fb90 con 0x7f6b3c0a4d00 2023-05-15T16:40:39.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.087+0000 7f6b4393e640 1 -- 172.21.15.62:0/325550931 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f6b3c0a5f00 con 0x7f6b3c0a4d00 2023-05-15T16:40:39.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.091+0000 7f6b31ffb640 1 -- 172.21.15.62:0/325550931 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f6b340531b0 con 0x7f6b3c0a4d00 2023-05-15T16:40:39.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.095+0000 7f6b4393e640 1 -- 172.21.15.62:0/325550931 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6b20065380 msgr2=0x7f6b20067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:39.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.095+0000 7f6b4393e640 1 --2- 172.21.15.62:0/325550931 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6b20065380 0x7f6b20067830 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f6b280057b0 tx=0x7f6b380011a0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.095+0000 7f6b4393e640 1 -- 172.21.15.62:0/325550931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b3c0a4d00 msgr2=0x7f6b3c0a5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:39.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.095+0000 7f6b4393e640 1 --2- 172.21.15.62:0/325550931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b3c0a4d00 0x7f6b3c0a5170 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c14ad30 tx=0x7f6b34007d70 comp rx=0 tx=0).stop 2023-05-15T16:40:39.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.095+0000 7f6b4393e640 1 -- 172.21.15.62:0/325550931 shutdown_connections 2023-05-15T16:40:39.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.095+0000 7f6b4393e640 1 --2- 172.21.15.62:0/325550931 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6b20065380 0x7f6b20067830 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.095+0000 7f6b4393e640 1 --2- 172.21.15.62:0/325550931 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6b3c0a4d00 0x7f6b3c0a5170 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.095+0000 7f6b4393e640 1 --2- 172.21.15.62:0/325550931 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6b3c1e2c60 0x7f6b3c1e3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.095+0000 7f6b4393e640 1 --2- 172.21.15.62:0/325550931 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f6b28003980 0x7f6b3c0a23d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.095+0000 7f6b4393e640 1 -- 172.21.15.62:0/325550931 >> 172.21.15.62:0/325550931 conn(0x7f6b3c0bff80 msgr2=0x7f6b3c141df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:39.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.095+0000 7f6b4393e640 1 -- 172.21.15.62:0/325550931 shutdown_connections 2023-05-15T16:40:39.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.095+0000 7f6b4393e640 1 -- 172.21.15.62:0/325550931 wait complete. 2023-05-15T16:40:39.114 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-05-15T16:40:39.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.231+0000 7f595b61a640 1 Processor -- start 2023-05-15T16:40:39.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.231+0000 7f595b61a640 1 -- start start 2023-05-15T16:40:39.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.231+0000 7f595b61a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59540b5330 0x7f59540b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:39.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.231+0000 7f595b61a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5954144e90 0x7f5954145310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:39.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.231+0000 7f595b61a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59540716b0 con 0x7f5954071a90 2023-05-15T16:40:39.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.231+0000 7f595b61a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59540b2280 con 0x7f5954144e90 2023-05-15T16:40:39.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.231+0000 7f595b61a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59540afa90 con 0x7f59540b5330 2023-05-15T16:40:39.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.231+0000 7f59593b6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59540b5330 0x7f59540b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:39.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.231+0000 7f5959bb7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5954144e90 0x7f5954145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:39.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.231+0000 7f5959bb7640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5954144e90 0x7f5954145310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.62:51500/0 (socket says 172.21.15.62:51500) 2023-05-15T16:40:39.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.231+0000 7f5959bb7640 1 -- 172.21.15.62:0/1724145764 learned_addr learned my addr 172.21.15.62:0/1724145764 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:39.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.231+0000 7f59593b6640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59540b5330 0x7f59540b5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.62:37884/0 (socket says 172.21.15.62:37884) 2023-05-15T16:40:39.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.231+0000 7f5958bb5640 1 --1- 172.21.15.62:0/1724145764 >> v1:172.21.15.161:6789/0 conn(0x7f5954071a90 0x7f59540b16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.62:60516/0 (socket says 172.21.15.62:60516) 2023-05-15T16:40:39.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.231+0000 7f5959bb7640 1 -- 172.21.15.62:0/1724145764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59540b5330 msgr2=0x7f59540b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:39.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.231+0000 7f5959bb7640 1 --2- 172.21.15.62:0/1724145764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59540b5330 0x7f59540b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.231+0000 7f5959bb7640 1 -- 172.21.15.62:0/1724145764 >> v1:172.21.15.161:6789/0 conn(0x7f5954071a90 legacy=0x7f59540b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:39.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.231+0000 7f5959bb7640 1 -- 172.21.15.62:0/1724145764 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59540b0f00 con 0x7f5954144e90 2023-05-15T16:40:39.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.231+0000 7f59593b6640 1 --2- 172.21.15.62:0/1724145764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59540b5330 0x7f59540b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-15T16:40:39.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.235+0000 7f5959bb7640 1 --2- 172.21.15.62:0/1724145764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5954144e90 0x7f5954145310 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f594c009870 tx=0x7f594c01c510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2887723d069ce981 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:39.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.235+0000 7f5953fff640 1 -- 172.21.15.62:0/1724145764 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c0aa670 con 0x7f5954144e90 2023-05-15T16:40:39.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.235+0000 7f5953fff640 1 -- 172.21.15.62:0/1724145764 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594c0aa7d0 con 0x7f5954144e90 2023-05-15T16:40:39.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.235+0000 7f5953fff640 1 -- 172.21.15.62:0/1724145764 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f594c0aab60 con 0x7f5954144e90 2023-05-15T16:40:39.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.235+0000 7f595b61a640 1 -- 172.21.15.62:0/1724145764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5954144e90 msgr2=0x7f5954145310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:39.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.235+0000 7f595b61a640 1 --2- 172.21.15.62:0/1724145764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5954144e90 0x7f5954145310 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f594c009870 tx=0x7f594c01c510 comp rx=0 tx=0).stop 2023-05-15T16:40:39.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.235+0000 7f595b61a640 1 -- 172.21.15.62:0/1724145764 shutdown_connections 2023-05-15T16:40:39.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.235+0000 7f595b61a640 1 --2- 172.21.15.62:0/1724145764 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5954144e90 0x7f5954145310 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.235+0000 7f595b61a640 1 --2- 172.21.15.62:0/1724145764 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59540b5330 0x7f59540b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.235+0000 7f595b61a640 1 -- 172.21.15.62:0/1724145764 >> 172.21.15.62:0/1724145764 conn(0x7f59540653f0 msgr2=0x7f59540697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:39.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.235+0000 7f595b61a640 1 -- 172.21.15.62:0/1724145764 shutdown_connections 2023-05-15T16:40:39.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.235+0000 7f595b61a640 1 -- 172.21.15.62:0/1724145764 wait complete. 2023-05-15T16:40:39.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.235+0000 7f595b61a640 1 Processor -- start 2023-05-15T16:40:39.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.235+0000 7f595b61a640 1 -- start start 2023-05-15T16:40:39.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f595b61a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5954071a90 0x7f59541e2600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:39.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f595b61a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59540b5330 0x7f595413fad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:39.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f595b61a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5954144e90 0x7f5954140010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:39.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f595b61a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59541e3340 con 0x7f5954071a90 2023-05-15T16:40:39.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f595b61a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59541e1ef0 con 0x7f5954144e90 2023-05-15T16:40:39.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f595b61a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59541e2170 con 0x7f59540b5330 2023-05-15T16:40:39.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f59593b6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5954071a90 0x7f59541e2600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:39.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f59593b6640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5954071a90 0x7f59541e2600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60464/0 (socket says 172.21.15.62:60464) 2023-05-15T16:40:39.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f59593b6640 1 -- 172.21.15.62:0/4166004917 learned_addr learned my addr 172.21.15.62:0/4166004917 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:39.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f5959bb7640 1 --2- 172.21.15.62:0/4166004917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5954144e90 0x7f5954140010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:39.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f5958bb5640 1 --2- 172.21.15.62:0/4166004917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59540b5330 0x7f595413fad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:39.243 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f59593b6640 1 -- 172.21.15.62:0/4166004917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59540b5330 msgr2=0x7f595413fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:39.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f59593b6640 1 --2- 172.21.15.62:0/4166004917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59540b5330 0x7f595413fad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f59593b6640 1 -- 172.21.15.62:0/4166004917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5954144e90 msgr2=0x7f5954140010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:39.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f59593b6640 1 --2- 172.21.15.62:0/4166004917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5954144e90 0x7f5954140010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f59593b6640 1 -- 172.21.15.62:0/4166004917 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5944009a70 con 0x7f5954071a90 2023-05-15T16:40:39.244 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f59593b6640 1 --2- 172.21.15.62:0/4166004917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5954071a90 0x7f59541e2600 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5944009f60 tx=0x7f5944009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:39.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f5951ffb640 1 -- 172.21.15.62:0/4166004917 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944014680 con 0x7f5954071a90 2023-05-15T16:40:39.245 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f5951ffb640 1 -- 172.21.15.62:0/4166004917 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f594400f040 con 0x7f5954071a90 2023-05-15T16:40:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f595b61a640 1 -- 172.21.15.62:0/4166004917 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f594c0094d0 con 0x7f5954071a90 2023-05-15T16:40:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f5951ffb640 1 -- 172.21.15.62:0/4166004917 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5944014a00 con 0x7f5954071a90 2023-05-15T16:40:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f595b61a640 1 -- 172.21.15.62:0/4166004917 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59540b2050 con 0x7f5954071a90 2023-05-15T16:40:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f595b61a640 1 -- 172.21.15.62:0/4166004917 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59540b1ec0 con 0x7f5954071a90 2023-05-15T16:40:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f5951ffb640 1 -- 172.21.15.62:0/4166004917 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f5944014b60 con 0x7f5954071a90 2023-05-15T16:40:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f5951ffb640 1 --2- 172.21.15.62:0/4166004917 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5940065380 0x7f5940067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f5951ffb640 1 -- 172.21.15.62:0/4166004917 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f5944083580 con 0x7f5954071a90 2023-05-15T16:40:39.246 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.239+0000 7f5958bb5640 1 --2- 172.21.15.62:0/4166004917 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5940065380 0x7f5940067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:39.247 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.243+0000 7f5958bb5640 1 --2- 172.21.15.62:0/4166004917 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5940065380 0x7f5940067830 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f59541dfb00 tx=0x7f5948009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:39.248 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.243+0000 7f5951ffb640 1 -- 172.21.15.62:0/4166004917 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f5944051550 con 0x7f5954071a90 2023-05-15T16:40:39.455 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.451+0000 7f595b61a640 1 -- 172.21.15.62:0/4166004917 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f595414b020 con 0x7f5954071a90 2023-05-15T16:40:39.462 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.459+0000 7f5951ffb640 1 -- 172.21.15.62:0/4166004917 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f5944054b70 con 0x7f5954071a90 2023-05-15T16:40:39.464 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.459+0000 7f595b61a640 1 -- 172.21.15.62:0/4166004917 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5940065380 msgr2=0x7f5940067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:39.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.459+0000 7f595b61a640 1 --2- 172.21.15.62:0/4166004917 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5940065380 0x7f5940067830 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f59541dfb00 tx=0x7f5948009040 comp rx=0 tx=0).stop 2023-05-15T16:40:39.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.459+0000 7f595b61a640 1 -- 172.21.15.62:0/4166004917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5954071a90 msgr2=0x7f59541e2600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:39.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.459+0000 7f595b61a640 1 --2- 172.21.15.62:0/4166004917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5954071a90 0x7f59541e2600 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5944009f60 tx=0x7f5944009f90 comp rx=0 tx=0).stop 2023-05-15T16:40:39.465 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.459+0000 7f595b61a640 1 -- 172.21.15.62:0/4166004917 shutdown_connections 2023-05-15T16:40:39.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.459+0000 7f595b61a640 1 --2- 172.21.15.62:0/4166004917 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5954144e90 0x7f5954140010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.459+0000 7f595b61a640 1 --2- 172.21.15.62:0/4166004917 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f59540b5330 0x7f595413fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.459+0000 7f595b61a640 1 --2- 172.21.15.62:0/4166004917 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5940065380 0x7f5940067830 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.459+0000 7f595b61a640 1 --2- 172.21.15.62:0/4166004917 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5954071a90 0x7f59541e2600 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.459+0000 7f595b61a640 1 -- 172.21.15.62:0/4166004917 >> 172.21.15.62:0/4166004917 conn(0x7f59540653f0 msgr2=0x7f59540baa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:39.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.459+0000 7f595b61a640 1 -- 172.21.15.62:0/4166004917 shutdown_connections 2023-05-15T16:40:39.466 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.459+0000 7f595b61a640 1 -- 172.21.15.62:0/4166004917 wait complete. 2023-05-15T16:40:39.481 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-15T16:40:39.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.595+0000 7fab883d8640 1 Processor -- start 2023-05-15T16:40:39.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.595+0000 7fab883d8640 1 -- start start 2023-05-15T16:40:39.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.595+0000 7fab883d8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fab800b5330 0x7fab800b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:39.598 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.595+0000 7fab883d8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab80071a90 0x7fab800b16c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:39.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.595+0000 7fab883d8640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab800716b0 con 0x7fab80144e90 2023-05-15T16:40:39.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.595+0000 7fab883d8640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab800b2280 con 0x7fab800b5330 2023-05-15T16:40:39.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.595+0000 7fab883d8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab800afa90 con 0x7fab80071a90 2023-05-15T16:40:39.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.595+0000 7fab85973640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab80071a90 0x7fab800b16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:39.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.595+0000 7fab86174640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fab800b5330 0x7fab800b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:39.599 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.595+0000 7fab85973640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab80071a90 0x7fab800b16c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.62:37900/0 (socket says 172.21.15.62:37900) 2023-05-15T16:40:39.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.595+0000 7fab85973640 1 -- 172.21.15.62:0/870988945 learned_addr learned my addr 172.21.15.62:0/870988945 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:39.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.595+0000 7fab85973640 1 -- 172.21.15.62:0/870988945 >> v2:172.21.15.161:3300/0 conn(0x7fab800b5330 msgr2=0x7fab800b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:39.600 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.595+0000 7fab85973640 1 --2- 172.21.15.62:0/870988945 >> v2:172.21.15.161:3300/0 conn(0x7fab800b5330 0x7fab800b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.595+0000 7fab85973640 1 -- 172.21.15.62:0/870988945 >> v1:172.21.15.161:6789/0 conn(0x7fab80144e90 legacy=0x7fab800b8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:39.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.595+0000 7fab85973640 1 -- 172.21.15.62:0/870988945 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab800b0f00 con 0x7fab80071a90 2023-05-15T16:40:39.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.595+0000 7fab86174640 1 --2- 172.21.15.62:0/870988945 >> v2:172.21.15.161:3300/0 conn(0x7fab800b5330 0x7fab800b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-15T16:40:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab85973640 1 --2- 172.21.15.62:0/870988945 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab80071a90 0x7fab800b16c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fab70009870 tx=0x7fab7001c510 comp rx=0 tx=0).ready entity=mon.2 client_cookie=96a09c28ba5884e7 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab85172640 1 -- 172.21.15.62:0/870988945 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab700aa670 con 0x7fab80071a90 2023-05-15T16:40:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab85172640 1 -- 172.21.15.62:0/870988945 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab700aa7d0 con 0x7fab80071a90 2023-05-15T16:40:39.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab85172640 1 -- 172.21.15.62:0/870988945 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab700aab60 con 0x7fab80071a90 2023-05-15T16:40:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab883d8640 1 -- 172.21.15.62:0/870988945 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab80071a90 msgr2=0x7fab800b16c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab883d8640 1 --2- 172.21.15.62:0/870988945 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab80071a90 0x7fab800b16c0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fab70009870 tx=0x7fab7001c510 comp rx=0 tx=0).stop 2023-05-15T16:40:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab883d8640 1 -- 172.21.15.62:0/870988945 shutdown_connections 2023-05-15T16:40:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab883d8640 1 --2- 172.21.15.62:0/870988945 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab80071a90 0x7fab800b16c0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab883d8640 1 --2- 172.21.15.62:0/870988945 >> v2:172.21.15.161:3300/0 conn(0x7fab800b5330 0x7fab800b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab883d8640 1 -- 172.21.15.62:0/870988945 >> 172.21.15.62:0/870988945 conn(0x7fab800653f0 msgr2=0x7fab800697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab883d8640 1 -- 172.21.15.62:0/870988945 shutdown_connections 2023-05-15T16:40:39.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab883d8640 1 -- 172.21.15.62:0/870988945 wait complete. 2023-05-15T16:40:39.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab883d8640 1 Processor -- start 2023-05-15T16:40:39.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab883d8640 1 -- start start 2023-05-15T16:40:39.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab883d8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab80071a90 0x7fab801481f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:39.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab883d8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab800b5330 0x7fab80147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:39.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab883d8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab80144e90 0x7fab8013f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:39.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab883d8640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab80148730 con 0x7fab80144e90 2023-05-15T16:40:39.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab883d8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab80137eb0 con 0x7fab800b5330 2023-05-15T16:40:39.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab883d8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab801e44c0 con 0x7fab80071a90 2023-05-15T16:40:39.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab86975640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab80144e90 0x7fab8013f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:39.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab86975640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab80144e90 0x7fab8013f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60466/0 (socket says 172.21.15.62:60466) 2023-05-15T16:40:39.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab86975640 1 -- 172.21.15.62:0/1940952481 learned_addr learned my addr 172.21.15.62:0/1940952481 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:39.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab85973640 1 --2- 172.21.15.62:0/1940952481 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab800b5330 0x7fab80147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:39.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab86174640 1 --2- 172.21.15.62:0/1940952481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab80071a90 0x7fab801481f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:39.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab86975640 1 -- 172.21.15.62:0/1940952481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab80071a90 msgr2=0x7fab801481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:39.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab86975640 1 --2- 172.21.15.62:0/1940952481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab80071a90 0x7fab801481f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab86975640 1 -- 172.21.15.62:0/1940952481 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab800b5330 msgr2=0x7fab80147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:39.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab86975640 1 --2- 172.21.15.62:0/1940952481 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab800b5330 0x7fab80147280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.599+0000 7fab86975640 1 -- 172.21.15.62:0/1940952481 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab7c009420 con 0x7fab80144e90 2023-05-15T16:40:39.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.603+0000 7fab86975640 1 --2- 172.21.15.62:0/1940952481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab80144e90 0x7fab8013f400 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fab7800c740 tx=0x7fab7800cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.603+0000 7fab76ffd640 1 -- 172.21.15.62:0/1940952481 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab78006d60 con 0x7fab80144e90 2023-05-15T16:40:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.603+0000 7fab76ffd640 1 -- 172.21.15.62:0/1940952481 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab7800ce50 con 0x7fab80144e90 2023-05-15T16:40:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.603+0000 7fab883d8640 1 -- 172.21.15.62:0/1940952481 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab700094d0 con 0x7fab80144e90 2023-05-15T16:40:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.603+0000 7fab76ffd640 1 -- 172.21.15.62:0/1940952481 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab78003bc0 con 0x7fab80144e90 2023-05-15T16:40:39.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.603+0000 7fab883d8640 1 -- 172.21.15.62:0/1940952481 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab800b1c00 con 0x7fab80144e90 2023-05-15T16:40:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.603+0000 7fab883d8640 1 -- 172.21.15.62:0/1940952481 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab801456a0 con 0x7fab80144e90 2023-05-15T16:40:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.603+0000 7fab76ffd640 1 -- 172.21.15.62:0/1940952481 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fab78003d20 con 0x7fab80144e90 2023-05-15T16:40:39.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.603+0000 7fab76ffd640 1 --2- 172.21.15.62:0/1940952481 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fab64065380 0x7fab64067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.603+0000 7fab76ffd640 1 -- 172.21.15.62:0/1940952481 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fab78081fc0 con 0x7fab80144e90 2023-05-15T16:40:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.603+0000 7fab86174640 1 --2- 172.21.15.62:0/1940952481 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fab64065380 0x7fab64067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.603+0000 7fab86174640 1 --2- 172.21.15.62:0/1940952481 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fab64065380 0x7fab64067830 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009c80 tx=0x7fab7c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:39.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.607+0000 7fab76ffd640 1 -- 172.21.15.62:0/1940952481 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fab78053a50 con 0x7fab80144e90 2023-05-15T16:40:39.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.759+0000 7fab883d8640 1 -- 172.21.15.62:0/1940952481 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab800b1ec0 con 0x7fab80144e90 2023-05-15T16:40:39.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.759+0000 7fab76ffd640 1 -- 172.21.15.62:0/1940952481 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v30) v1 ==== 74+0+14171 (secure 0 0 0) 0x7fab78053640 con 0x7fab80144e90 2023-05-15T16:40:39.765 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:39.765 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":30,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:40:36.923315+0000","last_up_change":"2023-05-15T16:39:48.597049+0000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-15T16:39:49.394028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-15T16:39:55.208679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37594},{"type":"v1","addr":"172.21.15.62:6825","nonce":37594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37594},{"type":"v1","addr":"172.21.15.62:6827","nonce":37594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37594},{"type":"v1","addr":"172.21.15.62:6831","nonce":37594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37594},{"type":"v1","addr":"172.21.15.62:6829","nonce":37594}]},"public_addr":"172.21.15.62:6825/37594","cluster_addr":"172.21.15.62:6827/37594","heartbeat_back_addr":"172.21.15.62:6831/37594","heartbeat_front_addr":"172.21.15.62:6829/37594","state":["exists","up"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37592},{"type":"v1","addr":"172.21.15.62:6808","nonce":37592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":37592},{"type":"v1","addr":"172.21.15.62:6814","nonce":37592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6821","nonce":37592},{"type":"v1","addr":"172.21.15.62:6823","nonce":37592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37592},{"type":"v1","addr":"172.21.15.62:6818","nonce":37592}]},"public_addr":"172.21.15.62:6808/37592","cluster_addr":"172.21.15.62:6814/37592","heartbeat_back_addr":"172.21.15.62:6823/37592","heartbeat_front_addr":"172.21.15.62:6818/37592","state":["exists","up"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":37591},{"type":"v1","addr":"172.21.15.62:6810","nonce":37591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":37591},{"type":"v1","addr":"172.21.15.62:6815","nonce":37591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37591},{"type":"v1","addr":"172.21.15.62:6822","nonce":37591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":37591},{"type":"v1","addr":"172.21.15.62:6819","nonce":37591}]},"public_addr":"172.21.15.62:6810/37591","cluster_addr":"172.21.15.62:6815/37591","heartbeat_back_addr":"172.21.15.62:6822/37591","heartbeat_front_addr":"172.21.15.62:6819/37591","state":["exists","up"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37593},{"type":"v1","addr":"172.21.15.62:6801","nonce":37593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37593},{"type":"v1","addr":"172.21.15.62:6803","nonce":37593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":37593},{"type":"v1","addr":"172.21.15.62:6812","nonce":37593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37593},{"type":"v1","addr":"172.21.15.62:6805","nonce":37593}]},"public_addr":"172.21.15.62:6801/37593","cluster_addr":"172.21.15.62:6803/37593","heartbeat_back_addr":"172.21.15.62:6812/37593","heartbeat_front_addr":"172.21.15.62:6805/37593","state":["exists","up"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37854},{"type":"v1","addr":"172.21.15.161:6801","nonce":37854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37854},{"type":"v1","addr":"172.21.15.161:6803","nonce":37854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37854},{"type":"v1","addr":"172.21.15.161:6807","nonce":37854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37854},{"type":"v1","addr":"172.21.15.161:6805","nonce":37854}]},"public_addr":"172.21.15.161:6801/37854","cluster_addr":"172.21.15.161:6803/37854","heartbeat_back_addr":"172.21.15.161:6807/37854","heartbeat_front_addr":"172.21.15.161:6805/37854","state":["exists","up"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37855},{"type":"v1","addr":"172.21.15.161:6810","nonce":37855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37855},{"type":"v1","addr":"172.21.15.161:6815","nonce":37855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37855},{"type":"v1","addr":"172.21.15.161:6824","nonce":37855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37855},{"type":"v1","addr":"172.21.15.161:6820","nonce":37855}]},"public_addr":"172.21.15.161:6810/37855","cluster_addr":"172.21.15.161:6815/37855","heartbeat_back_addr":"172.21.15.161:6824/37855","heartbeat_front_addr":"172.21.15.161:6820/37855","state":["exists","up"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":37856},{"type":"v1","addr":"172.21.15.161:6814","nonce":37856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37856},{"type":"v1","addr":"172.21.15.161:6819","nonce":37856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":37856},{"type":"v1","addr":"172.21.15.161:6830","nonce":37856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37856},{"type":"v1","addr":"172.21.15.161:6826","nonce":37856}]},"public_addr":"172.21.15.161:6814/37856","cluster_addr":"172.21.15.161:6819/37856","heartbeat_back_addr":"172.21.15.161:6830/37856","heartbeat_front_addr":"172.21.15.161:6826/37856","state":["exists","up"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":37857},{"type":"v1","addr":"172.21.15.161:6813","nonce":37857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":37857},{"type":"v1","addr":"172.21.15.161:6821","nonce":37857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":37857},{"type":"v1","addr":"172.21.15.161:6831","nonce":37857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":37857},{"type":"v1","addr":"172.21.15.161:6827","nonce":37857}]},"public_addr":"172.21.15.161:6813/37857","cluster_addr":"172.21.15.161:6821/37857","heartbeat_back_addr":"172.21.15.161:6831/37857","heartbeat_front_addr":"172.21.15.161:6827/37857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.592907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.618143+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.641533+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.614355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.579293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.718353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.730135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.792887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:40:39.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.763+0000 7fab883d8640 1 -- 172.21.15.62:0/1940952481 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fab64065380 msgr2=0x7fab64067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:39.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.763+0000 7fab883d8640 1 --2- 172.21.15.62:0/1940952481 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fab64065380 0x7fab64067830 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fab7c009c80 tx=0x7fab7c008040 comp rx=0 tx=0).stop 2023-05-15T16:40:39.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.763+0000 7fab883d8640 1 -- 172.21.15.62:0/1940952481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab80144e90 msgr2=0x7fab8013f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:39.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.763+0000 7fab883d8640 1 --2- 172.21.15.62:0/1940952481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab80144e90 0x7fab8013f400 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fab7800c740 tx=0x7fab7800cc00 comp rx=0 tx=0).stop 2023-05-15T16:40:39.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.763+0000 7fab883d8640 1 -- 172.21.15.62:0/1940952481 shutdown_connections 2023-05-15T16:40:39.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.763+0000 7fab883d8640 1 --2- 172.21.15.62:0/1940952481 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fab64065380 0x7fab64067830 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.763+0000 7fab883d8640 1 --2- 172.21.15.62:0/1940952481 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fab80144e90 0x7fab8013f400 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.763+0000 7fab883d8640 1 --2- 172.21.15.62:0/1940952481 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fab800b5330 0x7fab80147280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.763+0000 7fab883d8640 1 --2- 172.21.15.62:0/1940952481 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fab80071a90 0x7fab801481f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.763+0000 7fab883d8640 1 -- 172.21.15.62:0/1940952481 >> 172.21.15.62:0/1940952481 conn(0x7fab800653f0 msgr2=0x7fab8013cd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:39.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.763+0000 7fab883d8640 1 -- 172.21.15.62:0/1940952481 shutdown_connections 2023-05-15T16:40:39.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.763+0000 7fab883d8640 1 -- 172.21.15.62:0/1940952481 wait complete. 2023-05-15T16:40:39.782 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-05-15T16:39:49.394028+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-05-15T16:39:55.208679+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-05-15T16:40:39.783 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-05-15T16:40:39.897 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.891+0000 7fa8cf264640 1 Processor -- start 2023-05-15T16:40:39.898 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.895+0000 7fa8cf264640 1 -- start start 2023-05-15T16:40:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.895+0000 7fa8cf264640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa8c80b0dd0 0x7fa8c80b2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.895+0000 7fa8cf264640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8c80b65a0 0x7fa8c8146c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:39.900 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.895+0000 7fa8cf264640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8c81467e0 con 0x7fa8c80b5600 2023-05-15T16:40:39.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.895+0000 7fa8cf264640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8c80b2ca0 con 0x7fa8c80b0dd0 2023-05-15T16:40:39.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.895+0000 7fa8cf264640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c80b6130 con 0x7fa8c80b65a0 2023-05-15T16:40:39.901 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.895+0000 7fa8cd000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa8c80b0dd0 0x7fa8c80b2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.895+0000 7fa8cd000640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa8c80b0dd0 0x7fa8c80b2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60482/0 (socket says 172.21.15.62:60482) 2023-05-15T16:40:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.895+0000 7fa8cd000640 1 -- 172.21.15.62:0/4185263027 learned_addr learned my addr 172.21.15.62:0/4185263027 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:39.902 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.895+0000 7fa8cd000640 1 -- 172.21.15.62:0/4185263027 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8c80b65a0 msgr2=0x7fa8c8146c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.895+0000 7fa8cd000640 1 --2- 172.21.15.62:0/4185263027 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8c80b65a0 0x7fa8c8146c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.895+0000 7fa8cd000640 1 -- 172.21.15.62:0/4185263027 >> v1:172.21.15.161:6789/0 conn(0x7fa8c80b5600 legacy=0x7fa8c80b5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:39.903 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.895+0000 7fa8cd000640 1 -- 172.21.15.62:0/4185263027 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c80b3e10 con 0x7fa8c80b0dd0 2023-05-15T16:40:39.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cd000640 1 --2- 172.21.15.62:0/4185263027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8c80b0dd0 0x7fa8c80b2200 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80098a0 tx=0x7fa8b801c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d26c62ad49d6b6fc server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:39.906 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8c77fe640 1 -- 172.21.15.62:0/4185263027 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b80ab600 con 0x7fa8c80b0dd0 2023-05-15T16:40:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8c77fe640 1 -- 172.21.15.62:0/4185263027 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b80a7050 con 0x7fa8c80b0dd0 2023-05-15T16:40:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8c77fe640 1 -- 172.21.15.62:0/4185263027 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b80ab980 con 0x7fa8c80b0dd0 2023-05-15T16:40:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cf264640 1 -- 172.21.15.62:0/4185263027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8c80b0dd0 msgr2=0x7fa8c80b2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cf264640 1 --2- 172.21.15.62:0/4185263027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8c80b0dd0 0x7fa8c80b2200 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fa8b80098a0 tx=0x7fa8b801c4e0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cf264640 1 -- 172.21.15.62:0/4185263027 shutdown_connections 2023-05-15T16:40:39.907 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cf264640 1 --2- 172.21.15.62:0/4185263027 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8c80b65a0 0x7fa8c8146c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cf264640 1 --2- 172.21.15.62:0/4185263027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8c80b0dd0 0x7fa8c80b2200 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cf264640 1 -- 172.21.15.62:0/4185263027 >> 172.21.15.62:0/4185263027 conn(0x7fa8c80697b0 msgr2=0x7fa8c8069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cf264640 1 -- 172.21.15.62:0/4185263027 shutdown_connections 2023-05-15T16:40:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cf264640 1 -- 172.21.15.62:0/4185263027 wait complete. 2023-05-15T16:40:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cf264640 1 Processor -- start 2023-05-15T16:40:39.908 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cf264640 1 -- start start 2023-05-15T16:40:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cf264640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8c80b0dd0 0x7fa8c813ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cf264640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8c80b5600 0x7fa8c806eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cf264640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8c80b65a0 0x7fa8c813adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cf264640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8070b00 con 0x7fa8c80b0dd0 2023-05-15T16:40:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cf264640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c813f220 con 0x7fa8c80b5600 2023-05-15T16:40:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cf264640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8c8070730 con 0x7fa8c80b65a0 2023-05-15T16:40:39.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cd000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8c80b0dd0 0x7fa8c813ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cd000640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8c80b0dd0 0x7fa8c813ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60492/0 (socket says 172.21.15.62:60492) 2023-05-15T16:40:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cd000640 1 -- 172.21.15.62:0/4123235569 learned_addr learned my addr 172.21.15.62:0/4123235569 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cd000640 1 -- 172.21.15.62:0/4123235569 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8c80b65a0 msgr2=0x7fa8c813adb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-15T16:40:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cd000640 1 --2- 172.21.15.62:0/4123235569 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8c80b65a0 0x7fa8c813adb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cd000640 1 -- 172.21.15.62:0/4123235569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8c80b5600 msgr2=0x7fa8c806eb70 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-05-15T16:40:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cd000640 1 --2- 172.21.15.62:0/4123235569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8c80b5600 0x7fa8c806eb70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:39.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cd000640 1 -- 172.21.15.62:0/4123235569 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b80094d0 con 0x7fa8c80b0dd0 2023-05-15T16:40:39.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cd000640 1 --2- 172.21.15.62:0/4123235569 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8c80b0dd0 0x7fa8c813ece0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa8b801ab90 tx=0x7fa8b8019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:39.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8c57fa640 1 -- 172.21.15.62:0/4123235569 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b80bb070 con 0x7fa8c80b0dd0 2023-05-15T16:40:39.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8c57fa640 1 -- 172.21.15.62:0/4123235569 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8b80b5400 con 0x7fa8c80b0dd0 2023-05-15T16:40:39.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8c57fa640 1 -- 172.21.15.62:0/4123235569 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8b80b57d0 con 0x7fa8c80b0dd0 2023-05-15T16:40:39.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cf264640 1 -- 172.21.15.62:0/4123235569 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8c8146470 con 0x7fa8c80b0dd0 2023-05-15T16:40:39.911 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.899+0000 7fa8cf264640 1 -- 172.21.15.62:0/4123235569 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8c80b29c0 con 0x7fa8c80b0dd0 2023-05-15T16:40:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.903+0000 7fa8cf264640 1 -- 172.21.15.62:0/4123235569 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8c80b11a0 con 0x7fa8c80b0dd0 2023-05-15T16:40:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.903+0000 7fa8c57fa640 1 -- 172.21.15.62:0/4123235569 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fa8b80b5930 con 0x7fa8c80b0dd0 2023-05-15T16:40:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.903+0000 7fa8c57fa640 1 --2- 172.21.15.62:0/4123235569 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa8a80653b0 0x7fa8a8067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:39.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.903+0000 7fa8c57fa640 1 -- 172.21.15.62:0/4123235569 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa8b811c290 con 0x7fa8c80b0dd0 2023-05-15T16:40:39.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.903+0000 7fa8c7fff640 1 --2- 172.21.15.62:0/4123235569 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa8a80653b0 0x7fa8a8067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:39.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.903+0000 7fa8c7fff640 1 --2- 172.21.15.62:0/4123235569 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa8a80653b0 0x7fa8a8067860 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8143540 tx=0x7fa8b0006b90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:39.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:39.907+0000 7fa8c57fa640 1 -- 172.21.15.62:0/4123235569 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fa8b80ea250 con 0x7fa8c80b0dd0 2023-05-15T16:40:40.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.055+0000 7fa8cf264640 1 -- 172.21.15.62:0/4123235569 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa8c8067960 con 0x7fa8c80b0dd0 2023-05-15T16:40:40.058 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.055+0000 7fa8c57fa640 1 -- 172.21.15.62:0/4123235569 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v30) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa8b80ed870 con 0x7fa8c80b0dd0 2023-05-15T16:40:40.059 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 1 2023-05-15T16:40:40.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.055+0000 7fa8cf264640 1 -- 172.21.15.62:0/4123235569 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa8a80653b0 msgr2=0x7fa8a8067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:40.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.055+0000 7fa8cf264640 1 --2- 172.21.15.62:0/4123235569 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa8a80653b0 0x7fa8a8067860 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8143540 tx=0x7fa8b0006b90 comp rx=0 tx=0).stop 2023-05-15T16:40:40.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.055+0000 7fa8cf264640 1 -- 172.21.15.62:0/4123235569 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8c80b0dd0 msgr2=0x7fa8c813ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:40.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.055+0000 7fa8cf264640 1 --2- 172.21.15.62:0/4123235569 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8c80b0dd0 0x7fa8c813ece0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fa8b801ab90 tx=0x7fa8b8019280 comp rx=0 tx=0).stop 2023-05-15T16:40:40.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.055+0000 7fa8cf264640 1 -- 172.21.15.62:0/4123235569 shutdown_connections 2023-05-15T16:40:40.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.055+0000 7fa8cf264640 1 --2- 172.21.15.62:0/4123235569 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa8c80b65a0 0x7fa8c813adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.061 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.055+0000 7fa8cf264640 1 --2- 172.21.15.62:0/4123235569 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa8c80b5600 0x7fa8c806eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.055+0000 7fa8cf264640 1 --2- 172.21.15.62:0/4123235569 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa8a80653b0 0x7fa8a8067860 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.055+0000 7fa8cf264640 1 --2- 172.21.15.62:0/4123235569 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa8c80b0dd0 0x7fa8c813ece0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.055+0000 7fa8cf264640 1 -- 172.21.15.62:0/4123235569 >> 172.21.15.62:0/4123235569 conn(0x7fa8c80697b0 msgr2=0x7fa8c8069b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:40.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.055+0000 7fa8cf264640 1 -- 172.21.15.62:0/4123235569 shutdown_connections 2023-05-15T16:40:40.062 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.055+0000 7fa8cf264640 1 -- 172.21.15.62:0/4123235569 wait complete. 2023-05-15T16:40:40.076 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-05-15T16:40:40.196 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.191+0000 7f06a0835640 1 Processor -- start 2023-05-15T16:40:40.197 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.191+0000 7f06a0835640 1 -- start start 2023-05-15T16:40:40.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.191+0000 7f06a0835640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f069c0b5e70 0x7f069c144170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.198 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.191+0000 7f06a0835640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069c0b5240 con 0x7f069c14f4c0 2023-05-15T16:40:40.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.191+0000 7f06a0835640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f069c0b3220 con 0x7f069c0b7910 2023-05-15T16:40:40.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.191+0000 7f06a0835640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f069c0b5a50 con 0x7f069c0b5e70 2023-05-15T16:40:40.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.191+0000 7f069ad9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f069c14f4c0 0x7f069c1518a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58044/0 (socket says 172.21.15.62:58044) 2023-05-15T16:40:40.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.191+0000 7f069ad9d640 1 -- 172.21.15.62:0/2766683567 learned_addr learned my addr 172.21.15.62:0/2766683567 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:40.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f0699d9b640 1 --2- 172.21.15.62:0/2766683567 >> v2:172.21.15.161:3300/0 conn(0x7f069c0b5e70 0x7f069c144170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069959a640 1 -- 172.21.15.62:0/2766683567 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479037410 0 0) 0x7f069c0b5240 con 0x7f069c14f4c0 2023-05-15T16:40:40.199 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069959a640 1 -- 172.21.15.62:0/2766683567 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0684005740 con 0x7f069c14f4c0 2023-05-15T16:40:40.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069959a640 1 -- 172.21.15.62:0/2766683567 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 425468437 0 0) 0x7f0684005740 con 0x7f069c14f4c0 2023-05-15T16:40:40.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069959a640 1 -- 172.21.15.62:0/2766683567 >> v2:172.21.15.161:3300/0 conn(0x7f069c0b5e70 msgr2=0x7f069c144170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:40.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069959a640 1 --2- 172.21.15.62:0/2766683567 >> v2:172.21.15.161:3300/0 conn(0x7f069c0b5e70 0x7f069c144170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069959a640 1 -- 172.21.15.62:0/2766683567 >> v1:172.21.15.161:6789/0 conn(0x7f069c0b7910 legacy=0x7f069c0b4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:40.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069959a640 1 -- 172.21.15.62:0/2766683567 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c0b4710 con 0x7f069c14f4c0 2023-05-15T16:40:40.200 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069959a640 1 -- 172.21.15.62:0/2766683567 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7f0694001a00 con 0x7f069c14f4c0 2023-05-15T16:40:40.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069959a640 1 -- 172.21.15.62:0/2766683567 >> v1:172.21.15.62:6789/0 conn(0x7f069c14f4c0 legacy=0x7f069c1518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:40.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069959a640 1 --2- 172.21.15.62:0/2766683567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0684005be0 0x7f0684005ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069959a640 1 --2- 172.21.15.62:0/2766683567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06840069e0 0x7f0684006e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069959a640 1 --2- 172.21.15.62:0/2766683567 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0684007390 0x7f068400dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069959a640 1 -- 172.21.15.62:0/2766683567 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c0b5a50 con 0x7f0684005be0 2023-05-15T16:40:40.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069959a640 1 -- 172.21.15.62:0/2766683567 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068400e250 con 0x7f06840069e0 2023-05-15T16:40:40.201 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069959a640 1 -- 172.21.15.62:0/2766683567 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068400e410 con 0x7f0684007390 2023-05-15T16:40:40.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069a59c640 1 --2- 172.21.15.62:0/2766683567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0684005be0 0x7f0684005ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f0699d9b640 1 --2- 172.21.15.62:0/2766683567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06840069e0 0x7f0684006e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069a59c640 1 -- 172.21.15.62:0/2766683567 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0684007390 msgr2=0x7f068400dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:40.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069a59c640 1 --2- 172.21.15.62:0/2766683567 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0684007390 0x7f068400dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069a59c640 1 -- 172.21.15.62:0/2766683567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06840069e0 msgr2=0x7f0684006e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:40.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069a59c640 1 --2- 172.21.15.62:0/2766683567 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f06840069e0 0x7f0684006e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.202 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069a59c640 1 -- 172.21.15.62:0/2766683567 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0684005740 con 0x7f0684005be0 2023-05-15T16:40:40.203 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069ad9d640 1 -- 172.21.15.62:0/2766683567 reap_dead start 2023-05-15T16:40:40.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069a59c640 1 --2- 172.21.15.62:0/2766683567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0684005be0 0x7f0684005ff0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f068c001780 tx=0x7f068c01c3e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17e710eda67508f8 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:40.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069959a640 1 -- 172.21.15.62:0/2766683567 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c0052d0 con 0x7f0684005be0 2023-05-15T16:40:40.205 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069959a640 1 -- 172.21.15.62:0/2766683567 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f068c0a7050 con 0x7f0684005be0 2023-05-15T16:40:40.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f069959a640 1 -- 172.21.15.62:0/2766683567 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f068c003600 con 0x7f0684005be0 2023-05-15T16:40:40.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f06a0835640 1 -- 172.21.15.62:0/2766683567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0684005be0 msgr2=0x7f0684005ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:40.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f06a0835640 1 --2- 172.21.15.62:0/2766683567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0684005be0 0x7f0684005ff0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f068c001780 tx=0x7f068c01c3e0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f06a0835640 1 -- 172.21.15.62:0/2766683567 shutdown_connections 2023-05-15T16:40:40.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f06a0835640 1 --2- 172.21.15.62:0/2766683567 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0684005be0 0x7f0684005ff0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f06a0835640 1 -- 172.21.15.62:0/2766683567 >> 172.21.15.62:0/2766683567 conn(0x7f069c0697b0 msgr2=0x7f069c069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:40.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f06a0835640 1 -- 172.21.15.62:0/2766683567 shutdown_connections 2023-05-15T16:40:40.206 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.195+0000 7f06a0835640 1 -- 172.21.15.62:0/2766683567 wait complete. 2023-05-15T16:40:40.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f06a0835640 1 Processor -- start 2023-05-15T16:40:40.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f06a0835640 1 -- start start 2023-05-15T16:40:40.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f06a0835640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0684005be0 0x7f069c1de2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f06a0835640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f069c13b610 0x7f069c06f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f06a0835640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f069c13ba80 0x7f069c06f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f06a0835640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c070300 con 0x7f069c13b610 2023-05-15T16:40:40.207 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f06a0835640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f069c1de7e0 con 0x7f0684005be0 2023-05-15T16:40:40.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f06a0835640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f069c13d850 con 0x7f069c13ba80 2023-05-15T16:40:40.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f0699d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f069c13b610 0x7f069c06f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f0699d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f069c13b610 0x7f069c06f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60512/0 (socket says 172.21.15.62:60512) 2023-05-15T16:40:40.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f0699d9b640 1 -- 172.21.15.62:0/1692051412 learned_addr learned my addr 172.21.15.62:0/1692051412 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:40.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f069a59c640 1 --2- 172.21.15.62:0/1692051412 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0684005be0 0x7f069c1de2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f069ad9d640 1 --2- 172.21.15.62:0/1692051412 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f069c13ba80 0x7f069c06f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.208 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f0699d9b640 1 -- 172.21.15.62:0/1692051412 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f069c13ba80 msgr2=0x7f069c06f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:40.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f0699d9b640 1 --2- 172.21.15.62:0/1692051412 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f069c13ba80 0x7f069c06f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f0699d9b640 1 -- 172.21.15.62:0/1692051412 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0684005be0 msgr2=0x7f069c1de2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:40.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f0699d9b640 1 --2- 172.21.15.62:0/1692051412 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0684005be0 0x7f069c1de2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f0699d9b640 1 -- 172.21.15.62:0/1692051412 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f069c0b2a90 con 0x7f069c13b610 2023-05-15T16:40:40.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f069a59c640 1 --2- 172.21.15.62:0/1692051412 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0684005be0 0x7f069c1de2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-15T16:40:40.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f069ad9d640 1 --2- 172.21.15.62:0/1692051412 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f069c13ba80 0x7f069c06f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:40.209 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f0699d9b640 1 --2- 172.21.15.62:0/1692051412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f069c13b610 0x7f069c06f370 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0690010900 tx=0x7f0690010dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:40.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f068affd640 1 -- 172.21.15.62:0/1692051412 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0690009650 con 0x7f069c13b610 2023-05-15T16:40:40.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f068affd640 1 -- 172.21.15.62:0/1692051412 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f069000ebc0 con 0x7f069c13b610 2023-05-15T16:40:40.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f068affd640 1 -- 172.21.15.62:0/1692051412 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f069001c400 con 0x7f069c13b610 2023-05-15T16:40:40.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f06a0835640 1 -- 172.21.15.62:0/1692051412 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f069c0b34c0 con 0x7f069c13b610 2023-05-15T16:40:40.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f06a0835640 1 -- 172.21.15.62:0/1692051412 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f069c0b2cf0 con 0x7f069c13b610 2023-05-15T16:40:40.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.199+0000 7f06a0835640 1 -- 172.21.15.62:0/1692051412 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f069c067960 con 0x7f069c13b610 2023-05-15T16:40:40.210 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.203+0000 7f068affd640 1 -- 172.21.15.62:0/1692051412 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f069001c560 con 0x7f069c13b610 2023-05-15T16:40:40.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.203+0000 7f068affd640 1 --2- 172.21.15.62:0/1692051412 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f067c065380 0x7f067c067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.203+0000 7f068affd640 1 -- 172.21.15.62:0/1692051412 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7f0690082cf0 con 0x7f069c13b610 2023-05-15T16:40:40.211 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.203+0000 7f069a59c640 1 --2- 172.21.15.62:0/1692051412 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f067c065380 0x7f067c067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.203+0000 7f069a59c640 1 --2- 172.21.15.62:0/1692051412 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f067c065380 0x7f067c067830 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f068c001750 tx=0x7f068c0011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:40.212 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.207+0000 7f068affd640 1 -- 172.21.15.62:0/1692051412 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f0690050e00 con 0x7f069c13b610 2023-05-15T16:40:40.361 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.355+0000 7f06a0835640 1 -- 172.21.15.62:0/1692051412 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f069c04dbe0 con 0x7f069c13b610 2023-05-15T16:40:40.362 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.359+0000 7f068affd640 1 -- 172.21.15.62:0/1692051412 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v30) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0690054420 con 0x7f069c13b610 2023-05-15T16:40:40.362 INFO:teuthology.orchestra.run.smithi062.stdout:pg_num: 8 2023-05-15T16:40:40.363 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.359+0000 7f06a0835640 1 -- 172.21.15.62:0/1692051412 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f067c065380 msgr2=0x7f067c067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:40.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.359+0000 7f06a0835640 1 --2- 172.21.15.62:0/1692051412 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f067c065380 0x7f067c067830 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f068c001750 tx=0x7f068c0011a0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.359+0000 7f06a0835640 1 -- 172.21.15.62:0/1692051412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f069c13b610 msgr2=0x7f069c06f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:40.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.359+0000 7f06a0835640 1 --2- 172.21.15.62:0/1692051412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f069c13b610 0x7f069c06f370 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f0690010900 tx=0x7f0690010dc0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.359+0000 7f06a0835640 1 -- 172.21.15.62:0/1692051412 shutdown_connections 2023-05-15T16:40:40.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.359+0000 7f06a0835640 1 --2- 172.21.15.62:0/1692051412 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f069c13ba80 0x7f069c06f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.364 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.359+0000 7f06a0835640 1 --2- 172.21.15.62:0/1692051412 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f067c065380 0x7f067c067830 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.359+0000 7f06a0835640 1 --2- 172.21.15.62:0/1692051412 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f069c13b610 0x7f069c06f370 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.359+0000 7f06a0835640 1 --2- 172.21.15.62:0/1692051412 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0684005be0 0x7f069c1de2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.359+0000 7f06a0835640 1 -- 172.21.15.62:0/1692051412 >> 172.21.15.62:0/1692051412 conn(0x7f069c0697b0 msgr2=0x7f069c0b4af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:40.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.359+0000 7f06a0835640 1 -- 172.21.15.62:0/1692051412 shutdown_connections 2023-05-15T16:40:40.365 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.359+0000 7f06a0835640 1 -- 172.21.15.62:0/1692051412 wait complete. 2023-05-15T16:40:40.381 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-05-15T16:40:40.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3c6f6c640 1 Processor -- start 2023-05-15T16:40:40.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3c6f6c640 1 -- start start 2023-05-15T16:40:40.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3c6f6c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c00bccd0 0x7fc3c00bb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.500 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3c6f6c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fc3c0069b30 0x7fc3c0143e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3c6f6c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3c00baca0 con 0x7fc3c0144380 2023-05-15T16:40:40.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3c6f6c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3c006bae0 con 0x7fc3c0069b30 2023-05-15T16:40:40.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3c6f6c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c01447e0 con 0x7fc3c00bccd0 2023-05-15T16:40:40.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3c5509640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fc3c0144380 0x7fc3c00bbcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58048/0 (socket says 172.21.15.62:58048) 2023-05-15T16:40:40.501 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3c5509640 1 -- 172.21.15.62:0/3036539613 learned_addr learned my addr 172.21.15.62:0/3036539613 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:40.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3bffff640 1 --2- 172.21.15.62:0/3036539613 >> v2:172.21.15.161:3300/0 conn(0x7fc3c0069b30 0x7fc3c0143e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3bf7fe640 1 -- 172.21.15.62:0/3036539613 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704140098 0 0) 0x7fc3c00baca0 con 0x7fc3c0144380 2023-05-15T16:40:40.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3c4d08640 1 --2- 172.21.15.62:0/3036539613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c00bccd0 0x7fc3c00bb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3bf7fe640 1 -- 172.21.15.62:0/3036539613 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3ac003530 con 0x7fc3c0144380 2023-05-15T16:40:40.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3bf7fe640 1 -- 172.21.15.62:0/3036539613 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4251952172 0 0) 0x7fc3ac003530 con 0x7fc3c0144380 2023-05-15T16:40:40.503 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3bf7fe640 1 -- 172.21.15.62:0/3036539613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c00bccd0 msgr2=0x7fc3c00bb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:40.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3bf7fe640 1 --2- 172.21.15.62:0/3036539613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c00bccd0 0x7fc3c00bb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3bf7fe640 1 -- 172.21.15.62:0/3036539613 >> v2:172.21.15.161:3300/0 conn(0x7fc3c0069b30 msgr2=0x7fc3c0143e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:40.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3bf7fe640 1 --2- 172.21.15.62:0/3036539613 >> v2:172.21.15.161:3300/0 conn(0x7fc3c0069b30 0x7fc3c0143e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.504 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3bf7fe640 1 -- 172.21.15.62:0/3036539613 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c006b420 con 0x7fc3c0144380 2023-05-15T16:40:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3bf7fe640 1 -- 172.21.15.62:0/3036539613 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7fc3b8001a00 con 0x7fc3c0144380 2023-05-15T16:40:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3bf7fe640 1 -- 172.21.15.62:0/3036539613 >> v1:172.21.15.62:6789/0 conn(0x7fc3c0144380 legacy=0x7fc3c00bbcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3bf7fe640 1 --2- 172.21.15.62:0/3036539613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3ac003980 0x7fc3ac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3bf7fe640 1 --2- 172.21.15.62:0/3036539613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c00bccd0 0x7fc3ac0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3bf7fe640 1 --2- 172.21.15.62:0/3036539613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3ac004d10 0x7fc3ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.505 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3bf7fe640 1 -- 172.21.15.62:0/3036539613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c006bae0 con 0x7fc3ac004d10 2023-05-15T16:40:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3bf7fe640 1 -- 172.21.15.62:0/3036539613 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c01447e0 con 0x7fc3ac003980 2023-05-15T16:40:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.495+0000 7fc3bf7fe640 1 -- 172.21.15.62:0/3036539613 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3ac00b990 con 0x7fc3c00bccd0 2023-05-15T16:40:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.499+0000 7fc3c5509640 1 --2- 172.21.15.62:0/3036539613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3ac004d10 0x7fc3ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.499+0000 7fc3c4d08640 1 --2- 172.21.15.62:0/3036539613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3ac003980 0x7fc3ac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.499+0000 7fc3bffff640 1 --2- 172.21.15.62:0/3036539613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c00bccd0 0x7fc3ac0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.506 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.499+0000 7fc3c5509640 1 -- 172.21.15.62:0/3036539613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c00bccd0 msgr2=0x7fc3ac0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.499+0000 7fc3c5509640 1 --2- 172.21.15.62:0/3036539613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c00bccd0 0x7fc3ac0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.499+0000 7fc3c5509640 1 -- 172.21.15.62:0/3036539613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3ac003980 msgr2=0x7fc3ac003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.499+0000 7fc3c5509640 1 --2- 172.21.15.62:0/3036539613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3ac003980 0x7fc3ac003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.499+0000 7fc3c5509640 1 -- 172.21.15.62:0/3036539613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3ac003530 con 0x7fc3ac004d10 2023-05-15T16:40:40.507 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.499+0000 7fc3bffff640 1 --2- 172.21.15.62:0/3036539613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c00bccd0 0x7fc3ac0047d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:40.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.499+0000 7fc3c5509640 1 --2- 172.21.15.62:0/3036539613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3ac004d10 0x7fc3ac005180 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800a8d0 tx=0x7fc3b801d380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77e0c07ea97a64ec server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:40.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.499+0000 7fc3bf7fe640 1 -- 172.21.15.62:0/3036539613 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b80ad630 con 0x7fc3ac004d10 2023-05-15T16:40:40.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.499+0000 7fc3bf7fe640 1 -- 172.21.15.62:0/3036539613 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b80a8070 con 0x7fc3ac004d10 2023-05-15T16:40:40.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.499+0000 7fc3bf7fe640 1 -- 172.21.15.62:0/3036539613 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b80ad9d0 con 0x7fc3ac004d10 2023-05-15T16:40:40.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.499+0000 7fc3c6f6c640 1 -- 172.21.15.62:0/3036539613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3ac004d10 msgr2=0x7fc3ac005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:40.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.499+0000 7fc3c6f6c640 1 --2- 172.21.15.62:0/3036539613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3ac004d10 0x7fc3ac005180 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fc3b800a8d0 tx=0x7fc3b801d380 comp rx=0 tx=0).stop 2023-05-15T16:40:40.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.499+0000 7fc3c5509640 1 -- 172.21.15.62:0/3036539613 reap_dead start 2023-05-15T16:40:40.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.499+0000 7fc3c6f6c640 1 -- 172.21.15.62:0/3036539613 shutdown_connections 2023-05-15T16:40:40.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.499+0000 7fc3c6f6c640 1 -- 172.21.15.62:0/3036539613 >> 172.21.15.62:0/3036539613 conn(0x7fc3c00a1ad0 msgr2=0x7fc3c00a1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:40.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.499+0000 7fc3c6f6c640 1 -- 172.21.15.62:0/3036539613 shutdown_connections 2023-05-15T16:40:40.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.499+0000 7fc3c6f6c640 1 -- 172.21.15.62:0/3036539613 wait complete. 2023-05-15T16:40:40.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3c6f6c640 1 Processor -- start 2023-05-15T16:40:40.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3c6f6c640 1 -- start start 2023-05-15T16:40:40.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3c6f6c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3ac004d10 0x7fc3c00b5ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3c6f6c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c0144de0 0x7fc3c0145210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3c6f6c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c0145fb0 0x7fc3c0146420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3c6f6c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c00b63e0 con 0x7fc3c0145fb0 2023-05-15T16:40:40.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3c6f6c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c0147990 con 0x7fc3ac004d10 2023-05-15T16:40:40.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3c6f6c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c0141950 con 0x7fc3c0144de0 2023-05-15T16:40:40.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3c5509640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c0145fb0 0x7fc3c0146420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3c5509640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c0145fb0 0x7fc3c0146420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60532/0 (socket says 172.21.15.62:60532) 2023-05-15T16:40:40.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3c5509640 1 -- 172.21.15.62:0/2850114459 learned_addr learned my addr 172.21.15.62:0/2850114459 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:40.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3c4d08640 1 --2- 172.21.15.62:0/2850114459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3ac004d10 0x7fc3c00b5ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3bffff640 1 --2- 172.21.15.62:0/2850114459 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c0144de0 0x7fc3c0145210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3c5509640 1 -- 172.21.15.62:0/2850114459 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c0144de0 msgr2=0x7fc3c0145210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:40.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3c5509640 1 --2- 172.21.15.62:0/2850114459 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c0144de0 0x7fc3c0145210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3c5509640 1 -- 172.21.15.62:0/2850114459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3ac004d10 msgr2=0x7fc3c00b5ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:40.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3c5509640 1 --2- 172.21.15.62:0/2850114459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3ac004d10 0x7fc3c00b5ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3c5509640 1 -- 172.21.15.62:0/2850114459 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c00bd0a0 con 0x7fc3c0145fb0 2023-05-15T16:40:40.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3c5509640 1 --2- 172.21.15.62:0/2850114459 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c0145fb0 0x7fc3c0146420 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8098d70 tx=0x7fc3ac005800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:40.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3bd7fa640 1 -- 172.21.15.62:0/2850114459 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b80017c0 con 0x7fc3c0145fb0 2023-05-15T16:40:40.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3bd7fa640 1 -- 172.21.15.62:0/2850114459 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3b8001920 con 0x7fc3c0145fb0 2023-05-15T16:40:40.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3c6f6c640 1 -- 172.21.15.62:0/2850114459 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3c006b700 con 0x7fc3c0145fb0 2023-05-15T16:40:40.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3bd7fa640 1 -- 172.21.15.62:0/2850114459 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3b8004d70 con 0x7fc3c0145fb0 2023-05-15T16:40:40.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3c6f6c640 1 -- 172.21.15.62:0/2850114459 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3c00ba8c0 con 0x7fc3c0145fb0 2023-05-15T16:40:40.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3c6f6c640 1 -- 172.21.15.62:0/2850114459 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3c0067960 con 0x7fc3c0145fb0 2023-05-15T16:40:40.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3bd7fa640 1 -- 172.21.15.62:0/2850114459 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fc3b80aa030 con 0x7fc3c0145fb0 2023-05-15T16:40:40.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3bd7fa640 1 --2- 172.21.15.62:0/2850114459 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc3a0065380 0x7fc3a0067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.515 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.503+0000 7fc3bd7fa640 1 -- 172.21.15.62:0/2850114459 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fc3b811c250 con 0x7fc3c0145fb0 2023-05-15T16:40:40.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.507+0000 7fc3c4d08640 1 --2- 172.21.15.62:0/2850114459 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc3a0065380 0x7fc3a0067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.507+0000 7fc3c4d08640 1 --2- 172.21.15.62:0/2850114459 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc3a0065380 0x7fc3a0067830 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0009a60 tx=0x7fc3b0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:40.516 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.507+0000 7fc3bd7fa640 1 -- 172.21.15.62:0/2850114459 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fc3b80ea2b0 con 0x7fc3c0145fb0 2023-05-15T16:40:40.667 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.663+0000 7fc3c6f6c640 1 -- 172.21.15.62:0/2850114459 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc3c0067960 con 0x7fc3c0145fb0 2023-05-15T16:40:40.668 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.663+0000 7fc3bd7fa640 1 -- 172.21.15.62:0/2850114459 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) v1 ==== 84+0+126 (secure 0 0 0) 0x7fc3b80ed8d0 con 0x7fc3c0145fb0 2023-05-15T16:40:40.668 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:40.668 INFO:teuthology.orchestra.run.smithi062.stdout:[ 2023-05-15T16:40:40.668 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:40.669 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 1, 2023-05-15T16:40:40.669 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": ".mgr" 2023-05-15T16:40:40.669 INFO:teuthology.orchestra.run.smithi062.stdout: }, 2023-05-15T16:40:40.669 INFO:teuthology.orchestra.run.smithi062.stdout: { 2023-05-15T16:40:40.669 INFO:teuthology.orchestra.run.smithi062.stdout: "poolnum": 2, 2023-05-15T16:40:40.669 INFO:teuthology.orchestra.run.smithi062.stdout: "poolname": "rbd" 2023-05-15T16:40:40.669 INFO:teuthology.orchestra.run.smithi062.stdout: } 2023-05-15T16:40:40.670 INFO:teuthology.orchestra.run.smithi062.stdout:] 2023-05-15T16:40:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.667+0000 7fc3c6f6c640 1 -- 172.21.15.62:0/2850114459 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc3a0065380 msgr2=0x7fc3a0067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:40.670 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.667+0000 7fc3c6f6c640 1 --2- 172.21.15.62:0/2850114459 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc3a0065380 0x7fc3a0067830 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc3b0009a60 tx=0x7fc3b0008040 comp rx=0 tx=0).stop 2023-05-15T16:40:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.667+0000 7fc3c6f6c640 1 -- 172.21.15.62:0/2850114459 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c0145fb0 msgr2=0x7fc3c0146420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.667+0000 7fc3c6f6c640 1 --2- 172.21.15.62:0/2850114459 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c0145fb0 0x7fc3c0146420 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fc3b8098d70 tx=0x7fc3ac005800 comp rx=0 tx=0).stop 2023-05-15T16:40:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.667+0000 7fc3c6f6c640 1 -- 172.21.15.62:0/2850114459 shutdown_connections 2023-05-15T16:40:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.667+0000 7fc3c6f6c640 1 --2- 172.21.15.62:0/2850114459 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fc3a0065380 0x7fc3a0067830 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.667+0000 7fc3c6f6c640 1 --2- 172.21.15.62:0/2850114459 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fc3c0145fb0 0x7fc3c0146420 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.671 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.667+0000 7fc3c6f6c640 1 --2- 172.21.15.62:0/2850114459 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fc3c0144de0 0x7fc3c0145210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.667+0000 7fc3c6f6c640 1 --2- 172.21.15.62:0/2850114459 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fc3ac004d10 0x7fc3c00b5ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.667+0000 7fc3c6f6c640 1 -- 172.21.15.62:0/2850114459 >> 172.21.15.62:0/2850114459 conn(0x7fc3c00a1ad0 msgr2=0x7fc3c00bba30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.667+0000 7fc3c6f6c640 1 -- 172.21.15.62:0/2850114459 shutdown_connections 2023-05-15T16:40:40.672 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.667+0000 7fc3c6f6c640 1 -- 172.21.15.62:0/2850114459 wait complete. 2023-05-15T16:40:40.686 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-05-15T16:40:40.686 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-05-15T16:40:40.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.807+0000 7fa4da4df640 1 Processor -- start 2023-05-15T16:40:40.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.807+0000 7fa4da4df640 1 -- start start 2023-05-15T16:40:40.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.807+0000 7fa4da4df640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4d41511f0 0x7fa4d41535d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.807+0000 7fa4da4df640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d40b7a20 con 0x7fa4d4141d00 2023-05-15T16:40:40.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.807+0000 7fa4da4df640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d40b8f70 con 0x7fa4d40b8a00 2023-05-15T16:40:40.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.807+0000 7fa4da4df640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d40b94a0 con 0x7fa4d41511f0 2023-05-15T16:40:40.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.807+0000 7fa4d3fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa4d4141d00 0x7fa4d40ba510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58062/0 (socket says 172.21.15.62:58062) 2023-05-15T16:40:40.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.807+0000 7fa4d3fff640 1 -- 172.21.15.62:0/1097048640 learned_addr learned my addr 172.21.15.62:0/1097048640 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:40.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d8a7c640 1 --2- 172.21.15.62:0/1097048640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4d41511f0 0x7fa4d41535d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d2ffd640 1 -- 172.21.15.62:0/1097048640 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1586745758 0 0) 0x7fa4d40b7a20 con 0x7fa4d4141d00 2023-05-15T16:40:40.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d2ffd640 1 -- 172.21.15.62:0/1097048640 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4bc003530 con 0x7fa4d4141d00 2023-05-15T16:40:40.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d2ffd640 1 -- 172.21.15.62:0/1097048640 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1358384447 0 0) 0x7fa4bc003530 con 0x7fa4d4141d00 2023-05-15T16:40:40.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d2ffd640 1 -- 172.21.15.62:0/1097048640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4d41511f0 msgr2=0x7fa4d41535d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:40.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d2ffd640 1 --2- 172.21.15.62:0/1097048640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4d41511f0 0x7fa4d41535d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d2ffd640 1 -- 172.21.15.62:0/1097048640 >> v1:172.21.15.161:6789/0 conn(0x7fa4d40b8a00 legacy=0x7fa4d4147890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:40.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d2ffd640 1 -- 172.21.15.62:0/1097048640 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d40b9b60 con 0x7fa4d4141d00 2023-05-15T16:40:40.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d2ffd640 1 -- 172.21.15.62:0/1097048640 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7fa4c40016a0 con 0x7fa4d4141d00 2023-05-15T16:40:40.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d8a7c640 1 --2- 172.21.15.62:0/1097048640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4d41511f0 0x7fa4d41535d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-15T16:40:40.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d2ffd640 1 -- 172.21.15.62:0/1097048640 >> v1:172.21.15.62:6789/0 conn(0x7fa4d4141d00 legacy=0x7fa4d40ba510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:40.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d2ffd640 1 --2- 172.21.15.62:0/1097048640 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4bc0039b0 0x7fa4bc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d2ffd640 1 --2- 172.21.15.62:0/1097048640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4bc0047d0 0x7fa4bc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d2ffd640 1 --2- 172.21.15.62:0/1097048640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4d41511f0 0x7fa4bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d2ffd640 1 -- 172.21.15.62:0/1097048640 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d40b94a0 con 0x7fa4bc0047d0 2023-05-15T16:40:40.819 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d2ffd640 1 -- 172.21.15.62:0/1097048640 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc00ba70 con 0x7fa4bc0039b0 2023-05-15T16:40:40.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d2ffd640 1 -- 172.21.15.62:0/1097048640 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4bc00bc30 con 0x7fa4d41511f0 2023-05-15T16:40:40.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d37fe640 1 --2- 172.21.15.62:0/1097048640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4bc0047d0 0x7fa4bc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d3fff640 1 --2- 172.21.15.62:0/1097048640 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4bc0039b0 0x7fa4bc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.820 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d8a7c640 1 --2- 172.21.15.62:0/1097048640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4d41511f0 0x7fa4bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d37fe640 1 -- 172.21.15.62:0/1097048640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4d41511f0 msgr2=0x7fa4bc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:40.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d37fe640 1 --2- 172.21.15.62:0/1097048640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4d41511f0 0x7fa4bc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d37fe640 1 -- 172.21.15.62:0/1097048640 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4bc0039b0 msgr2=0x7fa4bc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:40.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d37fe640 1 --2- 172.21.15.62:0/1097048640 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4bc0039b0 0x7fa4bc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d37fe640 1 -- 172.21.15.62:0/1097048640 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc003530 con 0x7fa4bc0047d0 2023-05-15T16:40:40.821 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d8a7c640 1 --2- 172.21.15.62:0/1097048640 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4d41511f0 0x7fa4bc005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:40.825 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d37fe640 1 --2- 172.21.15.62:0/1097048640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4bc0047d0 0x7fa4bc004c40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8001780 tx=0x7fa4c801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e4f85db54942da server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:40.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d2ffd640 1 -- 172.21.15.62:0/1097048640 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c80052d0 con 0x7fa4bc0047d0 2023-05-15T16:40:40.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d2ffd640 1 -- 172.21.15.62:0/1097048640 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c80a7050 con 0x7fa4bc0047d0 2023-05-15T16:40:40.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d2ffd640 1 -- 172.21.15.62:0/1097048640 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8003600 con 0x7fa4bc0047d0 2023-05-15T16:40:40.826 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4da4df640 1 -- 172.21.15.62:0/1097048640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4bc0047d0 msgr2=0x7fa4bc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:40.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4da4df640 1 --2- 172.21.15.62:0/1097048640 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4bc0047d0 0x7fa4bc004c40 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fa4c8001780 tx=0x7fa4c801c400 comp rx=0 tx=0).stop 2023-05-15T16:40:40.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4d8a7c640 1 -- 172.21.15.62:0/1097048640 reap_dead start 2023-05-15T16:40:40.827 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4da4df640 1 -- 172.21.15.62:0/1097048640 shutdown_connections 2023-05-15T16:40:40.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4da4df640 1 -- 172.21.15.62:0/1097048640 >> 172.21.15.62:0/1097048640 conn(0x7fa4d40697b0 msgr2=0x7fa4d4069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:40.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4da4df640 1 -- 172.21.15.62:0/1097048640 shutdown_connections 2023-05-15T16:40:40.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.811+0000 7fa4da4df640 1 -- 172.21.15.62:0/1097048640 wait complete. 2023-05-15T16:40:40.828 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4da4df640 1 Processor -- start 2023-05-15T16:40:40.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4da4df640 1 -- start start 2023-05-15T16:40:40.829 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4da4df640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4bc0047d0 0x7fa4d40bcf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4da4df640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4d4148a30 0x7fa4d4149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4da4df640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4d4149c60 0x7fa4d413ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4da4df640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d40bd450 con 0x7fa4d4149c60 2023-05-15T16:40:40.830 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4da4df640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d414a0e0 con 0x7fa4d4148a30 2023-05-15T16:40:40.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4da4df640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d40b4890 con 0x7fa4bc0047d0 2023-05-15T16:40:40.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4d8a7c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4d4149c60 0x7fa4d413ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4d8a7c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4d4149c60 0x7fa4d413ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60542/0 (socket says 172.21.15.62:60542) 2023-05-15T16:40:40.831 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4d8a7c640 1 -- 172.21.15.62:0/3820726613 learned_addr learned my addr 172.21.15.62:0/3820726613 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:40.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4d3fff640 1 --2- 172.21.15.62:0/3820726613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4bc0047d0 0x7fa4d40bcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4d37fe640 1 --2- 172.21.15.62:0/3820726613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4d4148a30 0x7fa4d4149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4d8a7c640 1 -- 172.21.15.62:0/3820726613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4bc0047d0 msgr2=0x7fa4d40bcf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:40.832 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4d8a7c640 1 --2- 172.21.15.62:0/3820726613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4bc0047d0 0x7fa4d40bcf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4d8a7c640 1 -- 172.21.15.62:0/3820726613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4d4148a30 msgr2=0x7fa4d4149720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:40.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4d8a7c640 1 --2- 172.21.15.62:0/3820726613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4d4148a30 0x7fa4d4149720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:40.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4d8a7c640 1 -- 172.21.15.62:0/3820726613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d4071e20 con 0x7fa4d4149c60 2023-05-15T16:40:40.833 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4d8a7c640 1 --2- 172.21.15.62:0/3820726613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4d4149c60 0x7fa4d413ce80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40bb800 tx=0x7fa4cc0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:40.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4d0ff9640 1 -- 172.21.15.62:0/3820726613 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc014600 con 0x7fa4d4149c60 2023-05-15T16:40:40.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4d0ff9640 1 -- 172.21.15.62:0/3820726613 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4cc014780 con 0x7fa4d4149c60 2023-05-15T16:40:40.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4da4df640 1 -- 172.21.15.62:0/3820726613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d40b9ff0 con 0x7fa4d4149c60 2023-05-15T16:40:40.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4d0ff9640 1 -- 172.21.15.62:0/3820726613 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4cc014b30 con 0x7fa4d4149c60 2023-05-15T16:40:40.834 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4da4df640 1 -- 172.21.15.62:0/3820726613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d40b91c0 con 0x7fa4d4149c60 2023-05-15T16:40:40.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4da4df640 1 -- 172.21.15.62:0/3820726613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d404dbe0 con 0x7fa4d4149c60 2023-05-15T16:40:40.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.815+0000 7fa4d0ff9640 1 -- 172.21.15.62:0/3820726613 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fa4cc01d3b0 con 0x7fa4d4149c60 2023-05-15T16:40:40.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.819+0000 7fa4d0ff9640 1 --2- 172.21.15.62:0/3820726613 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa4c00653b0 0x7fa4c0067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:40.835 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.819+0000 7fa4d0ff9640 1 -- 172.21.15.62:0/3820726613 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5210+0+0 (secure 0 0 0) 0x7fa4cc0826c0 con 0x7fa4d4149c60 2023-05-15T16:40:40.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.819+0000 7fa4d3fff640 1 --2- 172.21.15.62:0/3820726613 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa4c00653b0 0x7fa4c0067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:40.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.819+0000 7fa4d3fff640 1 --2- 172.21.15.62:0/3820726613 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa4c00653b0 0x7fa4c0067860 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4148a00 tx=0x7fa4c4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:40.836 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.819+0000 7fa4d0ff9640 1 -- 172.21.15.62:0/3820726613 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fa4cc050580 con 0x7fa4d4149c60 2023-05-15T16:40:40.976 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:40.971+0000 7fa4da4df640 1 -- 172.21.15.62:0/3820726613 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa4d4071740 con 0x7fa4d4149c60 2023-05-15T16:40:41.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.743+0000 7fa4d0ff9640 1 -- 172.21.15.62:0/3820726613 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa4cc053ba0 con 0x7fa4d4149c60 2023-05-15T16:40:41.749 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_metadata' created 2023-05-15T16:40:41.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.751+0000 7fa4da4df640 1 -- 172.21.15.62:0/3820726613 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa4c00653b0 msgr2=0x7fa4c0067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:41.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.751+0000 7fa4da4df640 1 --2- 172.21.15.62:0/3820726613 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa4c00653b0 0x7fa4c0067860 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4148a00 tx=0x7fa4c4009040 comp rx=0 tx=0).stop 2023-05-15T16:40:41.754 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.751+0000 7fa4da4df640 1 -- 172.21.15.62:0/3820726613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4d4149c60 msgr2=0x7fa4d413ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:41.755 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.751+0000 7fa4da4df640 1 --2- 172.21.15.62:0/3820726613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4d4149c60 0x7fa4d413ce80 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fa4d40bb800 tx=0x7fa4cc0043b0 comp rx=0 tx=0).stop 2023-05-15T16:40:41.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.751+0000 7fa4da4df640 1 -- 172.21.15.62:0/3820726613 shutdown_connections 2023-05-15T16:40:41.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.751+0000 7fa4da4df640 1 --2- 172.21.15.62:0/3820726613 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa4c00653b0 0x7fa4c0067860 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:41.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.751+0000 7fa4da4df640 1 --2- 172.21.15.62:0/3820726613 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa4d4149c60 0x7fa4d413ce80 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:41.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.751+0000 7fa4da4df640 1 --2- 172.21.15.62:0/3820726613 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa4d4148a30 0x7fa4d4149720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:41.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.751+0000 7fa4da4df640 1 --2- 172.21.15.62:0/3820726613 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa4bc0047d0 0x7fa4d40bcf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:41.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.751+0000 7fa4da4df640 1 -- 172.21.15.62:0/3820726613 >> 172.21.15.62:0/3820726613 conn(0x7fa4d40697b0 msgr2=0x7fa4d413e190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:41.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.751+0000 7fa4da4df640 1 -- 172.21.15.62:0/3820726613 shutdown_connections 2023-05-15T16:40:41.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.751+0000 7fa4da4df640 1 -- 172.21.15.62:0/3820726613 wait complete. 2023-05-15T16:40:41.780 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-05-15T16:40:41.915 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.911+0000 7f4dc9204640 1 Processor -- start 2023-05-15T16:40:41.916 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.911+0000 7f4dc9204640 1 -- start start 2023-05-15T16:40:41.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.911+0000 7f4dc9204640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4dc414b180 0x7f4dc40b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:41.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.911+0000 7f4dc9204640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc406de60 con 0x7f4dc4141f30 2023-05-15T16:40:41.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.911+0000 7f4dc9204640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4dc4142300 con 0x7f4dc40ba160 2023-05-15T16:40:41.917 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.911+0000 7f4dc9204640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4dc40ba8d0 con 0x7f4dc414b180 2023-05-15T16:40:41.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.911+0000 7f4dc2d9d640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f4dc4141f30 0x7f4dc41485c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58076/0 (socket says 172.21.15.62:58076) 2023-05-15T16:40:41.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.911+0000 7f4dc2d9d640 1 -- 172.21.15.62:0/3773407480 learned_addr learned my addr 172.21.15.62:0/3773407480 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:41.918 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.911+0000 7f4dc359e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f4dc414b180 0x7f4dc40b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:41.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.915+0000 7f4dc359e640 1 -- 172.21.15.62:0/3773407480 >> v1:172.21.15.161:6789/0 conn(0x7f4dc40ba160 legacy=0x7f4dc406d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:41.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.915+0000 7f4dc359e640 1 -- 172.21.15.62:0/3773407480 >> v1:172.21.15.62:6789/0 conn(0x7f4dc4141f30 legacy=0x7f4dc41485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:41.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.915+0000 7f4dc359e640 1 -- 172.21.15.62:0/3773407480 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dc40ba5f0 con 0x7f4dc414b180 2023-05-15T16:40:41.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.915+0000 7f4dc1d9b640 1 -- 172.21.15.62:0/3773407480 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 829409701 0 0) 0x7f4dc406de60 con 0x7f4dc4141f30 2023-05-15T16:40:41.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.915+0000 7f4dc359e640 1 --2- 172.21.15.62:0/3773407480 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dc414b180 0x7f4dc40b4ce0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc009d90 tx=0x7f4dbc01c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48475941674ff11 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:41.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.915+0000 7f4dc1d9b640 1 -- 172.21.15.62:0/3773407480 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc0a58e0 con 0x7f4dc414b180 2023-05-15T16:40:41.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.915+0000 7f4dc1d9b640 1 -- 172.21.15.62:0/3773407480 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dbc0a5a40 con 0x7f4dc414b180 2023-05-15T16:40:41.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.915+0000 7f4dc1d9b640 1 -- 172.21.15.62:0/3773407480 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dbc0a5dd0 con 0x7f4dc414b180 2023-05-15T16:40:41.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.915+0000 7f4dc9204640 1 -- 172.21.15.62:0/3773407480 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dc414b180 msgr2=0x7f4dc40b4ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:41.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.915+0000 7f4dc9204640 1 --2- 172.21.15.62:0/3773407480 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dc414b180 0x7f4dc40b4ce0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc009d90 tx=0x7f4dbc01c910 comp rx=0 tx=0).stop 2023-05-15T16:40:41.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.915+0000 7f4dc9204640 1 -- 172.21.15.62:0/3773407480 shutdown_connections 2023-05-15T16:40:41.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.915+0000 7f4dc9204640 1 --2- 172.21.15.62:0/3773407480 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dc414b180 0x7f4dc40b4ce0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:41.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.915+0000 7f4dc9204640 1 -- 172.21.15.62:0/3773407480 >> 172.21.15.62:0/3773407480 conn(0x7f4dc40bdf60 msgr2=0x7f4dc40be360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:41.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.915+0000 7f4dc9204640 1 -- 172.21.15.62:0/3773407480 shutdown_connections 2023-05-15T16:40:41.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.915+0000 7f4dc9204640 1 -- 172.21.15.62:0/3773407480 wait complete. 2023-05-15T16:40:41.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dc9204640 1 Processor -- start 2023-05-15T16:40:41.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dc9204640 1 -- start start 2023-05-15T16:40:41.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dc9204640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dc40ba160 0x7f4dc413b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:41.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dc9204640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4dc4141f30 0x7f4dc406b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:41.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dc9204640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dc414b180 0x7f4dc413c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:41.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dc9204640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc41481a0 con 0x7f4dc40ba160 2023-05-15T16:40:41.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dc9204640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc406baa0 con 0x7f4dc414b180 2023-05-15T16:40:41.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dc9204640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4dc413caa0 con 0x7f4dc4141f30 2023-05-15T16:40:41.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dc2d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dc40ba160 0x7f4dc413b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:41.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dc2d9d640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dc40ba160 0x7f4dc413b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60552/0 (socket says 172.21.15.62:60552) 2023-05-15T16:40:41.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dc2d9d640 1 -- 172.21.15.62:0/3074621992 learned_addr learned my addr 172.21.15.62:0/3074621992 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:41.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dc359e640 1 --2- 172.21.15.62:0/3074621992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dc414b180 0x7f4dc413c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:41.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dc2d9d640 1 -- 172.21.15.62:0/3074621992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4dc4141f30 msgr2=0x7f4dc406b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:41.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dc2d9d640 1 --2- 172.21.15.62:0/3074621992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4dc4141f30 0x7f4dc406b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:41.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dc2d9d640 1 -- 172.21.15.62:0/3074621992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dc414b180 msgr2=0x7f4dc413c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:41.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dc2d9d640 1 --2- 172.21.15.62:0/3074621992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dc414b180 0x7f4dc413c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:41.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dc2d9d640 1 -- 172.21.15.62:0/3074621992 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dbc009a70 con 0x7f4dc40ba160 2023-05-15T16:40:41.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dc2d9d640 1 --2- 172.21.15.62:0/3074621992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dc40ba160 0x7f4dc413b750 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4db40011f0 tx=0x7f4db400c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:41.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dab7fe640 1 -- 172.21.15.62:0/3074621992 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db40074e0 con 0x7f4dc40ba160 2023-05-15T16:40:41.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dab7fe640 1 -- 172.21.15.62:0/3074621992 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4db4007640 con 0x7f4dc40ba160 2023-05-15T16:40:41.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dab7fe640 1 -- 172.21.15.62:0/3074621992 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4db4004a10 con 0x7f4dc40ba160 2023-05-15T16:40:41.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dc9204640 1 -- 172.21.15.62:0/3074621992 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4dc4155ed0 con 0x7f4dc40ba160 2023-05-15T16:40:41.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dc9204640 1 -- 172.21.15.62:0/3074621992 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4dc4155d40 con 0x7f4dc40ba160 2023-05-15T16:40:41.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dc9204640 1 -- 172.21.15.62:0/3074621992 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4dc4156060 con 0x7f4dc40ba160 2023-05-15T16:40:41.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dab7fe640 1 -- 172.21.15.62:0/3074621992 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f4db4004b70 con 0x7f4dc40ba160 2023-05-15T16:40:41.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dab7fe640 1 --2- 172.21.15.62:0/3074621992 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4db0065380 0x7f4db0067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:41.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.919+0000 7f4dab7fe640 1 -- 172.21.15.62:0/3074621992 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5580+0+0 (secure 0 0 0) 0x7f4db4081910 con 0x7f4dc40ba160 2023-05-15T16:40:41.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.923+0000 7f4dc259c640 1 --2- 172.21.15.62:0/3074621992 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4db0065380 0x7f4db0067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:41.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.923+0000 7f4dc259c640 1 --2- 172.21.15.62:0/3074621992 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4db0065380 0x7f4db0067830 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4dc413c2d0 tx=0x7f4db8006bd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:41.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:41.923+0000 7f4dab7fe640 1 -- 172.21.15.62:0/3074621992 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f4db404f770 con 0x7f4dc40ba160 2023-05-15T16:40:42.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.079+0000 7f4dc9204640 1 -- 172.21.15.62:0/3074621992 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4dc404dbe0 con 0x7f4dc40ba160 2023-05-15T16:40:42.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.755+0000 7f4dab7fe640 1 -- 172.21.15.62:0/3074621992 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4db4018070 con 0x7f4dc40ba160 2023-05-15T16:40:42.761 INFO:teuthology.orchestra.run.smithi062.stderr:pool 'cephfs_data' created 2023-05-15T16:40:42.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.763+0000 7f4dc9204640 1 -- 172.21.15.62:0/3074621992 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4db0065380 msgr2=0x7f4db0067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:42.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.763+0000 7f4dc9204640 1 --2- 172.21.15.62:0/3074621992 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4db0065380 0x7f4db0067830 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f4dc413c2d0 tx=0x7f4db8006bd0 comp rx=0 tx=0).stop 2023-05-15T16:40:42.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.763+0000 7f4dc9204640 1 -- 172.21.15.62:0/3074621992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dc40ba160 msgr2=0x7f4dc413b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:42.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.763+0000 7f4dc9204640 1 --2- 172.21.15.62:0/3074621992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dc40ba160 0x7f4dc413b750 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f4db40011f0 tx=0x7f4db400c9b0 comp rx=0 tx=0).stop 2023-05-15T16:40:42.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.767+0000 7f4dc9204640 1 -- 172.21.15.62:0/3074621992 shutdown_connections 2023-05-15T16:40:42.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.767+0000 7f4dc9204640 1 --2- 172.21.15.62:0/3074621992 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f4dc414b180 0x7f4dc413c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:42.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.767+0000 7f4dc9204640 1 --2- 172.21.15.62:0/3074621992 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f4dc4141f30 0x7f4dc406b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:42.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.767+0000 7f4dc9204640 1 --2- 172.21.15.62:0/3074621992 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f4db0065380 0x7f4db0067830 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:42.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.767+0000 7f4dc9204640 1 --2- 172.21.15.62:0/3074621992 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f4dc40ba160 0x7f4dc413b750 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:42.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.767+0000 7f4dc9204640 1 -- 172.21.15.62:0/3074621992 >> 172.21.15.62:0/3074621992 conn(0x7f4dc40bdf60 msgr2=0x7f4dc40b98d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:42.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.771+0000 7f4dc9204640 1 -- 172.21.15.62:0/3074621992 shutdown_connections 2023-05-15T16:40:42.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.771+0000 7f4dc9204640 1 -- 172.21.15.62:0/3074621992 wait complete. 2023-05-15T16:40:42.809 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-05-15T16:40:42.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.931+0000 7f1db537e640 1 Processor -- start 2023-05-15T16:40:42.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.931+0000 7f1db537e640 1 -- start start 2023-05-15T16:40:42.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.931+0000 7f1db537e640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1db00ba2b0 0x7f1db0144150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:42.934 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.931+0000 7f1db537e640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db00b94c0 con 0x7f1db0143d20 2023-05-15T16:40:42.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.931+0000 7f1db537e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1db006bf30 con 0x7f1db00be2c0 2023-05-15T16:40:42.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.931+0000 7f1db537e640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1db006c210 con 0x7f1db00ba2b0 2023-05-15T16:40:42.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.931+0000 7f1daf7fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f1db00ba2b0 0x7f1db0144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:42.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.931+0000 7f1dae7fc640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f1db0143d20 0x7f1db00b9ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58086/0 (socket says 172.21.15.62:58086) 2023-05-15T16:40:42.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.931+0000 7f1dae7fc640 1 -- 172.21.15.62:0/2221877156 learned_addr learned my addr 172.21.15.62:0/2221877156 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:42.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.931+0000 7f1daf7fe640 1 -- 172.21.15.62:0/2221877156 >> v1:172.21.15.161:6789/0 conn(0x7f1db00be2c0 legacy=0x7f1db00b86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:42.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.931+0000 7f1daf7fe640 1 -- 172.21.15.62:0/2221877156 >> v1:172.21.15.62:6789/0 conn(0x7f1db0143d20 legacy=0x7f1db00b9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:42.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.931+0000 7f1daf7fe640 1 -- 172.21.15.62:0/2221877156 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1db006c4f0 con 0x7f1db00ba2b0 2023-05-15T16:40:42.937 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.931+0000 7f1dadffb640 1 -- 172.21.15.62:0/2221877156 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2141712391 0 0) 0x7f1db00b94c0 con 0x7f1db0143d20 2023-05-15T16:40:42.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1daf7fe640 1 --2- 172.21.15.62:0/2221877156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1db00ba2b0 0x7f1db0144150 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1da80097c0 tx=0x7f1da801ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3cbc8e620b879b0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:42.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1dadffb640 1 -- 172.21.15.62:0/2221877156 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da80a8930 con 0x7f1db00ba2b0 2023-05-15T16:40:42.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1dadffb640 1 -- 172.21.15.62:0/2221877156 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da80a8a90 con 0x7f1db00ba2b0 2023-05-15T16:40:42.938 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1dadffb640 1 -- 172.21.15.62:0/2221877156 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da80a8e20 con 0x7f1db00ba2b0 2023-05-15T16:40:42.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1db537e640 1 -- 172.21.15.62:0/2221877156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1db00ba2b0 msgr2=0x7f1db0144150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:42.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1db537e640 1 --2- 172.21.15.62:0/2221877156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1db00ba2b0 0x7f1db0144150 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f1da80097c0 tx=0x7f1da801ec30 comp rx=0 tx=0).stop 2023-05-15T16:40:42.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1db537e640 1 -- 172.21.15.62:0/2221877156 shutdown_connections 2023-05-15T16:40:42.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1db537e640 1 --2- 172.21.15.62:0/2221877156 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1db00ba2b0 0x7f1db0144150 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:42.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1db537e640 1 -- 172.21.15.62:0/2221877156 >> 172.21.15.62:0/2221877156 conn(0x7f1db006e480 msgr2=0x7f1db006e880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:42.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1db537e640 1 -- 172.21.15.62:0/2221877156 shutdown_connections 2023-05-15T16:40:42.939 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1db537e640 1 -- 172.21.15.62:0/2221877156 wait complete. 2023-05-15T16:40:42.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1db537e640 1 Processor -- start 2023-05-15T16:40:42.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1db537e640 1 -- start start 2023-05-15T16:40:42.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1db537e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1db00ba2b0 0x7f1db0145620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:42.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1db537e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1db00be2c0 0x7f1db0146320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:42.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1db537e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1db0143d20 0x7f1db01393e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:42.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1db537e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db0145b60 con 0x7f1db0143d20 2023-05-15T16:40:42.942 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1db537e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1db0139d90 con 0x7f1db00ba2b0 2023-05-15T16:40:42.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1db537e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1db0147550 con 0x7f1db00be2c0 2023-05-15T16:40:42.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1daf7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1db0143d20 0x7f1db01393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:42.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1daf7fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1db0143d20 0x7f1db01393e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60568/0 (socket says 172.21.15.62:60568) 2023-05-15T16:40:42.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1daf7fe640 1 -- 172.21.15.62:0/3776757146 learned_addr learned my addr 172.21.15.62:0/3776757146 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:42.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1daeffd640 1 --2- 172.21.15.62:0/3776757146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1db00ba2b0 0x7f1db0145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:42.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1dae7fc640 1 --2- 172.21.15.62:0/3776757146 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1db00be2c0 0x7f1db0146320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:42.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1daf7fe640 1 -- 172.21.15.62:0/3776757146 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1db00be2c0 msgr2=0x7f1db0146320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:42.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1daf7fe640 1 --2- 172.21.15.62:0/3776757146 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1db00be2c0 0x7f1db0146320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:42.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1daf7fe640 1 -- 172.21.15.62:0/3776757146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1db00ba2b0 msgr2=0x7f1db0145620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:42.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1daf7fe640 1 --2- 172.21.15.62:0/3776757146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1db00ba2b0 0x7f1db0145620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:42.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1daf7fe640 1 -- 172.21.15.62:0/3776757146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da8009420 con 0x7f1db0143d20 2023-05-15T16:40:42.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1daeffd640 1 --2- 172.21.15.62:0/3776757146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1db00ba2b0 0x7f1db0145620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:42.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1daf7fe640 1 --2- 172.21.15.62:0/3776757146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1db0143d20 0x7f1db01393e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1da801b840 tx=0x7f1da801b9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:42.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1da77fe640 1 -- 172.21.15.62:0/3776757146 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da80b0e20 con 0x7f1db0143d20 2023-05-15T16:40:42.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1da77fe640 1 -- 172.21.15.62:0/3776757146 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da80b9410 con 0x7f1db0143d20 2023-05-15T16:40:42.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1db537e640 1 -- 172.21.15.62:0/3776757146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1db006bbe0 con 0x7f1db0143d20 2023-05-15T16:40:42.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1da77fe640 1 -- 172.21.15.62:0/3776757146 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da80b97a0 con 0x7f1db0143d20 2023-05-15T16:40:42.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.935+0000 7f1db537e640 1 -- 172.21.15.62:0/3776757146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1db006c7d0 con 0x7f1db0143d20 2023-05-15T16:40:42.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.939+0000 7f1db537e640 1 -- 172.21.15.62:0/3776757146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1db00be690 con 0x7f1db0143d20 2023-05-15T16:40:42.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.939+0000 7f1da77fe640 1 -- 172.21.15.62:0/3776757146 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f1da80b7040 con 0x7f1db0143d20 2023-05-15T16:40:42.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.939+0000 7f1da77fe640 1 --2- 172.21.15.62:0/3776757146 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1d90065380 0x7f1d90067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:42.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.939+0000 7f1da77fe640 1 -- 172.21.15.62:0/3776757146 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5962+0+0 (secure 0 0 0) 0x7f1da8120ad0 con 0x7f1db0143d20 2023-05-15T16:40:42.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.939+0000 7f1daeffd640 1 --2- 172.21.15.62:0/3776757146 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1d90065380 0x7f1d90067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:42.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.939+0000 7f1daeffd640 1 --2- 172.21.15.62:0/3776757146 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1d90065380 0x7f1d90067830 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1da0007fd0 tx=0x7f1da0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:42.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:42.943+0000 7f1da77fe640 1 -- 172.21.15.62:0/3776757146 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f1da80ee920 con 0x7f1db0143d20 2023-05-15T16:40:43.133 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.127+0000 7f1db537e640 1 -- 172.21.15.62:0/3776757146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1db0070a10 con 0x7f1db0143d20 2023-05-15T16:40:43.143 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.139+0000 7f1da77fe640 1 -- 172.21.15.62:0/3776757146 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v11) v1 ==== 172+0+0 (secure 0 0 0) 0x7f1da80f1f40 con 0x7f1db0143d20 2023-05-15T16:40:43.144 INFO:teuthology.orchestra.run.smithi062.stderr:new fs with metadata pool 5 and data pool 6 2023-05-15T16:40:43.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.151+0000 7f1db537e640 1 -- 172.21.15.62:0/3776757146 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1d90065380 msgr2=0x7f1d90067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:43.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.151+0000 7f1db537e640 1 --2- 172.21.15.62:0/3776757146 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1d90065380 0x7f1d90067830 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1da0007fd0 tx=0x7f1da0009040 comp rx=0 tx=0).stop 2023-05-15T16:40:43.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.151+0000 7f1db537e640 1 -- 172.21.15.62:0/3776757146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1db0143d20 msgr2=0x7f1db01393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:43.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.151+0000 7f1db537e640 1 --2- 172.21.15.62:0/3776757146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1db0143d20 0x7f1db01393e0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1da801b840 tx=0x7f1da801b9d0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.151+0000 7f1db537e640 1 -- 172.21.15.62:0/3776757146 shutdown_connections 2023-05-15T16:40:43.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.151+0000 7f1db537e640 1 --2- 172.21.15.62:0/3776757146 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f1d90065380 0x7f1d90067830 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.151+0000 7f1db537e640 1 --2- 172.21.15.62:0/3776757146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f1db0143d20 0x7f1db01393e0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.151+0000 7f1db537e640 1 --2- 172.21.15.62:0/3776757146 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f1db00be2c0 0x7f1db0146320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.157 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.151+0000 7f1db537e640 1 --2- 172.21.15.62:0/3776757146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f1db00ba2b0 0x7f1db0145620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.151+0000 7f1db537e640 1 -- 172.21.15.62:0/3776757146 >> 172.21.15.62:0/3776757146 conn(0x7f1db006e480 msgr2=0x7f1db01417b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:43.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.151+0000 7f1db537e640 1 -- 172.21.15.62:0/3776757146 shutdown_connections 2023-05-15T16:40:43.158 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.151+0000 7f1db537e640 1 -- 172.21.15.62:0/3776757146 wait complete. 2023-05-15T16:40:43.182 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-15T16:40:43.299 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.295+0000 7fa7beea9640 1 Processor -- start 2023-05-15T16:40:43.300 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.295+0000 7fa7beea9640 1 -- start start 2023-05-15T16:40:43.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.295+0000 7fa7beea9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7b8071a90 0x7fa7b80b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:43.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.295+0000 7fa7beea9640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa7b8144e90 0x7fa7b8145310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:43.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.295+0000 7fa7beea9640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7b80716b0 con 0x7fa7b80b5330 2023-05-15T16:40:43.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.295+0000 7fa7beea9640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7b80b2280 con 0x7fa7b8144e90 2023-05-15T16:40:43.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.295+0000 7fa7beea9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b80afa90 con 0x7fa7b8071a90 2023-05-15T16:40:43.301 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.295+0000 7fa7b7fff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7b8071a90 0x7fa7b80b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:43.302 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.295+0000 7fa7bd446640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa7b8144e90 0x7fa7b8145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:43.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.295+0000 7fa7bcc45640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7fa7b80b5330 0x7fa7b80b16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.62:60594/0 (socket says 172.21.15.62:60594) 2023-05-15T16:40:43.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.295+0000 7fa7bd446640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fa7b8144e90 0x7fa7b8145310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.62:51666/0 (socket says 172.21.15.62:51666) 2023-05-15T16:40:43.303 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.295+0000 7fa7bcc45640 1 -- 172.21.15.62:0/98626430 learned_addr learned my addr 172.21.15.62:0/98626430 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:43.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.299+0000 7fa7bd446640 1 -- 172.21.15.62:0/98626430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7b8071a90 msgr2=0x7fa7b80b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:43.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.299+0000 7fa7bd446640 1 --2- 172.21.15.62:0/98626430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7b8071a90 0x7fa7b80b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.304 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.299+0000 7fa7bd446640 1 -- 172.21.15.62:0/98626430 >> v1:172.21.15.161:6789/0 conn(0x7fa7b80b5330 legacy=0x7fa7b80b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:43.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.299+0000 7fa7bd446640 1 -- 172.21.15.62:0/98626430 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b80b0f00 con 0x7fa7b8144e90 2023-05-15T16:40:43.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.299+0000 7fa7bd446640 1 --2- 172.21.15.62:0/98626430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7b8144e90 0x7fa7b8145310 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009d90 tx=0x7fa7b001c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f98db115a497447a server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:43.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.299+0000 7fa7b77fe640 1 -- 172.21.15.62:0/98626430 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b00a59e0 con 0x7fa7b8144e90 2023-05-15T16:40:43.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.299+0000 7fa7b77fe640 1 -- 172.21.15.62:0/98626430 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b00a5b40 con 0x7fa7b8144e90 2023-05-15T16:40:43.305 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.299+0000 7fa7b77fe640 1 -- 172.21.15.62:0/98626430 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b00ad440 con 0x7fa7b8144e90 2023-05-15T16:40:43.306 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.299+0000 7fa7beea9640 1 -- 172.21.15.62:0/98626430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7b8144e90 msgr2=0x7fa7b8145310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:43.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.299+0000 7fa7beea9640 1 --2- 172.21.15.62:0/98626430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7b8144e90 0x7fa7b8145310 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009d90 tx=0x7fa7b001c920 comp rx=0 tx=0).stop 2023-05-15T16:40:43.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.299+0000 7fa7beea9640 1 -- 172.21.15.62:0/98626430 shutdown_connections 2023-05-15T16:40:43.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.299+0000 7fa7beea9640 1 --2- 172.21.15.62:0/98626430 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7b8144e90 0x7fa7b8145310 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.307 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.299+0000 7fa7beea9640 1 --2- 172.21.15.62:0/98626430 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7b8071a90 0x7fa7b80b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.299+0000 7fa7beea9640 1 -- 172.21.15.62:0/98626430 >> 172.21.15.62:0/98626430 conn(0x7fa7b80653f0 msgr2=0x7fa7b80697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:43.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.299+0000 7fa7beea9640 1 -- 172.21.15.62:0/98626430 shutdown_connections 2023-05-15T16:40:43.308 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.299+0000 7fa7beea9640 1 -- 172.21.15.62:0/98626430 wait complete. 2023-05-15T16:40:43.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7beea9640 1 Processor -- start 2023-05-15T16:40:43.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7beea9640 1 -- start start 2023-05-15T16:40:43.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7beea9640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7b8071a90 0x7fa7b81370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:43.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7beea9640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7b80b5330 0x7fa7b81e2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:43.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7beea9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7b8144e90 0x7fa7b813b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:43.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7beea9640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b8137600 con 0x7fa7b8144e90 2023-05-15T16:40:43.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7beea9640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b81e3e80 con 0x7fa7b8071a90 2023-05-15T16:40:43.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7beea9640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7b813b140 con 0x7fa7b80b5330 2023-05-15T16:40:43.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7bd446640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7b8144e90 0x7fa7b813b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:43.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7bd446640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7b8144e90 0x7fa7b813b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60578/0 (socket says 172.21.15.62:60578) 2023-05-15T16:40:43.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7bd446640 1 -- 172.21.15.62:0/404120704 learned_addr learned my addr 172.21.15.62:0/404120704 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:43.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7bcc45640 1 --2- 172.21.15.62:0/404120704 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7b8071a90 0x7fa7b81370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:43.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7b7fff640 1 --2- 172.21.15.62:0/404120704 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7b80b5330 0x7fa7b81e2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:43.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7bd446640 1 -- 172.21.15.62:0/404120704 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7b80b5330 msgr2=0x7fa7b81e2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:43.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7bd446640 1 --2- 172.21.15.62:0/404120704 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7b80b5330 0x7fa7b81e2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7bd446640 1 -- 172.21.15.62:0/404120704 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7b8071a90 msgr2=0x7fa7b81370c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:43.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7bd446640 1 --2- 172.21.15.62:0/404120704 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7b8071a90 0x7fa7b81370c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7bd446640 1 -- 172.21.15.62:0/404120704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b0009a70 con 0x7fa7b8144e90 2023-05-15T16:40:43.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7bd446640 1 --2- 172.21.15.62:0/404120704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7b8144e90 0x7fa7b813b5d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009d90 tx=0x7fa7b00196c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:43.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7b57fa640 1 -- 172.21.15.62:0/404120704 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0007000 con 0x7fa7b8144e90 2023-05-15T16:40:43.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7b57fa640 1 -- 172.21.15.62:0/404120704 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b00aede0 con 0x7fa7b8144e90 2023-05-15T16:40:43.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7beea9640 1 -- 172.21.15.62:0/404120704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7b80b2050 con 0x7fa7b8144e90 2023-05-15T16:40:43.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7b57fa640 1 -- 172.21.15.62:0/404120704 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b00b7650 con 0x7fa7b8144e90 2023-05-15T16:40:43.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7beea9640 1 -- 172.21.15.62:0/404120704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b80b1ec0 con 0x7fa7b8144e90 2023-05-15T16:40:43.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.303+0000 7fa7beea9640 1 -- 172.21.15.62:0/404120704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7b814b000 con 0x7fa7b8144e90 2023-05-15T16:40:43.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.307+0000 7fa7b57fa640 1 -- 172.21.15.62:0/404120704 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fa7b00b4050 con 0x7fa7b8144e90 2023-05-15T16:40:43.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.307+0000 7fa7b57fa640 1 --2- 172.21.15.62:0/404120704 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa7a40653b0 0x7fa7a4067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:43.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.307+0000 7fa7b57fa640 1 -- 172.21.15.62:0/404120704 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa7b011db70 con 0x7fa7b8144e90 2023-05-15T16:40:43.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.307+0000 7fa7bcc45640 1 --2- 172.21.15.62:0/404120704 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa7a40653b0 0x7fa7a4067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:43.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.307+0000 7fa7bcc45640 1 --2- 172.21.15.62:0/404120704 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa7a40653b0 0x7fa7a4067860 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8000f70 tx=0x7fa7a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:43.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.311+0000 7fa7b57fa640 1 -- 172.21.15.62:0/404120704 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fa7b00eb800 con 0x7fa7b8144e90 2023-05-15T16:40:43.469 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.467+0000 7fa7beea9640 1 -- 172.21.15.62:0/404120704 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa7b8067960 con 0x7fa7b8144e90 2023-05-15T16:40:43.472 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.467+0000 7fa7b57fa640 1 -- 172.21.15.62:0/404120704 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+17896 (secure 0 0 0) 0x7fa7b00b2090 con 0x7fa7b8144e90 2023-05-15T16:40:43.472 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:43.472 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":33,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:40:43.132586+0000","last_up_change":"2023-05-15T16:39:48.597049+0000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-15T16:39:49.394028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-15T16:39:55.208679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-15T16:40:41.013860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-15T16:40:42.121351+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37594},{"type":"v1","addr":"172.21.15.62:6825","nonce":37594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37594},{"type":"v1","addr":"172.21.15.62:6827","nonce":37594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37594},{"type":"v1","addr":"172.21.15.62:6831","nonce":37594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37594},{"type":"v1","addr":"172.21.15.62:6829","nonce":37594}]},"public_addr":"172.21.15.62:6825/37594","cluster_addr":"172.21.15.62:6827/37594","heartbeat_back_addr":"172.21.15.62:6831/37594","heartbeat_front_addr":"172.21.15.62:6829/37594","state":["exists","up"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37592},{"type":"v1","addr":"172.21.15.62:6808","nonce":37592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":37592},{"type":"v1","addr":"172.21.15.62:6814","nonce":37592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6821","nonce":37592},{"type":"v1","addr":"172.21.15.62:6823","nonce":37592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37592},{"type":"v1","addr":"172.21.15.62:6818","nonce":37592}]},"public_addr":"172.21.15.62:6808/37592","cluster_addr":"172.21.15.62:6814/37592","heartbeat_back_addr":"172.21.15.62:6823/37592","heartbeat_front_addr":"172.21.15.62:6818/37592","state":["exists","up"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":37591},{"type":"v1","addr":"172.21.15.62:6810","nonce":37591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":37591},{"type":"v1","addr":"172.21.15.62:6815","nonce":37591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37591},{"type":"v1","addr":"172.21.15.62:6822","nonce":37591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":37591},{"type":"v1","addr":"172.21.15.62:6819","nonce":37591}]},"public_addr":"172.21.15.62:6810/37591","cluster_addr":"172.21.15.62:6815/37591","heartbeat_back_addr":"172.21.15.62:6822/37591","heartbeat_front_addr":"172.21.15.62:6819/37591","state":["exists","up"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37593},{"type":"v1","addr":"172.21.15.62:6801","nonce":37593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37593},{"type":"v1","addr":"172.21.15.62:6803","nonce":37593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":37593},{"type":"v1","addr":"172.21.15.62:6812","nonce":37593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37593},{"type":"v1","addr":"172.21.15.62:6805","nonce":37593}]},"public_addr":"172.21.15.62:6801/37593","cluster_addr":"172.21.15.62:6803/37593","heartbeat_back_addr":"172.21.15.62:6812/37593","heartbeat_front_addr":"172.21.15.62:6805/37593","state":["exists","up"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37854},{"type":"v1","addr":"172.21.15.161:6801","nonce":37854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37854},{"type":"v1","addr":"172.21.15.161:6803","nonce":37854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37854},{"type":"v1","addr":"172.21.15.161:6807","nonce":37854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37854},{"type":"v1","addr":"172.21.15.161:6805","nonce":37854}]},"public_addr":"172.21.15.161:6801/37854","cluster_addr":"172.21.15.161:6803/37854","heartbeat_back_addr":"172.21.15.161:6807/37854","heartbeat_front_addr":"172.21.15.161:6805/37854","state":["exists","up"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37855},{"type":"v1","addr":"172.21.15.161:6810","nonce":37855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37855},{"type":"v1","addr":"172.21.15.161:6815","nonce":37855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37855},{"type":"v1","addr":"172.21.15.161:6824","nonce":37855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37855},{"type":"v1","addr":"172.21.15.161:6820","nonce":37855}]},"public_addr":"172.21.15.161:6810/37855","cluster_addr":"172.21.15.161:6815/37855","heartbeat_back_addr":"172.21.15.161:6824/37855","heartbeat_front_addr":"172.21.15.161:6820/37855","state":["exists","up"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":37856},{"type":"v1","addr":"172.21.15.161:6814","nonce":37856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37856},{"type":"v1","addr":"172.21.15.161:6819","nonce":37856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":37856},{"type":"v1","addr":"172.21.15.161:6830","nonce":37856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37856},{"type":"v1","addr":"172.21.15.161:6826","nonce":37856}]},"public_addr":"172.21.15.161:6814/37856","cluster_addr":"172.21.15.161:6819/37856","heartbeat_back_addr":"172.21.15.161:6830/37856","heartbeat_front_addr":"172.21.15.161:6826/37856","state":["exists","up"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":37857},{"type":"v1","addr":"172.21.15.161:6813","nonce":37857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":37857},{"type":"v1","addr":"172.21.15.161:6821","nonce":37857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":37857},{"type":"v1","addr":"172.21.15.161:6831","nonce":37857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":37857},{"type":"v1","addr":"172.21.15.161:6827","nonce":37857}]},"public_addr":"172.21.15.161:6813/37857","cluster_addr":"172.21.15.161:6821/37857","heartbeat_back_addr":"172.21.15.161:6831/37857","heartbeat_front_addr":"172.21.15.161:6827/37857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.592907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.618143+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.641533+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.614355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.579293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.718353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.730135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.792887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:40:43.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.471+0000 7fa7beea9640 1 -- 172.21.15.62:0/404120704 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa7a40653b0 msgr2=0x7fa7a4067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:43.474 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.471+0000 7fa7beea9640 1 --2- 172.21.15.62:0/404120704 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa7a40653b0 0x7fa7a4067860 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa7a8000f70 tx=0x7fa7a8009040 comp rx=0 tx=0).stop 2023-05-15T16:40:43.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.471+0000 7fa7beea9640 1 -- 172.21.15.62:0/404120704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7b8144e90 msgr2=0x7fa7b813b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:43.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.471+0000 7fa7beea9640 1 --2- 172.21.15.62:0/404120704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7b8144e90 0x7fa7b813b5d0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0009d90 tx=0x7fa7b00196c0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.471+0000 7fa7beea9640 1 -- 172.21.15.62:0/404120704 shutdown_connections 2023-05-15T16:40:43.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.471+0000 7fa7beea9640 1 --2- 172.21.15.62:0/404120704 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa7a40653b0 0x7fa7a4067860 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.471+0000 7fa7beea9640 1 --2- 172.21.15.62:0/404120704 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa7b8144e90 0x7fa7b813b5d0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.471+0000 7fa7beea9640 1 --2- 172.21.15.62:0/404120704 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa7b80b5330 0x7fa7b81e2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.475 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.471+0000 7fa7beea9640 1 --2- 172.21.15.62:0/404120704 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa7b8071a90 0x7fa7b81370c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.471+0000 7fa7beea9640 1 -- 172.21.15.62:0/404120704 >> 172.21.15.62:0/404120704 conn(0x7fa7b80653f0 msgr2=0x7fa7b80baae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:43.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.471+0000 7fa7beea9640 1 -- 172.21.15.62:0/404120704 shutdown_connections 2023-05-15T16:40:43.476 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.471+0000 7fa7beea9640 1 -- 172.21.15.62:0/404120704 wait complete. 2023-05-15T16:40:43.492 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-15T16:40:43.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.603+0000 7f65cf87e640 1 Processor -- start 2023-05-15T16:40:43.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.603+0000 7f65cf87e640 1 -- start start 2023-05-15T16:40:43.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.603+0000 7f65cf87e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c8147af0 0x7f65c80ba030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:43.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.603+0000 7f65cf87e640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f65c80b8950 0x7f65c80b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:43.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.603+0000 7f65cf87e640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65c8148950 con 0x7f65c81450d0 2023-05-15T16:40:43.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.603+0000 7f65cf87e640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65c80b5570 con 0x7f65c80b8950 2023-05-15T16:40:43.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.603+0000 7f65cf87e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c8070cd0 con 0x7f65c8147af0 2023-05-15T16:40:43.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.603+0000 7f65cde1b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f65c80b8950 0x7f65c80b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:43.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.603+0000 7f65cce19640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c8147af0 0x7f65c80ba030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:43.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.603+0000 7f65cd61a640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f65c81450d0 0x7f65c80705c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.62:60606/0 (socket says 172.21.15.62:60606) 2023-05-15T16:40:43.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.603+0000 7f65cd61a640 1 -- 172.21.15.62:0/2735829894 learned_addr learned my addr 172.21.15.62:0/2735829894 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:43.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.603+0000 7f65cde1b640 1 -- 172.21.15.62:0/2735829894 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c8147af0 msgr2=0x7f65c80ba030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:43.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.603+0000 7f65cde1b640 1 --2- 172.21.15.62:0/2735829894 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c8147af0 0x7f65c80ba030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.603+0000 7f65cde1b640 1 -- 172.21.15.62:0/2735829894 >> v1:172.21.15.161:6789/0 conn(0x7f65c81450d0 legacy=0x7f65c80705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:43.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.603+0000 7f65cde1b640 1 -- 172.21.15.62:0/2735829894 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65c80b92e0 con 0x7f65c80b8950 2023-05-15T16:40:43.609 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.603+0000 7f65bffff640 1 -- 172.21.15.62:0/2735829894 <== mon.1 v1:172.21.15.161:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2517479136 0 0) 0x7f65c8148950 con 0x7f65c81450d0 2023-05-15T16:40:43.610 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.603+0000 7f65cce19640 1 --2- 172.21.15.62:0/2735829894 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c8147af0 0x7f65c80ba030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-05-15T16:40:43.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.607+0000 7f65cde1b640 1 --2- 172.21.15.62:0/2735829894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c80b8950 0x7f65c80b8da0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f65c0009d90 tx=0x7f65c001c890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4b719936f07ac4a server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:43.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.607+0000 7f65bffff640 1 -- 172.21.15.62:0/2735829894 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c00a5950 con 0x7f65c80b8950 2023-05-15T16:40:43.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.607+0000 7f65bffff640 1 -- 172.21.15.62:0/2735829894 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65c00a5ab0 con 0x7f65c80b8950 2023-05-15T16:40:43.611 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.607+0000 7f65bffff640 1 -- 172.21.15.62:0/2735829894 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65c00a5e40 con 0x7f65c80b8950 2023-05-15T16:40:43.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.607+0000 7f65cf87e640 1 -- 172.21.15.62:0/2735829894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c80b8950 msgr2=0x7f65c80b8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:43.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.607+0000 7f65cf87e640 1 --2- 172.21.15.62:0/2735829894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c80b8950 0x7f65c80b8da0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f65c0009d90 tx=0x7f65c001c890 comp rx=0 tx=0).stop 2023-05-15T16:40:43.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.607+0000 7f65cf87e640 1 -- 172.21.15.62:0/2735829894 shutdown_connections 2023-05-15T16:40:43.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.607+0000 7f65cf87e640 1 --2- 172.21.15.62:0/2735829894 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c80b8950 0x7f65c80b8da0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.612 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.607+0000 7f65cf87e640 1 --2- 172.21.15.62:0/2735829894 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c8147af0 0x7f65c80ba030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.607+0000 7f65cf87e640 1 -- 172.21.15.62:0/2735829894 >> 172.21.15.62:0/2735829894 conn(0x7f65c80bde20 msgr2=0x7f65c80be220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:43.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.607+0000 7f65cf87e640 1 -- 172.21.15.62:0/2735829894 shutdown_connections 2023-05-15T16:40:43.613 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.607+0000 7f65cf87e640 1 -- 172.21.15.62:0/2735829894 wait complete. 2023-05-15T16:40:43.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.607+0000 7f65cf87e640 1 Processor -- start 2023-05-15T16:40:43.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.607+0000 7f65cf87e640 1 -- start start 2023-05-15T16:40:43.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65cf87e640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80b8950 0x7f65c80b7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:43.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65cf87e640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65c81450d0 0x7f65c814d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:43.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65cf87e640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c8147af0 0x7f65c81e2060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:43.615 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65cf87e640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c80b7d40 con 0x7f65c81450d0 2023-05-15T16:40:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65cf87e640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65c814e110 con 0x7f65c8147af0 2023-05-15T16:40:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65cf87e640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65c80bd1e0 con 0x7f65c80b8950 2023-05-15T16:40:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65cce19640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65c81450d0 0x7f65c814d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65cce19640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65c81450d0 0x7f65c814d740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60586/0 (socket says 172.21.15.62:60586) 2023-05-15T16:40:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65cce19640 1 -- 172.21.15.62:0/2993312732 learned_addr learned my addr 172.21.15.62:0/2993312732 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65cde1b640 1 --2- 172.21.15.62:0/2993312732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c8147af0 0x7f65c81e2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:43.616 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65cd61a640 1 --2- 172.21.15.62:0/2993312732 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80b8950 0x7f65c80b7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:43.617 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65cce19640 1 -- 172.21.15.62:0/2993312732 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80b8950 msgr2=0x7f65c80b7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:43.617 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65cce19640 1 --2- 172.21.15.62:0/2993312732 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80b8950 0x7f65c80b7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.617 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65cce19640 1 -- 172.21.15.62:0/2993312732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c8147af0 msgr2=0x7f65c81e2060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:43.617 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65cce19640 1 --2- 172.21.15.62:0/2993312732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c8147af0 0x7f65c81e2060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.617 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65cce19640 1 -- 172.21.15.62:0/2993312732 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65b8009420 con 0x7f65c81450d0 2023-05-15T16:40:43.617 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65cce19640 1 --2- 172.21.15.62:0/2993312732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65c81450d0 0x7f65c814d740 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f65b800e980 tx=0x7f65b800ee40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:43.617 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65bdffb640 1 -- 172.21.15.62:0/2993312732 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b800ca00 con 0x7f65c81450d0 2023-05-15T16:40:43.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65cf87e640 1 -- 172.21.15.62:0/2993312732 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65c0009a70 con 0x7f65c81450d0 2023-05-15T16:40:43.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65bdffb640 1 -- 172.21.15.62:0/2993312732 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b800cb60 con 0x7f65c81450d0 2023-05-15T16:40:43.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65bdffb640 1 -- 172.21.15.62:0/2993312732 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65b8013470 con 0x7f65c81450d0 2023-05-15T16:40:43.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65cf87e640 1 -- 172.21.15.62:0/2993312732 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65c806ce50 con 0x7f65c81450d0 2023-05-15T16:40:43.618 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65cf87e640 1 -- 172.21.15.62:0/2993312732 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65c81485e0 con 0x7f65c81450d0 2023-05-15T16:40:43.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65bdffb640 1 -- 172.21.15.62:0/2993312732 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f65b80135d0 con 0x7f65c81450d0 2023-05-15T16:40:43.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65bdffb640 1 --2- 172.21.15.62:0/2993312732 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f65ac065380 0x7f65ac067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:43.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65bdffb640 1 -- 172.21.15.62:0/2993312732 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f65b8082b60 con 0x7f65c81450d0 2023-05-15T16:40:43.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.611+0000 7f65cd61a640 1 --2- 172.21.15.62:0/2993312732 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f65ac065380 0x7f65ac067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:43.619 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.615+0000 7f65cd61a640 1 --2- 172.21.15.62:0/2993312732 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f65ac065380 0x7f65ac067830 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f65c4000f70 tx=0x7f65c4007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:43.620 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.615+0000 7f65bdffb640 1 -- 172.21.15.62:0/2993312732 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f65b8050700 con 0x7f65c81450d0 2023-05-15T16:40:43.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.767+0000 7f65cf87e640 1 -- 172.21.15.62:0/2993312732 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65c81454a0 con 0x7f65c81450d0 2023-05-15T16:40:43.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.771+0000 7f65bdffb640 1 -- 172.21.15.62:0/2993312732 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+17896 (secure 0 0 0) 0x7f65b8053d20 con 0x7f65c81450d0 2023-05-15T16:40:43.776 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:43.776 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":33,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:40:43.132586+0000","last_up_change":"2023-05-15T16:39:48.597049+0000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-15T16:39:49.394028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-15T16:39:55.208679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-15T16:40:41.013860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-15T16:40:42.121351+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37594},{"type":"v1","addr":"172.21.15.62:6825","nonce":37594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37594},{"type":"v1","addr":"172.21.15.62:6827","nonce":37594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37594},{"type":"v1","addr":"172.21.15.62:6831","nonce":37594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37594},{"type":"v1","addr":"172.21.15.62:6829","nonce":37594}]},"public_addr":"172.21.15.62:6825/37594","cluster_addr":"172.21.15.62:6827/37594","heartbeat_back_addr":"172.21.15.62:6831/37594","heartbeat_front_addr":"172.21.15.62:6829/37594","state":["exists","up"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37592},{"type":"v1","addr":"172.21.15.62:6808","nonce":37592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":37592},{"type":"v1","addr":"172.21.15.62:6814","nonce":37592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6821","nonce":37592},{"type":"v1","addr":"172.21.15.62:6823","nonce":37592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37592},{"type":"v1","addr":"172.21.15.62:6818","nonce":37592}]},"public_addr":"172.21.15.62:6808/37592","cluster_addr":"172.21.15.62:6814/37592","heartbeat_back_addr":"172.21.15.62:6823/37592","heartbeat_front_addr":"172.21.15.62:6818/37592","state":["exists","up"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":37591},{"type":"v1","addr":"172.21.15.62:6810","nonce":37591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":37591},{"type":"v1","addr":"172.21.15.62:6815","nonce":37591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37591},{"type":"v1","addr":"172.21.15.62:6822","nonce":37591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":37591},{"type":"v1","addr":"172.21.15.62:6819","nonce":37591}]},"public_addr":"172.21.15.62:6810/37591","cluster_addr":"172.21.15.62:6815/37591","heartbeat_back_addr":"172.21.15.62:6822/37591","heartbeat_front_addr":"172.21.15.62:6819/37591","state":["exists","up"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37593},{"type":"v1","addr":"172.21.15.62:6801","nonce":37593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37593},{"type":"v1","addr":"172.21.15.62:6803","nonce":37593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":37593},{"type":"v1","addr":"172.21.15.62:6812","nonce":37593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37593},{"type":"v1","addr":"172.21.15.62:6805","nonce":37593}]},"public_addr":"172.21.15.62:6801/37593","cluster_addr":"172.21.15.62:6803/37593","heartbeat_back_addr":"172.21.15.62:6812/37593","heartbeat_front_addr":"172.21.15.62:6805/37593","state":["exists","up"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37854},{"type":"v1","addr":"172.21.15.161:6801","nonce":37854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37854},{"type":"v1","addr":"172.21.15.161:6803","nonce":37854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37854},{"type":"v1","addr":"172.21.15.161:6807","nonce":37854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37854},{"type":"v1","addr":"172.21.15.161:6805","nonce":37854}]},"public_addr":"172.21.15.161:6801/37854","cluster_addr":"172.21.15.161:6803/37854","heartbeat_back_addr":"172.21.15.161:6807/37854","heartbeat_front_addr":"172.21.15.161:6805/37854","state":["exists","up"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37855},{"type":"v1","addr":"172.21.15.161:6810","nonce":37855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37855},{"type":"v1","addr":"172.21.15.161:6815","nonce":37855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37855},{"type":"v1","addr":"172.21.15.161:6824","nonce":37855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37855},{"type":"v1","addr":"172.21.15.161:6820","nonce":37855}]},"public_addr":"172.21.15.161:6810/37855","cluster_addr":"172.21.15.161:6815/37855","heartbeat_back_addr":"172.21.15.161:6824/37855","heartbeat_front_addr":"172.21.15.161:6820/37855","state":["exists","up"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":37856},{"type":"v1","addr":"172.21.15.161:6814","nonce":37856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37856},{"type":"v1","addr":"172.21.15.161:6819","nonce":37856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":37856},{"type":"v1","addr":"172.21.15.161:6830","nonce":37856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37856},{"type":"v1","addr":"172.21.15.161:6826","nonce":37856}]},"public_addr":"172.21.15.161:6814/37856","cluster_addr":"172.21.15.161:6819/37856","heartbeat_back_addr":"172.21.15.161:6830/37856","heartbeat_front_addr":"172.21.15.161:6826/37856","state":["exists","up"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":37857},{"type":"v1","addr":"172.21.15.161:6813","nonce":37857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":37857},{"type":"v1","addr":"172.21.15.161:6821","nonce":37857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":37857},{"type":"v1","addr":"172.21.15.161:6831","nonce":37857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":37857},{"type":"v1","addr":"172.21.15.161:6827","nonce":37857}]},"public_addr":"172.21.15.161:6813/37857","cluster_addr":"172.21.15.161:6821/37857","heartbeat_back_addr":"172.21.15.161:6831/37857","heartbeat_front_addr":"172.21.15.161:6827/37857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.592907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.618143+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.641533+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.614355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.579293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.718353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.730135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.792887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:40:43.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.775+0000 7f65cf87e640 1 -- 172.21.15.62:0/2993312732 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f65ac065380 msgr2=0x7f65ac067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:43.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.775+0000 7f65cf87e640 1 --2- 172.21.15.62:0/2993312732 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f65ac065380 0x7f65ac067830 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f65c4000f70 tx=0x7f65c4007b60 comp rx=0 tx=0).stop 2023-05-15T16:40:43.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.775+0000 7f65cf87e640 1 -- 172.21.15.62:0/2993312732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65c81450d0 msgr2=0x7f65c814d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:43.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.775+0000 7f65cf87e640 1 --2- 172.21.15.62:0/2993312732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65c81450d0 0x7f65c814d740 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f65b800e980 tx=0x7f65b800ee40 comp rx=0 tx=0).stop 2023-05-15T16:40:43.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.775+0000 7f65cf87e640 1 -- 172.21.15.62:0/2993312732 shutdown_connections 2023-05-15T16:40:43.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.775+0000 7f65cf87e640 1 --2- 172.21.15.62:0/2993312732 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f65c8147af0 0x7f65c81e2060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.775+0000 7f65cf87e640 1 --2- 172.21.15.62:0/2993312732 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f65ac065380 0x7f65ac067830 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.775+0000 7f65cf87e640 1 --2- 172.21.15.62:0/2993312732 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f65c81450d0 0x7f65c814d740 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.775+0000 7f65cf87e640 1 --2- 172.21.15.62:0/2993312732 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f65c80b8950 0x7f65c80b7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.775+0000 7f65cf87e640 1 -- 172.21.15.62:0/2993312732 >> 172.21.15.62:0/2993312732 conn(0x7f65c80bde20 msgr2=0x7f65c806d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:43.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.775+0000 7f65cf87e640 1 -- 172.21.15.62:0/2993312732 shutdown_connections 2023-05-15T16:40:43.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.775+0000 7f65cf87e640 1 -- 172.21.15.62:0/2993312732 wait complete. 2023-05-15T16:40:43.793 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-05-15T16:40:43.909 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.903+0000 7fcf9af4f640 1 Processor -- start 2023-05-15T16:40:43.910 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.907+0000 7fcf9af4f640 1 -- start start 2023-05-15T16:40:43.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.907+0000 7fcf9af4f640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcf940bcfa0 0x7fcf94146db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:43.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.907+0000 7fcf9af4f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf9414a380 0x7fcf941544d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:43.912 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.907+0000 7fcf9af4f640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf9406b100 con 0x7fcf941472f0 2023-05-15T16:40:43.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.907+0000 7fcf9af4f640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf940bad50 con 0x7fcf940bcfa0 2023-05-15T16:40:43.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.907+0000 7fcf9af4f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf94147720 con 0x7fcf9414a380 2023-05-15T16:40:43.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.907+0000 7fcf98ceb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcf940bcfa0 0x7fcf94146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:43.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.907+0000 7fcf98ceb640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcf940bcfa0 0x7fcf94146db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60596/0 (socket says 172.21.15.62:60596) 2023-05-15T16:40:43.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.907+0000 7fcf98ceb640 1 -- 172.21.15.62:0/1818220698 learned_addr learned my addr 172.21.15.62:0/1818220698 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:43.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.907+0000 7fcf994ec640 1 --2- 172.21.15.62:0/1818220698 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf9414a380 0x7fcf941544d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:43.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.907+0000 7fcf98ceb640 1 -- 172.21.15.62:0/1818220698 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf9414a380 msgr2=0x7fcf941544d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:43.913 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.907+0000 7fcf98ceb640 1 --2- 172.21.15.62:0/1818220698 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf9414a380 0x7fcf941544d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.907+0000 7fcf98ceb640 1 -- 172.21.15.62:0/1818220698 >> v1:172.21.15.161:6789/0 conn(0x7fcf941472f0 legacy=0x7fcf94149c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:43.914 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.907+0000 7fcf98ceb640 1 -- 172.21.15.62:0/1818220698 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf9406b3a0 con 0x7fcf940bcfa0 2023-05-15T16:40:43.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.907+0000 7fcf98ceb640 1 --2- 172.21.15.62:0/1818220698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf940bcfa0 0x7fcf94146db0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009870 tx=0x7fcf8801c440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54956b696929665b server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:43.919 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf937fe640 1 -- 172.21.15.62:0/1818220698 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf880ab600 con 0x7fcf940bcfa0 2023-05-15T16:40:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf937fe640 1 -- 172.21.15.62:0/1818220698 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf880ab760 con 0x7fcf940bcfa0 2023-05-15T16:40:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf937fe640 1 -- 172.21.15.62:0/1818220698 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf880abaf0 con 0x7fcf940bcfa0 2023-05-15T16:40:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf9af4f640 1 -- 172.21.15.62:0/1818220698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf940bcfa0 msgr2=0x7fcf94146db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf9af4f640 1 --2- 172.21.15.62:0/1818220698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf940bcfa0 0x7fcf94146db0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fcf88009870 tx=0x7fcf8801c440 comp rx=0 tx=0).stop 2023-05-15T16:40:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf9af4f640 1 -- 172.21.15.62:0/1818220698 shutdown_connections 2023-05-15T16:40:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf9af4f640 1 --2- 172.21.15.62:0/1818220698 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf9414a380 0x7fcf941544d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.920 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf9af4f640 1 --2- 172.21.15.62:0/1818220698 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf940bcfa0 0x7fcf94146db0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf9af4f640 1 -- 172.21.15.62:0/1818220698 >> 172.21.15.62:0/1818220698 conn(0x7fcf940bff80 msgr2=0x7fcf940c0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf9af4f640 1 -- 172.21.15.62:0/1818220698 shutdown_connections 2023-05-15T16:40:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf9af4f640 1 -- 172.21.15.62:0/1818220698 wait complete. 2023-05-15T16:40:43.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf9af4f640 1 Processor -- start 2023-05-15T16:40:43.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf9af4f640 1 -- start start 2023-05-15T16:40:43.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf9af4f640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf940bcfa0 0x7fcf940b7380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:43.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf9af4f640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf941472f0 0x7fcf940b91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:43.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf9af4f640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf9414a380 0x7fcf940b96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:43.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf9af4f640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9413f730 con 0x7fcf9414a380 2023-05-15T16:40:43.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf9af4f640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf9413e930 con 0x7fcf941472f0 2023-05-15T16:40:43.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf9af4f640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf940ba0d0 con 0x7fcf940bcfa0 2023-05-15T16:40:43.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf994ec640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf9414a380 0x7fcf940b96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:43.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf994ec640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf9414a380 0x7fcf940b96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60608/0 (socket says 172.21.15.62:60608) 2023-05-15T16:40:43.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf994ec640 1 -- 172.21.15.62:0/1695462468 learned_addr learned my addr 172.21.15.62:0/1695462468 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:43.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf93fff640 1 --2- 172.21.15.62:0/1695462468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf941472f0 0x7fcf940b91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:43.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf98ceb640 1 --2- 172.21.15.62:0/1695462468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf940bcfa0 0x7fcf940b7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:43.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf994ec640 1 -- 172.21.15.62:0/1695462468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf940bcfa0 msgr2=0x7fcf940b7380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:43.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf994ec640 1 --2- 172.21.15.62:0/1695462468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf940bcfa0 0x7fcf940b7380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf994ec640 1 -- 172.21.15.62:0/1695462468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf941472f0 msgr2=0x7fcf940b91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:43.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf994ec640 1 --2- 172.21.15.62:0/1695462468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf941472f0 0x7fcf940b91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:43.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf994ec640 1 -- 172.21.15.62:0/1695462468 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf880094d0 con 0x7fcf9414a380 2023-05-15T16:40:43.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf98ceb640 1 --2- 172.21.15.62:0/1695462468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf940bcfa0 0x7fcf940b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:43.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf994ec640 1 --2- 172.21.15.62:0/1695462468 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf9414a380 0x7fcf940b96e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00cd70 tx=0x7fcf8c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:43.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf917fa640 1 -- 172.21.15.62:0/1695462468 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c003ba0 con 0x7fcf9414a380 2023-05-15T16:40:43.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf917fa640 1 -- 172.21.15.62:0/1695462468 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf8c003d00 con 0x7fcf9414a380 2023-05-15T16:40:43.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf9af4f640 1 -- 172.21.15.62:0/1695462468 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf940b6d30 con 0x7fcf9414a380 2023-05-15T16:40:43.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf917fa640 1 -- 172.21.15.62:0/1695462468 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf8c004240 con 0x7fcf9414a380 2023-05-15T16:40:43.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.911+0000 7fcf9af4f640 1 -- 172.21.15.62:0/1695462468 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf940bd4a0 con 0x7fcf9414a380 2023-05-15T16:40:43.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.915+0000 7fcf9af4f640 1 -- 172.21.15.62:0/1695462468 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf94069b30 con 0x7fcf9414a380 2023-05-15T16:40:43.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.915+0000 7fcf917fa640 1 -- 172.21.15.62:0/1695462468 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fcf8c0043a0 con 0x7fcf9414a380 2023-05-15T16:40:43.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.915+0000 7fcf917fa640 1 --2- 172.21.15.62:0/1695462468 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcf78065380 0x7fcf78067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:43.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.915+0000 7fcf917fa640 1 -- 172.21.15.62:0/1695462468 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcf8c012070 con 0x7fcf9414a380 2023-05-15T16:40:43.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.915+0000 7fcf98ceb640 1 --2- 172.21.15.62:0/1695462468 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcf78065380 0x7fcf78067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:43.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.915+0000 7fcf98ceb640 1 --2- 172.21.15.62:0/1695462468 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcf78065380 0x7fcf78067830 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcf880af000 tx=0x7fcf88008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:43.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:43.919+0000 7fcf917fa640 1 -- 172.21.15.62:0/1695462468 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fcf8c050f60 con 0x7fcf9414a380 2023-05-15T16:40:44.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.099+0000 7fcf9af4f640 1 -- 172.21.15.62:0/1695462468 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcf940b9ea0 con 0x7fcf9414a380 2023-05-15T16:40:44.152 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.147+0000 7fcf917fa640 1 -- 172.21.15.62:0/1695462468 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcf8c054580 con 0x7fcf9414a380 2023-05-15T16:40:44.154 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.151+0000 7fcf9af4f640 1 -- 172.21.15.62:0/1695462468 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcf78065380 msgr2=0x7fcf78067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:44.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.151+0000 7fcf9af4f640 1 --2- 172.21.15.62:0/1695462468 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcf78065380 0x7fcf78067830 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fcf880af000 tx=0x7fcf88008040 comp rx=0 tx=0).stop 2023-05-15T16:40:44.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.151+0000 7fcf9af4f640 1 -- 172.21.15.62:0/1695462468 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf9414a380 msgr2=0x7fcf940b96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:44.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.151+0000 7fcf9af4f640 1 --2- 172.21.15.62:0/1695462468 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf9414a380 0x7fcf940b96e0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fcf8c00cd70 tx=0x7fcf8c00a660 comp rx=0 tx=0).stop 2023-05-15T16:40:44.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.151+0000 7fcf9af4f640 1 -- 172.21.15.62:0/1695462468 shutdown_connections 2023-05-15T16:40:44.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.151+0000 7fcf9af4f640 1 --2- 172.21.15.62:0/1695462468 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcf78065380 0x7fcf78067830 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:44.155 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.151+0000 7fcf9af4f640 1 --2- 172.21.15.62:0/1695462468 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcf9414a380 0x7fcf940b96e0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:44.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.151+0000 7fcf9af4f640 1 --2- 172.21.15.62:0/1695462468 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcf941472f0 0x7fcf940b91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:44.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.151+0000 7fcf9af4f640 1 --2- 172.21.15.62:0/1695462468 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcf940bcfa0 0x7fcf940b7380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:44.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.151+0000 7fcf9af4f640 1 -- 172.21.15.62:0/1695462468 >> 172.21.15.62:0/1695462468 conn(0x7fcf940bff80 msgr2=0x7fcf941436e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:44.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.151+0000 7fcf9af4f640 1 -- 172.21.15.62:0/1695462468 shutdown_connections 2023-05-15T16:40:44.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.151+0000 7fcf9af4f640 1 -- 172.21.15.62:0/1695462468 wait complete. 2023-05-15T16:40:44.171 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-05-15T16:40:44.171 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-05-15T16:40:44.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.279+0000 7f974ccb8640 1 Processor -- start 2023-05-15T16:40:44.285 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.279+0000 7f974ccb8640 1 -- start start 2023-05-15T16:40:44.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.283+0000 7f974ccb8640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f97480b4100 0x7f97480b38a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:44.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.283+0000 7f974ccb8640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f9748147c30 0x7f9748148030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:44.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.283+0000 7f974ccb8640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97480b7400 con 0x7f97480b3080 2023-05-15T16:40:44.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.283+0000 7f974ccb8640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97480b4e70 con 0x7f9748147c30 2023-05-15T16:40:44.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.283+0000 7f974ccb8640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9748142380 con 0x7f97480b4100 2023-05-15T16:40:44.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.283+0000 7f973ffff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f97480b3080 0x7f9748141c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:58098/0 (socket says 172.21.15.62:58098) 2023-05-15T16:40:44.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.283+0000 7f973ffff640 1 -- 172.21.15.62:0/2349142948 learned_addr learned my addr 172.21.15.62:0/2349142948 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:44.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.283+0000 7f9746d9d640 1 --2- 172.21.15.62:0/2349142948 >> v2:172.21.15.62:3300/0 conn(0x7f9748147c30 0x7f9748148030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:44.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.283+0000 7f974659c640 1 --2- 172.21.15.62:0/2349142948 >> v2:172.21.15.161:3300/0 conn(0x7f97480b4100 0x7f97480b38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:44.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.283+0000 7f9746d9d640 1 -- 172.21.15.62:0/2349142948 >> v2:172.21.15.161:3300/0 conn(0x7f97480b4100 msgr2=0x7f97480b38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:44.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.283+0000 7f9746d9d640 1 --2- 172.21.15.62:0/2349142948 >> v2:172.21.15.161:3300/0 conn(0x7f97480b4100 0x7f97480b38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:44.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.283+0000 7f9746d9d640 1 -- 172.21.15.62:0/2349142948 >> v1:172.21.15.62:6789/0 conn(0x7f97480b3080 legacy=0x7f9748141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:44.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.283+0000 7f9745d9b640 1 -- 172.21.15.62:0/2349142948 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399274059 0 0) 0x7f97480b7400 con 0x7f97480b3080 2023-05-15T16:40:44.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.283+0000 7f9746d9d640 1 -- 172.21.15.62:0/2349142948 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97480b6640 con 0x7f9748147c30 2023-05-15T16:40:44.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.283+0000 7f9746d9d640 1 --2- 172.21.15.62:0/2349142948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9748147c30 0x7f9748148030 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f97480b2e90 tx=0x7f974001c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=915f5c39d1c4b76d server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:44.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f9745d9b640 1 -- 172.21.15.62:0/2349142948 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97400a59a0 con 0x7f9748147c30 2023-05-15T16:40:44.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f9745d9b640 1 -- 172.21.15.62:0/2349142948 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97400a5b00 con 0x7f9748147c30 2023-05-15T16:40:44.289 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f9745d9b640 1 -- 172.21.15.62:0/2349142948 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97400a5e90 con 0x7f9748147c30 2023-05-15T16:40:44.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974ccb8640 1 -- 172.21.15.62:0/2349142948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9748147c30 msgr2=0x7f9748148030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:44.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974ccb8640 1 --2- 172.21.15.62:0/2349142948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9748147c30 0x7f9748148030 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f97480b2e90 tx=0x7f974001c8e0 comp rx=0 tx=0).stop 2023-05-15T16:40:44.290 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974ccb8640 1 -- 172.21.15.62:0/2349142948 shutdown_connections 2023-05-15T16:40:44.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974ccb8640 1 --2- 172.21.15.62:0/2349142948 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f9748147c30 0x7f9748148030 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:44.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974ccb8640 1 --2- 172.21.15.62:0/2349142948 >> v2:172.21.15.161:3300/0 conn(0x7f97480b4100 0x7f97480b38a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:44.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974ccb8640 1 -- 172.21.15.62:0/2349142948 >> 172.21.15.62:0/2349142948 conn(0x7f97480697b0 msgr2=0x7f9748069bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:44.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974ccb8640 1 -- 172.21.15.62:0/2349142948 shutdown_connections 2023-05-15T16:40:44.291 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974ccb8640 1 -- 172.21.15.62:0/2349142948 wait complete. 2023-05-15T16:40:44.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974ccb8640 1 Processor -- start 2023-05-15T16:40:44.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974ccb8640 1 -- start start 2023-05-15T16:40:44.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974ccb8640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97480b3080 0x7f97481463a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:44.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974ccb8640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97480b4100 0x7f974806f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:44.293 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974ccb8640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9748147c30 0x7f97481e5310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:44.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974ccb8640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97481468e0 con 0x7f97480b3080 2023-05-15T16:40:44.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974ccb8640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9748070640 con 0x7f97480b4100 2023-05-15T16:40:44.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974ccb8640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9748070920 con 0x7f9748147c30 2023-05-15T16:40:44.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974659c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97480b3080 0x7f97481463a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:44.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974659c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97480b3080 0x7f97481463a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:60632/0 (socket says 172.21.15.62:60632) 2023-05-15T16:40:44.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974659c640 1 -- 172.21.15.62:0/1180422301 learned_addr learned my addr 172.21.15.62:0/1180422301 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:44.294 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f973ffff640 1 --2- 172.21.15.62:0/1180422301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97480b4100 0x7f974806f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:44.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f9746d9d640 1 --2- 172.21.15.62:0/1180422301 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9748147c30 0x7f97481e5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:44.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974659c640 1 -- 172.21.15.62:0/1180422301 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9748147c30 msgr2=0x7f97481e5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:44.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974659c640 1 --2- 172.21.15.62:0/1180422301 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9748147c30 0x7f97481e5310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:44.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974659c640 1 -- 172.21.15.62:0/1180422301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97480b4100 msgr2=0x7f974806f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:44.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974659c640 1 --2- 172.21.15.62:0/1180422301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97480b4100 0x7f974806f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:44.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974659c640 1 -- 172.21.15.62:0/1180422301 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9740009a70 con 0x7f97480b3080 2023-05-15T16:40:44.295 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974659c640 1 --2- 172.21.15.62:0/1180422301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97480b3080 0x7f97481463a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f973800d800 tx=0x7f973800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:44.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f973effd640 1 -- 172.21.15.62:0/1180422301 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973800b6c0 con 0x7f97480b3080 2023-05-15T16:40:44.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f973effd640 1 -- 172.21.15.62:0/1180422301 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973800b820 con 0x7f97480b3080 2023-05-15T16:40:44.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974ccb8640 1 -- 172.21.15.62:0/1180422301 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97480b44d0 con 0x7f97480b3080 2023-05-15T16:40:44.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f973effd640 1 -- 172.21.15.62:0/1180422301 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973800bb90 con 0x7f97480b3080 2023-05-15T16:40:44.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974ccb8640 1 -- 172.21.15.62:0/1180422301 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97480b6ee0 con 0x7f97480b3080 2023-05-15T16:40:44.296 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.287+0000 7f974ccb8640 1 -- 172.21.15.62:0/1180422301 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97480a1dc0 con 0x7f97480b3080 2023-05-15T16:40:44.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.291+0000 7f973effd640 1 -- 172.21.15.62:0/1180422301 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f973800bcf0 con 0x7f97480b3080 2023-05-15T16:40:44.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.291+0000 7f973effd640 1 --2- 172.21.15.62:0/1180422301 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9728065380 0x7f9728067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:44.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.291+0000 7f973effd640 1 -- 172.21.15.62:0/1180422301 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f9738082d30 con 0x7f97480b3080 2023-05-15T16:40:44.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.291+0000 7f973ffff640 1 --2- 172.21.15.62:0/1180422301 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9728065380 0x7f9728067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:44.297 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.291+0000 7f973ffff640 1 --2- 172.21.15.62:0/1180422301 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9728065380 0x7f9728067830 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9748146b90 tx=0x7f9730009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:44.298 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.295+0000 7f973effd640 1 -- 172.21.15.62:0/1180422301 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f9738054470 con 0x7f97480b3080 2023-05-15T16:40:44.486 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:44.483+0000 7f974ccb8640 1 -- 172.21.15.62:0/1180422301 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9748067960 con 0x7f97480b3080 2023-05-15T16:40:45.156 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.151+0000 7f973effd640 1 -- 172.21.15.62:0/1180422301 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9738054060 con 0x7f97480b3080 2023-05-15T16:40:45.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.155+0000 7f974ccb8640 1 -- 172.21.15.62:0/1180422301 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9728065380 msgr2=0x7f9728067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:45.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.155+0000 7f974ccb8640 1 --2- 172.21.15.62:0/1180422301 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9728065380 0x7f9728067830 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9748146b90 tx=0x7f9730009040 comp rx=0 tx=0).stop 2023-05-15T16:40:45.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.155+0000 7f974ccb8640 1 -- 172.21.15.62:0/1180422301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97480b3080 msgr2=0x7f97481463a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:45.159 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.155+0000 7f974ccb8640 1 --2- 172.21.15.62:0/1180422301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97480b3080 0x7f97481463a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f973800d800 tx=0x7f973800dcc0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.155+0000 7f974ccb8640 1 -- 172.21.15.62:0/1180422301 shutdown_connections 2023-05-15T16:40:45.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.155+0000 7f974ccb8640 1 --2- 172.21.15.62:0/1180422301 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f9748147c30 0x7f97481e5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.155+0000 7f974ccb8640 1 --2- 172.21.15.62:0/1180422301 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f97480b4100 0x7f974806f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.155+0000 7f974ccb8640 1 --2- 172.21.15.62:0/1180422301 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f9728065380 0x7f9728067830 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.155+0000 7f974ccb8640 1 --2- 172.21.15.62:0/1180422301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f97480b3080 0x7f97481463a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.160 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.155+0000 7f974ccb8640 1 -- 172.21.15.62:0/1180422301 >> 172.21.15.62:0/1180422301 conn(0x7f97480697b0 msgr2=0x7f9748151d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:45.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.155+0000 7f974ccb8640 1 -- 172.21.15.62:0/1180422301 shutdown_connections 2023-05-15T16:40:45.161 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.155+0000 7f974ccb8640 1 -- 172.21.15.62:0/1180422301 wait complete. 2023-05-15T16:40:45.181 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-05-15T16:40:45.181 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-15T16:40:45.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.307+0000 7f23ddf51640 1 Processor -- start 2023-05-15T16:40:45.309 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.307+0000 7f23ddf51640 1 -- start start 2023-05-15T16:40:45.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.307+0000 7f23ddf51640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f23d80b5330 0x7f23d80b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:45.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.307+0000 7f23ddf51640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d80716b0 con 0x7f23d8071a90 2023-05-15T16:40:45.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.307+0000 7f23ddf51640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23d80afa90 con 0x7f23d8144e90 2023-05-15T16:40:45.310 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.307+0000 7f23ddf51640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23d80b2280 con 0x7f23d80b5330 2023-05-15T16:40:45.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.307+0000 7f23d77fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f23d80b5330 0x7f23d80b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:45.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.307+0000 7f23d6ffd640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f23d8071a90 0x7f23d80b16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39250/0 (socket says 172.21.15.62:39250) 2023-05-15T16:40:45.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.307+0000 7f23d6ffd640 1 -- 172.21.15.62:0/1248015301 learned_addr learned my addr 172.21.15.62:0/1248015301 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:45.311 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.307+0000 7f23d67fc640 1 -- 172.21.15.62:0/1248015301 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 925186519 0 0) 0x7f23d80716b0 con 0x7f23d8071a90 2023-05-15T16:40:45.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.307+0000 7f23d67fc640 1 -- 172.21.15.62:0/1248015301 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23c4003530 con 0x7f23d8071a90 2023-05-15T16:40:45.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.307+0000 7f23d77fe640 1 -- 172.21.15.62:0/1248015301 >> v1:172.21.15.161:6789/0 conn(0x7f23d8144e90 legacy=0x7f23d8152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:45.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.307+0000 7f23d77fe640 1 -- 172.21.15.62:0/1248015301 >> v1:172.21.15.62:6789/0 conn(0x7f23d8071a90 legacy=0x7f23d80b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:45.312 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.307+0000 7f23d77fe640 1 -- 172.21.15.62:0/1248015301 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d80b0f00 con 0x7f23d80b5330 2023-05-15T16:40:45.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.307+0000 7f23d77fe640 1 --2- 172.21.15.62:0/1248015301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d80b5330 0x7f23d80b5700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f23c80097c0 tx=0x7f23c801ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb487d0c3af45869 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:45.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23d67fc640 1 -- 172.21.15.62:0/1248015301 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c80a8970 con 0x7f23d80b5330 2023-05-15T16:40:45.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23d67fc640 1 -- 172.21.15.62:0/1248015301 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c80a8ad0 con 0x7f23d80b5330 2023-05-15T16:40:45.313 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23d67fc640 1 -- 172.21.15.62:0/1248015301 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c80a8e40 con 0x7f23d80b5330 2023-05-15T16:40:45.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23ddf51640 1 -- 172.21.15.62:0/1248015301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d80b5330 msgr2=0x7f23d80b5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:45.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23ddf51640 1 --2- 172.21.15.62:0/1248015301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d80b5330 0x7f23d80b5700 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f23c80097c0 tx=0x7f23c801ec70 comp rx=0 tx=0).stop 2023-05-15T16:40:45.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23ddf51640 1 -- 172.21.15.62:0/1248015301 shutdown_connections 2023-05-15T16:40:45.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23ddf51640 1 --2- 172.21.15.62:0/1248015301 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d80b5330 0x7f23d80b5700 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.314 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23ddf51640 1 -- 172.21.15.62:0/1248015301 >> 172.21.15.62:0/1248015301 conn(0x7f23d80653f0 msgr2=0x7f23d80697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:45.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23ddf51640 1 -- 172.21.15.62:0/1248015301 shutdown_connections 2023-05-15T16:40:45.315 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23ddf51640 1 -- 172.21.15.62:0/1248015301 wait complete. 2023-05-15T16:40:45.316 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23ddf51640 1 Processor -- start 2023-05-15T16:40:45.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23ddf51640 1 -- start start 2023-05-15T16:40:45.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23ddf51640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d8071a90 0x7f23d80acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:45.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23ddf51640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23d80b5330 0x7f23d81e3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:45.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23ddf51640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23d8144e90 0x7f23d813f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:45.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23ddf51640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80ad520 con 0x7f23d8071a90 2023-05-15T16:40:45.317 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23ddf51640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23d80ad710 con 0x7f23d8144e90 2023-05-15T16:40:45.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23ddf51640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23d81e3770 con 0x7f23d80b5330 2023-05-15T16:40:45.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23d77fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d8071a90 0x7f23d80acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:45.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23d77fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d8071a90 0x7f23d80acfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43826/0 (socket says 172.21.15.62:43826) 2023-05-15T16:40:45.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23d77fe640 1 -- 172.21.15.62:0/129671841 learned_addr learned my addr 172.21.15.62:0/129671841 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:45.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23d77fe640 1 -- 172.21.15.62:0/129671841 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23d80b5330 msgr2=0x7f23d81e3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:45.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23d6ffd640 1 --2- 172.21.15.62:0/129671841 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23d80b5330 0x7f23d81e3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:45.318 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23d7fff640 1 --2- 172.21.15.62:0/129671841 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23d8144e90 0x7f23d813f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:45.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23d77fe640 1 --2- 172.21.15.62:0/129671841 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23d80b5330 0x7f23d81e3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23d77fe640 1 -- 172.21.15.62:0/129671841 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23d8144e90 msgr2=0x7f23d813f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:45.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23d77fe640 1 --2- 172.21.15.62:0/129671841 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23d8144e90 0x7f23d813f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23d77fe640 1 -- 172.21.15.62:0/129671841 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23c8009420 con 0x7f23d8071a90 2023-05-15T16:40:45.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23d7fff640 1 --2- 172.21.15.62:0/129671841 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23d8144e90 0x7f23d813f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:45.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23d77fe640 1 --2- 172.21.15.62:0/129671841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d8071a90 0x7f23d80acfe0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f23c8000c10 tx=0x7f23c801d4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:45.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23cffff640 1 -- 172.21.15.62:0/129671841 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c8004450 con 0x7f23d8071a90 2023-05-15T16:40:45.319 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23cffff640 1 -- 172.21.15.62:0/129671841 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23c8003620 con 0x7f23d8071a90 2023-05-15T16:40:45.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23cffff640 1 -- 172.21.15.62:0/129671841 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23c8003990 con 0x7f23d8071a90 2023-05-15T16:40:45.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23ddf51640 1 -- 172.21.15.62:0/129671841 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23d80b11a0 con 0x7f23d8071a90 2023-05-15T16:40:45.320 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.311+0000 7f23ddf51640 1 -- 172.21.15.62:0/129671841 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23d80af7b0 con 0x7f23d8071a90 2023-05-15T16:40:45.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.315+0000 7f23ddf51640 1 -- 172.21.15.62:0/129671841 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23d80b1ec0 con 0x7f23d8071a90 2023-05-15T16:40:45.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.315+0000 7f23cffff640 1 -- 172.21.15.62:0/129671841 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f23c8003af0 con 0x7f23d8071a90 2023-05-15T16:40:45.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.315+0000 7f23cffff640 1 --2- 172.21.15.62:0/129671841 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f23b8065380 0x7f23b8067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:45.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.315+0000 7f23cffff640 1 -- 172.21.15.62:0/129671841 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f23c81204d0 con 0x7f23d8071a90 2023-05-15T16:40:45.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.315+0000 7f23d6ffd640 1 --2- 172.21.15.62:0/129671841 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f23b8065380 0x7f23b8067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:45.321 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.319+0000 7f23d6ffd640 1 --2- 172.21.15.62:0/129671841 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f23b8065380 0x7f23b8067830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f23d8144780 tx=0x7f23c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:45.322 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.319+0000 7f23cffff640 1 -- 172.21.15.62:0/129671841 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f23c80ee1e0 con 0x7f23d8071a90 2023-05-15T16:40:45.509 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.503+0000 7f23ddf51640 1 -- 172.21.15.62:0/129671841 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f23d81e2890 con 0x7f23d8071a90 2023-05-15T16:40:45.510 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.507+0000 7f23cffff640 1 -- 172.21.15.62:0/129671841 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3891 (secure 0 0 0) 0x7f23d81e2890 con 0x7f23d8071a90 2023-05-15T16:40:45.510 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:45.510 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4571,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/4029121060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":4029121060},{"type":"v1","addr":"172.21.15.62:6834","nonce":4029121060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4672,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1717488141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1717488141},{"type":"v1","addr":"172.21.15.161:6835","nonce":1717488141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-15T16:40:43.133344+0000","modified":"2023-05-15T16:40:45.146541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/303746399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":303746399},{"type":"v1","addr":"172.21.15.62:6835","nonce":303746399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-15T16:40:45.510 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 13 2023-05-15T16:40:45.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.507+0000 7f23ddf51640 1 -- 172.21.15.62:0/129671841 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f23b8065380 msgr2=0x7f23b8067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:45.511 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.507+0000 7f23ddf51640 1 --2- 172.21.15.62:0/129671841 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f23b8065380 0x7f23b8067830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f23d8144780 tx=0x7f23c0009040 comp rx=0 tx=0).stop 2023-05-15T16:40:45.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.507+0000 7f23ddf51640 1 -- 172.21.15.62:0/129671841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d8071a90 msgr2=0x7f23d80acfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:45.512 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.507+0000 7f23ddf51640 1 --2- 172.21.15.62:0/129671841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d8071a90 0x7f23d80acfe0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f23c8000c10 tx=0x7f23c801d4b0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.507+0000 7f23ddf51640 1 -- 172.21.15.62:0/129671841 shutdown_connections 2023-05-15T16:40:45.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.507+0000 7f23ddf51640 1 --2- 172.21.15.62:0/129671841 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f23d8144e90 0x7f23d813f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.507+0000 7f23ddf51640 1 --2- 172.21.15.62:0/129671841 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f23d80b5330 0x7f23d81e3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.507+0000 7f23ddf51640 1 --2- 172.21.15.62:0/129671841 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f23b8065380 0x7f23b8067830 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.507+0000 7f23ddf51640 1 --2- 172.21.15.62:0/129671841 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f23d8071a90 0x7f23d80acfe0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.507+0000 7f23ddf51640 1 -- 172.21.15.62:0/129671841 >> 172.21.15.62:0/129671841 conn(0x7f23d80653f0 msgr2=0x7f23d80af030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:45.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.507+0000 7f23ddf51640 1 -- 172.21.15.62:0/129671841 shutdown_connections 2023-05-15T16:40:45.514 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.507+0000 7f23ddf51640 1 -- 172.21.15.62:0/129671841 wait complete. 2023-05-15T16:40:45.527 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-05-15T16:40:45.647 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.643+0000 7f5b7c935640 1 Processor -- start 2023-05-15T16:40:45.648 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.643+0000 7f5b7c935640 1 -- start start 2023-05-15T16:40:45.649 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.643+0000 7f5b7c935640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f5b78141c90 0x7f5b780b7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:45.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.643+0000 7f5b7c935640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5b780b9d30 0x7f5b780713e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:45.650 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.643+0000 7f5b7c935640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b780b7ea0 con 0x7f5b780ba190 2023-05-15T16:40:45.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.643+0000 7f5b7c935640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b780b8ff0 con 0x7f5b780b9d30 2023-05-15T16:40:45.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.643+0000 7f5b7c935640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b780b8110 con 0x7f5b78141c90 2023-05-15T16:40:45.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.643+0000 7f5b75d9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5b780b9d30 0x7f5b780713e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:45.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.643+0000 7f5b75d9b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f5b780b9d30 0x7f5b780713e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43828/0 (socket says 172.21.15.62:43828) 2023-05-15T16:40:45.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.643+0000 7f5b75d9b640 1 -- 172.21.15.62:0/2259873753 learned_addr learned my addr 172.21.15.62:0/2259873753 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:45.651 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.643+0000 7f5b7659c640 1 --2- 172.21.15.62:0/2259873753 >> v2:172.21.15.161:3300/0 conn(0x7f5b78141c90 0x7f5b780b7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:45.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.643+0000 7f5b75d9b640 1 -- 172.21.15.62:0/2259873753 >> v2:172.21.15.161:3300/0 conn(0x7f5b78141c90 msgr2=0x7f5b780b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:45.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.643+0000 7f5b75d9b640 1 --2- 172.21.15.62:0/2259873753 >> v2:172.21.15.161:3300/0 conn(0x7f5b78141c90 0x7f5b780b7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.643+0000 7f5b75d9b640 1 -- 172.21.15.62:0/2259873753 >> v1:172.21.15.161:6789/0 conn(0x7f5b780ba190 legacy=0x7f5b780697b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:45.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.643+0000 7f5b75d9b640 1 -- 172.21.15.62:0/2259873753 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b780b83f0 con 0x7f5b780b9d30 2023-05-15T16:40:45.652 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.643+0000 7f5b7659c640 1 --2- 172.21.15.62:0/2259873753 >> v2:172.21.15.161:3300/0 conn(0x7f5b78141c90 0x7f5b780b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:45.653 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.647+0000 7f5b75d9b640 1 --2- 172.21.15.62:0/2259873753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780b9d30 0x7f5b780713e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5b78066000 tx=0x7f5b6c01ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32371446b34ca6af server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:45.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.647+0000 7f5b7559a640 1 -- 172.21.15.62:0/2259873753 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0a89b0 con 0x7f5b780b9d30 2023-05-15T16:40:45.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.647+0000 7f5b7559a640 1 -- 172.21.15.62:0/2259873753 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c0a8b10 con 0x7f5b780b9d30 2023-05-15T16:40:45.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.647+0000 7f5b7559a640 1 -- 172.21.15.62:0/2259873753 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0a8ea0 con 0x7f5b780b9d30 2023-05-15T16:40:45.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.647+0000 7f5b7c935640 1 -- 172.21.15.62:0/2259873753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780b9d30 msgr2=0x7f5b780713e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:45.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.647+0000 7f5b7c935640 1 --2- 172.21.15.62:0/2259873753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780b9d30 0x7f5b780713e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5b78066000 tx=0x7f5b6c01ecb0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.647+0000 7f5b7c935640 1 -- 172.21.15.62:0/2259873753 shutdown_connections 2023-05-15T16:40:45.654 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.647+0000 7f5b7c935640 1 --2- 172.21.15.62:0/2259873753 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780b9d30 0x7f5b780713e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.647+0000 7f5b7c935640 1 --2- 172.21.15.62:0/2259873753 >> v2:172.21.15.161:3300/0 conn(0x7f5b78141c90 0x7f5b780b7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.647+0000 7f5b7c935640 1 -- 172.21.15.62:0/2259873753 >> 172.21.15.62:0/2259873753 conn(0x7f5b780bd830 msgr2=0x7f5b780b9620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:45.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.647+0000 7f5b7c935640 1 -- 172.21.15.62:0/2259873753 shutdown_connections 2023-05-15T16:40:45.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.647+0000 7f5b7c935640 1 -- 172.21.15.62:0/2259873753 wait complete. 2023-05-15T16:40:45.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b7c935640 1 Processor -- start 2023-05-15T16:40:45.655 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b7c935640 1 -- start start 2023-05-15T16:40:45.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b7c935640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b780b9d30 0x7f5b78071700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:45.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b7c935640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780ba190 0x7f5b780b6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:45.658 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b7c935640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b78141c90 0x7f5b780b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:45.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b7c935640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b780b5780 con 0x7f5b780ba190 2023-05-15T16:40:45.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b7c935640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b78135790 con 0x7f5b78141c90 2023-05-15T16:40:45.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b7c935640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b78071c40 con 0x7f5b780b9d30 2023-05-15T16:40:45.659 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b75d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780ba190 0x7f5b780b6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:45.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b75d9b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780ba190 0x7f5b780b6670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43840/0 (socket says 172.21.15.62:43840) 2023-05-15T16:40:45.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b75d9b640 1 -- 172.21.15.62:0/1598701278 learned_addr learned my addr 172.21.15.62:0/1598701278 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:45.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b7659c640 1 --2- 172.21.15.62:0/1598701278 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b780b9d30 0x7f5b78071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:45.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b76d9d640 1 --2- 172.21.15.62:0/1598701278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b78141c90 0x7f5b780b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:45.660 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b75d9b640 1 -- 172.21.15.62:0/1598701278 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b780b9d30 msgr2=0x7f5b78071700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:45.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b75d9b640 1 --2- 172.21.15.62:0/1598701278 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b780b9d30 0x7f5b78071700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b75d9b640 1 -- 172.21.15.62:0/1598701278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b78141c90 msgr2=0x7f5b780b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:45.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b75d9b640 1 --2- 172.21.15.62:0/1598701278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b78141c90 0x7f5b780b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b75d9b640 1 -- 172.21.15.62:0/1598701278 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b6c0094d0 con 0x7f5b780ba190 2023-05-15T16:40:45.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b76d9d640 1 --2- 172.21.15.62:0/1598701278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b78141c90 0x7f5b780b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:45.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b75d9b640 1 --2- 172.21.15.62:0/1598701278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780ba190 0x7f5b780b6670 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c000c10 tx=0x7f5b6c01ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:45.661 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b66ffd640 1 -- 172.21.15.62:0/1598701278 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0b1e90 con 0x7f5b780ba190 2023-05-15T16:40:45.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b66ffd640 1 -- 172.21.15.62:0/1598701278 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c0b9410 con 0x7f5b780ba190 2023-05-15T16:40:45.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b66ffd640 1 -- 172.21.15.62:0/1598701278 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c0b97e0 con 0x7f5b780ba190 2023-05-15T16:40:45.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b7c935640 1 -- 172.21.15.62:0/1598701278 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b78142060 con 0x7f5b780ba190 2023-05-15T16:40:45.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b7c935640 1 -- 172.21.15.62:0/1598701278 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b780b86d0 con 0x7f5b780ba190 2023-05-15T16:40:45.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b7c935640 1 -- 172.21.15.62:0/1598701278 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b78070e50 con 0x7f5b780ba190 2023-05-15T16:40:45.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b66ffd640 1 -- 172.21.15.62:0/1598701278 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f5b6c0b7040 con 0x7f5b780ba190 2023-05-15T16:40:45.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b66ffd640 1 --2- 172.21.15.62:0/1598701278 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5b580653b0 0x7f5b58067860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:45.662 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.651+0000 7f5b66ffd640 1 -- 172.21.15.62:0/1598701278 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f5b6c120860 con 0x7f5b780ba190 2023-05-15T16:40:45.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.655+0000 7f5b7659c640 1 --2- 172.21.15.62:0/1598701278 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5b580653b0 0x7f5b58067860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:45.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.655+0000 7f5b7659c640 1 --2- 172.21.15.62:0/1598701278 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5b580653b0 0x7f5b58067860 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5b68006fd0 tx=0x7f5b68008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:45.663 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.659+0000 7f5b66ffd640 1 -- 172.21.15.62:0/1598701278 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f5b6c0ee570 con 0x7f5b780ba190 2023-05-15T16:40:45.810 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.807+0000 7f5b7c935640 1 -- 172.21.15.62:0/1598701278 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b78070e50 con 0x7f5b780ba190 2023-05-15T16:40:45.814 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.811+0000 7f5b66ffd640 1 -- 172.21.15.62:0/1598701278 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) v1 ==== 74+0+17883 (secure 0 0 0) 0x7f5b6c0b5070 con 0x7f5b780ba190 2023-05-15T16:40:45.814 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:45.814 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":34,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","created":"2023-05-15T16:39:36.755621+0000","modified":"2023-05-15T16:40:44.137857+0000","last_up_change":"2023-05-15T16:39:48.597049+0000","last_in_change":"2023-05-15T16:39:39.096112+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-05-15T16:39:49.394028+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-05-15T16:39:55.208679+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-05-15T16:40:41.013860+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-05-15T16:40:42.121351+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"780dd483-5a31-4c7e-bd31-ab5ab8e5b409","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6824","nonce":37594},{"type":"v1","addr":"172.21.15.62:6825","nonce":37594}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6826","nonce":37594},{"type":"v1","addr":"172.21.15.62:6827","nonce":37594}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6830","nonce":37594},{"type":"v1","addr":"172.21.15.62:6831","nonce":37594}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6828","nonce":37594},{"type":"v1","addr":"172.21.15.62:6829","nonce":37594}]},"public_addr":"172.21.15.62:6825/37594","cluster_addr":"172.21.15.62:6827/37594","heartbeat_back_addr":"172.21.15.62:6831/37594","heartbeat_front_addr":"172.21.15.62:6829/37594","state":["exists","up"]},{"osd":1,"uuid":"d34effc2-e11d-468e-8890-90a4fe6fe11a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6806","nonce":37592},{"type":"v1","addr":"172.21.15.62:6808","nonce":37592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6811","nonce":37592},{"type":"v1","addr":"172.21.15.62:6814","nonce":37592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6821","nonce":37592},{"type":"v1","addr":"172.21.15.62:6823","nonce":37592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6816","nonce":37592},{"type":"v1","addr":"172.21.15.62:6818","nonce":37592}]},"public_addr":"172.21.15.62:6808/37592","cluster_addr":"172.21.15.62:6814/37592","heartbeat_back_addr":"172.21.15.62:6823/37592","heartbeat_front_addr":"172.21.15.62:6818/37592","state":["exists","up"]},{"osd":2,"uuid":"277c65ad-f31f-4e9c-a8b8-8688dc19132f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6807","nonce":37591},{"type":"v1","addr":"172.21.15.62:6810","nonce":37591}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6813","nonce":37591},{"type":"v1","addr":"172.21.15.62:6815","nonce":37591}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6820","nonce":37591},{"type":"v1","addr":"172.21.15.62:6822","nonce":37591}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6817","nonce":37591},{"type":"v1","addr":"172.21.15.62:6819","nonce":37591}]},"public_addr":"172.21.15.62:6810/37591","cluster_addr":"172.21.15.62:6815/37591","heartbeat_back_addr":"172.21.15.62:6822/37591","heartbeat_front_addr":"172.21.15.62:6819/37591","state":["exists","up"]},{"osd":3,"uuid":"5a4a4d5f-f863-4783-89c2-2bd806813376","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6800","nonce":37593},{"type":"v1","addr":"172.21.15.62:6801","nonce":37593}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6802","nonce":37593},{"type":"v1","addr":"172.21.15.62:6803","nonce":37593}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6809","nonce":37593},{"type":"v1","addr":"172.21.15.62:6812","nonce":37593}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6804","nonce":37593},{"type":"v1","addr":"172.21.15.62:6805","nonce":37593}]},"public_addr":"172.21.15.62:6801/37593","cluster_addr":"172.21.15.62:6803/37593","heartbeat_back_addr":"172.21.15.62:6812/37593","heartbeat_front_addr":"172.21.15.62:6805/37593","state":["exists","up"]},{"osd":4,"uuid":"ba2e6df7-2918-486c-b4fa-b9e30c852085","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6800","nonce":37854},{"type":"v1","addr":"172.21.15.161:6801","nonce":37854}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6802","nonce":37854},{"type":"v1","addr":"172.21.15.161:6803","nonce":37854}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6806","nonce":37854},{"type":"v1","addr":"172.21.15.161:6807","nonce":37854}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6804","nonce":37854},{"type":"v1","addr":"172.21.15.161:6805","nonce":37854}]},"public_addr":"172.21.15.161:6801/37854","cluster_addr":"172.21.15.161:6803/37854","heartbeat_back_addr":"172.21.15.161:6807/37854","heartbeat_front_addr":"172.21.15.161:6805/37854","state":["exists","up"]},{"osd":5,"uuid":"7e242cff-26b2-49d7-bd7b-5bc1f775eda6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6808","nonce":37855},{"type":"v1","addr":"172.21.15.161:6810","nonce":37855}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6812","nonce":37855},{"type":"v1","addr":"172.21.15.161:6815","nonce":37855}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6822","nonce":37855},{"type":"v1","addr":"172.21.15.161:6824","nonce":37855}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6818","nonce":37855},{"type":"v1","addr":"172.21.15.161:6820","nonce":37855}]},"public_addr":"172.21.15.161:6810/37855","cluster_addr":"172.21.15.161:6815/37855","heartbeat_back_addr":"172.21.15.161:6824/37855","heartbeat_front_addr":"172.21.15.161:6820/37855","state":["exists","up"]},{"osd":6,"uuid":"1ed9dcc8-4515-4e93-84ae-cc2452f9f82a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6811","nonce":37856},{"type":"v1","addr":"172.21.15.161:6814","nonce":37856}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6816","nonce":37856},{"type":"v1","addr":"172.21.15.161:6819","nonce":37856}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6828","nonce":37856},{"type":"v1","addr":"172.21.15.161:6830","nonce":37856}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6823","nonce":37856},{"type":"v1","addr":"172.21.15.161:6826","nonce":37856}]},"public_addr":"172.21.15.161:6814/37856","cluster_addr":"172.21.15.161:6819/37856","heartbeat_back_addr":"172.21.15.161:6830/37856","heartbeat_front_addr":"172.21.15.161:6826/37856","state":["exists","up"]},{"osd":7,"uuid":"46d2baee-113b-4165-bda7-8aeb67c7fd44","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6809","nonce":37857},{"type":"v1","addr":"172.21.15.161:6813","nonce":37857}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6817","nonce":37857},{"type":"v1","addr":"172.21.15.161:6821","nonce":37857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6829","nonce":37857},{"type":"v1","addr":"172.21.15.161:6831","nonce":37857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6825","nonce":37857},{"type":"v1","addr":"172.21.15.161:6827","nonce":37857}]},"public_addr":"172.21.15.161:6813/37857","cluster_addr":"172.21.15.161:6821/37857","heartbeat_back_addr":"172.21.15.161:6831/37857","heartbeat_front_addr":"172.21.15.161:6827/37857","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.592907+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.618143+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.641533+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.614355+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.579293+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.718353+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.730135+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-05-15T16:39:44.792887+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-05-15T16:40:45.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.811+0000 7f5b7c935640 1 -- 172.21.15.62:0/1598701278 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5b580653b0 msgr2=0x7f5b58067860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:45.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.811+0000 7f5b7c935640 1 --2- 172.21.15.62:0/1598701278 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5b580653b0 0x7f5b58067860 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5b68006fd0 tx=0x7f5b68008040 comp rx=0 tx=0).stop 2023-05-15T16:40:45.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.811+0000 7f5b7c935640 1 -- 172.21.15.62:0/1598701278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780ba190 msgr2=0x7f5b780b6670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:45.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.811+0000 7f5b7c935640 1 --2- 172.21.15.62:0/1598701278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780ba190 0x7f5b780b6670 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c000c10 tx=0x7f5b6c01ba50 comp rx=0 tx=0).stop 2023-05-15T16:40:45.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.811+0000 7f5b7c935640 1 -- 172.21.15.62:0/1598701278 shutdown_connections 2023-05-15T16:40:45.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.811+0000 7f5b7c935640 1 --2- 172.21.15.62:0/1598701278 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f5b78141c90 0x7f5b780b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.811+0000 7f5b7c935640 1 --2- 172.21.15.62:0/1598701278 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f5b580653b0 0x7f5b58067860 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.811+0000 7f5b7c935640 1 --2- 172.21.15.62:0/1598701278 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f5b780ba190 0x7f5b780b6670 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.811+0000 7f5b7c935640 1 --2- 172.21.15.62:0/1598701278 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f5b780b9d30 0x7f5b78071700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.811+0000 7f5b7c935640 1 -- 172.21.15.62:0/1598701278 >> 172.21.15.62:0/1598701278 conn(0x7f5b780bd830 msgr2=0x7f5b7813df50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:45.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.811+0000 7f5b7c935640 1 -- 172.21.15.62:0/1598701278 shutdown_connections 2023-05-15T16:40:45.818 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.811+0000 7f5b7c935640 1 -- 172.21.15.62:0/1598701278 wait complete. 2023-05-15T16:40:45.832 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-05-15T16:40:45.832 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-15T16:40:45.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.951+0000 7f37712b5640 1 Processor -- start 2023-05-15T16:40:45.955 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.951+0000 7f37712b5640 1 -- start start 2023-05-15T16:40:45.956 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.951+0000 7f37712b5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f376c140b30 0x7f376c0b4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:45.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.951+0000 7f37712b5640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f376c149df0 0x7f376c0b3af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:45.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.951+0000 7f37712b5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f376c071a00 0x7f376c0b7550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:45.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.951+0000 7f37712b5640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376c0afd30 con 0x7f376c149df0 2023-05-15T16:40:45.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.951+0000 7f37712b5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f376c0b3660 con 0x7f376c071a00 2023-05-15T16:40:45.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.951+0000 7f37712b5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376c0b3330 con 0x7f376c140b30 2023-05-15T16:40:45.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.951+0000 7f376a7fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f376c149df0 0x7f376c0b3af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:45.957 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.951+0000 7f376a7fc640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f376c149df0 0x7f376c0b3af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43854/0 (socket says 172.21.15.62:43854) 2023-05-15T16:40:45.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.951+0000 7f376a7fc640 1 -- 172.21.15.62:0/682638848 learned_addr learned my addr 172.21.15.62:0/682638848 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:45.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.951+0000 7f376affd640 1 --2- 172.21.15.62:0/682638848 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f376c140b30 0x7f376c0b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:45.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.951+0000 7f376b7fe640 1 --2- 172.21.15.62:0/682638848 >> v2:172.21.15.161:3300/0 conn(0x7f376c071a00 0x7f376c0b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:45.958 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.951+0000 7f376a7fc640 1 -- 172.21.15.62:0/682638848 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f376c140b30 msgr2=0x7f376c0b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:45.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.955+0000 7f376a7fc640 1 --2- 172.21.15.62:0/682638848 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f376c140b30 0x7f376c0b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.955+0000 7f376a7fc640 1 -- 172.21.15.62:0/682638848 >> v2:172.21.15.161:3300/0 conn(0x7f376c071a00 msgr2=0x7f376c0b7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:45.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.955+0000 7f376a7fc640 1 --2- 172.21.15.62:0/682638848 >> v2:172.21.15.161:3300/0 conn(0x7f376c071a00 0x7f376c0b7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.955+0000 7f376a7fc640 1 -- 172.21.15.62:0/682638848 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f376c0b4030 con 0x7f376c149df0 2023-05-15T16:40:45.959 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.955+0000 7f376b7fe640 1 --2- 172.21.15.62:0/682638848 >> v2:172.21.15.161:3300/0 conn(0x7f376c071a00 0x7f376c0b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-15T16:40:45.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.955+0000 7f376a7fc640 1 --2- 172.21.15.62:0/682638848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f376c149df0 0x7f376c0b3af0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f376c14a200 tx=0x7f376001ecf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94372d3d1451ca1 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:45.960 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.955+0000 7f3769ffb640 1 -- 172.21.15.62:0/682638848 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37600a89b0 con 0x7f376c149df0 2023-05-15T16:40:45.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.955+0000 7f3769ffb640 1 -- 172.21.15.62:0/682638848 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37600a8b10 con 0x7f376c149df0 2023-05-15T16:40:45.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.955+0000 7f3769ffb640 1 -- 172.21.15.62:0/682638848 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37600a8ea0 con 0x7f376c149df0 2023-05-15T16:40:45.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.955+0000 7f37712b5640 1 -- 172.21.15.62:0/682638848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f376c149df0 msgr2=0x7f376c0b3af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:45.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.955+0000 7f37712b5640 1 --2- 172.21.15.62:0/682638848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f376c149df0 0x7f376c0b3af0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f376c14a200 tx=0x7f376001ecf0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.955+0000 7f37712b5640 1 -- 172.21.15.62:0/682638848 shutdown_connections 2023-05-15T16:40:45.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.955+0000 7f37712b5640 1 --2- 172.21.15.62:0/682638848 >> v2:172.21.15.161:3300/0 conn(0x7f376c071a00 0x7f376c0b7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.955+0000 7f37712b5640 1 --2- 172.21.15.62:0/682638848 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f376c149df0 0x7f376c0b3af0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.961 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.955+0000 7f37712b5640 1 --2- 172.21.15.62:0/682638848 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f376c140b30 0x7f376c0b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.955+0000 7f37712b5640 1 -- 172.21.15.62:0/682638848 >> 172.21.15.62:0/682638848 conn(0x7f376c0653f0 msgr2=0x7f376c0697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:45.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.955+0000 7f37712b5640 1 -- 172.21.15.62:0/682638848 shutdown_connections 2023-05-15T16:40:45.962 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.955+0000 7f37712b5640 1 -- 172.21.15.62:0/682638848 wait complete. 2023-05-15T16:40:45.963 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f37712b5640 1 Processor -- start 2023-05-15T16:40:45.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f37712b5640 1 -- start start 2023-05-15T16:40:45.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f37712b5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f376c071a00 0x7f376c141630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:45.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f37712b5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f376c140b30 0x7f376c13aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:45.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f37712b5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f376c149df0 0x7f376c148d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:45.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f37712b5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c13e8b0 con 0x7f376c140b30 2023-05-15T16:40:45.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f37712b5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f376c13e6c0 con 0x7f376c071a00 2023-05-15T16:40:45.964 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f37712b5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f376c13cca0 con 0x7f376c149df0 2023-05-15T16:40:45.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f376a7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f376c140b30 0x7f376c13aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:45.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f376a7fc640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f376c140b30 0x7f376c13aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43864/0 (socket says 172.21.15.62:43864) 2023-05-15T16:40:45.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f376a7fc640 1 -- 172.21.15.62:0/851797368 learned_addr learned my addr 172.21.15.62:0/851797368 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:45.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f376b7fe640 1 --2- 172.21.15.62:0/851797368 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f376c149df0 0x7f376c148d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:45.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f376affd640 1 --2- 172.21.15.62:0/851797368 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f376c071a00 0x7f376c141630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:45.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f376a7fc640 1 -- 172.21.15.62:0/851797368 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f376c149df0 msgr2=0x7f376c148d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:45.965 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f376a7fc640 1 --2- 172.21.15.62:0/851797368 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f376c149df0 0x7f376c148d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f376a7fc640 1 -- 172.21.15.62:0/851797368 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f376c071a00 msgr2=0x7f376c141630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:45.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f376a7fc640 1 --2- 172.21.15.62:0/851797368 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f376c071a00 0x7f376c141630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:45.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f376a7fc640 1 -- 172.21.15.62:0/851797368 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37600094d0 con 0x7f376c140b30 2023-05-15T16:40:45.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f376a7fc640 1 --2- 172.21.15.62:0/851797368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f376c140b30 0x7f376c13aeb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f376001d3a0 tx=0x7f376001ba90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:45.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f37537fe640 1 -- 172.21.15.62:0/851797368 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37600ba600 con 0x7f376c140b30 2023-05-15T16:40:45.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f37537fe640 1 -- 172.21.15.62:0/851797368 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37600ba760 con 0x7f376c140b30 2023-05-15T16:40:45.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f37537fe640 1 -- 172.21.15.62:0/851797368 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37600bab10 con 0x7f376c140b30 2023-05-15T16:40:45.966 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f37712b5640 1 -- 172.21.15.62:0/851797368 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f376c140f00 con 0x7f376c140b30 2023-05-15T16:40:45.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f37712b5640 1 -- 172.21.15.62:0/851797368 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f376c0b5000 con 0x7f376c140b30 2023-05-15T16:40:45.967 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f37712b5640 1 -- 172.21.15.62:0/851797368 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f376c13cb00 con 0x7f376c140b30 2023-05-15T16:40:45.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f37537fe640 1 -- 172.21.15.62:0/851797368 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f37600bac70 con 0x7f376c140b30 2023-05-15T16:40:45.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.959+0000 7f37537fe640 1 --2- 172.21.15.62:0/851797368 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3758065380 0x7f3758067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:45.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.963+0000 7f37537fe640 1 -- 172.21.15.62:0/851797368 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f3760120e10 con 0x7f376c140b30 2023-05-15T16:40:45.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.963+0000 7f376affd640 1 --2- 172.21.15.62:0/851797368 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3758065380 0x7f3758067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:45.968 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.963+0000 7f376affd640 1 --2- 172.21.15.62:0/851797368 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3758065380 0x7f3758067830 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f375c003fd0 tx=0x7f375c0039a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:45.969 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:45.967+0000 7f37537fe640 1 -- 172.21.15.62:0/851797368 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f376c13cb00 con 0x7f376c140b30 2023-05-15T16:40:46.119 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.115+0000 7f37712b5640 1 -- 172.21.15.62:0/851797368 --> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f376c13cb00 con 0x7f3758065380 2023-05-15T16:40:46.141 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.135+0000 7f37537fe640 1 -- 172.21.15.62:0/851797368 <== mgr.4105 v2:172.21.15.161:6832/37541 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286623 (secure 0 0 0) 0x7f376c13cb00 con 0x7f3758065380 2023-05-15T16:40:46.145 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:46.147 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-05-15T16:40:46.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.143+0000 7f37712b5640 1 -- 172.21.15.62:0/851797368 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3758065380 msgr2=0x7f3758067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:46.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.143+0000 7f37712b5640 1 --2- 172.21.15.62:0/851797368 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3758065380 0x7f3758067830 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f375c003fd0 tx=0x7f375c0039a0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.143+0000 7f37712b5640 1 -- 172.21.15.62:0/851797368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f376c140b30 msgr2=0x7f376c13aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:46.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.143+0000 7f37712b5640 1 --2- 172.21.15.62:0/851797368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f376c140b30 0x7f376c13aeb0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f376001d3a0 tx=0x7f376001ba90 comp rx=0 tx=0).stop 2023-05-15T16:40:46.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.143+0000 7f37712b5640 1 -- 172.21.15.62:0/851797368 shutdown_connections 2023-05-15T16:40:46.148 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.143+0000 7f37712b5640 1 --2- 172.21.15.62:0/851797368 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f376c149df0 0x7f376c148d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.143+0000 7f37712b5640 1 --2- 172.21.15.62:0/851797368 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3758065380 0x7f3758067830 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.143+0000 7f37712b5640 1 --2- 172.21.15.62:0/851797368 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f376c140b30 0x7f376c13aeb0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.143+0000 7f37712b5640 1 --2- 172.21.15.62:0/851797368 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f376c071a00 0x7f376c141630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.143+0000 7f37712b5640 1 -- 172.21.15.62:0/851797368 >> 172.21.15.62:0/851797368 conn(0x7f376c0653f0 msgr2=0x7f376c13eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:46.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.143+0000 7f37712b5640 1 -- 172.21.15.62:0/851797368 shutdown_connections 2023-05-15T16:40:46.149 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.143+0000 7f37712b5640 1 -- 172.21.15.62:0/851797368 wait complete. 2023-05-15T16:40:46.164 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-05-15T16:40:45.331432+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69352,"kb_used_data":4136,"kb_used_omap":0,"kb_used_meta":65152,"kb_avail":754905368,"statfs":{"total":773094113280,"available":773023096832,"internally_reserved":0,"allocated":4235264,"data_stored":2387004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":66715648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":65,"apply_latency_ms":65,"commit_latency_ns":65000000,"apply_latency_ns":65000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001238"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.150182+0000","last_change":"2023-05-15T16:40:43.160673+0000","last_active":"2023-05-15T16:40:44.150182+0000","last_peered":"2023-05-15T16:40:44.150182+0000","last_clean":"2023-05-15T16:40:44.150182+0000","last_became_active":"2023-05-15T16:40:43.160400+0000","last_became_peered":"2023-05-15T16:40:43.160400+0000","last_unstale":"2023-05-15T16:40:44.150182+0000","last_undegraded":"2023-05-15T16:40:44.150182+0000","last_fullsized":"2023-05-15T16:40:44.150182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:09:27.509084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.149657+0000","last_change":"2023-05-15T16:40:43.163583+0000","last_active":"2023-05-15T16:40:44.149657+0000","last_peered":"2023-05-15T16:40:44.149657+0000","last_clean":"2023-05-15T16:40:44.149657+0000","last_became_active":"2023-05-15T16:40:43.163382+0000","last_became_peered":"2023-05-15T16:40:43.163382+0000","last_unstale":"2023-05-15T16:40:44.149657+0000","last_undegraded":"2023-05-15T16:40:44.149657+0000","last_fullsized":"2023-05-15T16:40:44.149657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:48:36.460921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.152070+0000","last_change":"2023-05-15T16:40:43.211610+0000","last_active":"2023-05-15T16:40:44.152070+0000","last_peered":"2023-05-15T16:40:44.152070+0000","last_clean":"2023-05-15T16:40:44.152070+0000","last_became_active":"2023-05-15T16:40:43.211274+0000","last_became_peered":"2023-05-15T16:40:43.211274+0000","last_unstale":"2023-05-15T16:40:44.152070+0000","last_undegraded":"2023-05-15T16:40:44.152070+0000","last_fullsized":"2023-05-15T16:40:44.152070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:36:01.464099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.200273+0000","last_change":"2023-05-15T16:40:43.197080+0000","last_active":"2023-05-15T16:40:43.200273+0000","last_peered":"2023-05-15T16:40:43.200273+0000","last_clean":"2023-05-15T16:40:43.200273+0000","last_became_active":"2023-05-15T16:40:43.196772+0000","last_became_peered":"2023-05-15T16:40:43.196772+0000","last_unstale":"2023-05-15T16:40:43.200273+0000","last_undegraded":"2023-05-15T16:40:43.200273+0000","last_fullsized":"2023-05-15T16:40:43.200273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:28:36.725852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.183148+0000","last_change":"2023-05-15T16:40:43.178213+0000","last_active":"2023-05-15T16:40:43.183148+0000","last_peered":"2023-05-15T16:40:43.183148+0000","last_clean":"2023-05-15T16:40:43.183148+0000","last_became_active":"2023-05-15T16:40:43.177948+0000","last_became_peered":"2023-05-15T16:40:43.177948+0000","last_unstale":"2023-05-15T16:40:43.183148+0000","last_undegraded":"2023-05-15T16:40:43.183148+0000","last_fullsized":"2023-05-15T16:40:43.183148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:53.937682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.164050+0000","last_change":"2023-05-15T16:40:43.162143+0000","last_active":"2023-05-15T16:40:43.164050+0000","last_peered":"2023-05-15T16:40:43.164050+0000","last_clean":"2023-05-15T16:40:43.164050+0000","last_became_active":"2023-05-15T16:40:43.161588+0000","last_became_peered":"2023-05-15T16:40:43.161588+0000","last_unstale":"2023-05-15T16:40:43.164050+0000","last_undegraded":"2023-05-15T16:40:43.164050+0000","last_fullsized":"2023-05-15T16:40:43.164050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:41:07.655815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.154775+0000","last_change":"2023-05-15T16:40:43.185677+0000","last_active":"2023-05-15T16:40:44.154775+0000","last_peered":"2023-05-15T16:40:44.154775+0000","last_clean":"2023-05-15T16:40:44.154775+0000","last_became_active":"2023-05-15T16:40:43.184529+0000","last_became_peered":"2023-05-15T16:40:43.184529+0000","last_unstale":"2023-05-15T16:40:44.154775+0000","last_undegraded":"2023-05-15T16:40:44.154775+0000","last_fullsized":"2023-05-15T16:40:44.154775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:48:37.795757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.149294+0000","last_change":"2023-05-15T16:40:43.185390+0000","last_active":"2023-05-15T16:40:44.149294+0000","last_peered":"2023-05-15T16:40:44.149294+0000","last_clean":"2023-05-15T16:40:44.149294+0000","last_became_active":"2023-05-15T16:40:43.185090+0000","last_became_peered":"2023-05-15T16:40:43.185090+0000","last_unstale":"2023-05-15T16:40:44.149294+0000","last_undegraded":"2023-05-15T16:40:44.149294+0000","last_fullsized":"2023-05-15T16:40:44.149294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:36:01.464099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.152079+0000","last_change":"2023-05-15T16:40:43.210314+0000","last_active":"2023-05-15T16:40:44.152079+0000","last_peered":"2023-05-15T16:40:44.152079+0000","last_clean":"2023-05-15T16:40:44.152079+0000","last_became_active":"2023-05-15T16:40:43.209965+0000","last_became_peered":"2023-05-15T16:40:43.209965+0000","last_unstale":"2023-05-15T16:40:44.152079+0000","last_undegraded":"2023-05-15T16:40:44.152079+0000","last_fullsized":"2023-05-15T16:40:44.152079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:07:03.252878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.155637+0000","last_change":"2023-05-15T16:40:43.214512+0000","last_active":"2023-05-15T16:40:44.155637+0000","last_peered":"2023-05-15T16:40:44.155637+0000","last_clean":"2023-05-15T16:40:44.155637+0000","last_became_active":"2023-05-15T16:40:43.211314+0000","last_became_peered":"2023-05-15T16:40:43.211314+0000","last_unstale":"2023-05-15T16:40:44.155637+0000","last_undegraded":"2023-05-15T16:40:44.155637+0000","last_fullsized":"2023-05-15T16:40:44.155637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:36:28.019271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.156140+0000","last_change":"2023-05-15T16:40:43.213368+0000","last_active":"2023-05-15T16:40:44.156140+0000","last_peered":"2023-05-15T16:40:44.156140+0000","last_clean":"2023-05-15T16:40:44.156140+0000","last_became_active":"2023-05-15T16:40:43.212895+0000","last_became_peered":"2023-05-15T16:40:43.212895+0000","last_unstale":"2023-05-15T16:40:44.156140+0000","last_undegraded":"2023-05-15T16:40:44.156140+0000","last_fullsized":"2023-05-15T16:40:44.156140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:09:27.509084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.151822+0000","last_change":"2023-05-15T16:40:43.163691+0000","last_active":"2023-05-15T16:40:44.151822+0000","last_peered":"2023-05-15T16:40:44.151822+0000","last_clean":"2023-05-15T16:40:44.151822+0000","last_became_active":"2023-05-15T16:40:43.163387+0000","last_became_peered":"2023-05-15T16:40:43.163387+0000","last_unstale":"2023-05-15T16:40:44.151822+0000","last_undegraded":"2023-05-15T16:40:44.151822+0000","last_fullsized":"2023-05-15T16:40:44.151822+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:20:07.783148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.155744+0000","last_change":"2023-05-15T16:40:43.202451+0000","last_active":"2023-05-15T16:40:44.155744+0000","last_peered":"2023-05-15T16:40:44.155744+0000","last_clean":"2023-05-15T16:40:44.155744+0000","last_became_active":"2023-05-15T16:40:43.201781+0000","last_became_peered":"2023-05-15T16:40:43.201781+0000","last_unstale":"2023-05-15T16:40:44.155744+0000","last_undegraded":"2023-05-15T16:40:44.155744+0000","last_fullsized":"2023-05-15T16:40:44.155744+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:48:36.460921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.205367+0000","last_change":"2023-05-15T16:40:43.203715+0000","last_active":"2023-05-15T16:40:43.205367+0000","last_peered":"2023-05-15T16:40:43.205367+0000","last_clean":"2023-05-15T16:40:43.205367+0000","last_became_active":"2023-05-15T16:40:43.203124+0000","last_became_peered":"2023-05-15T16:40:43.203124+0000","last_unstale":"2023-05-15T16:40:43.205367+0000","last_undegraded":"2023-05-15T16:40:43.205367+0000","last_fullsized":"2023-05-15T16:40:43.205367+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:34:13.546068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.154878+0000","last_change":"2023-05-15T16:40:43.198632+0000","last_active":"2023-05-15T16:40:44.154878+0000","last_peered":"2023-05-15T16:40:44.154878+0000","last_clean":"2023-05-15T16:40:44.154878+0000","last_became_active":"2023-05-15T16:40:43.189529+0000","last_became_peered":"2023-05-15T16:40:43.189529+0000","last_unstale":"2023-05-15T16:40:44.154878+0000","last_undegraded":"2023-05-15T16:40:44.154878+0000","last_fullsized":"2023-05-15T16:40:44.154878+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:36:01.464099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.198378+0000","last_change":"2023-05-15T16:40:43.187747+0000","last_active":"2023-05-15T16:40:43.198378+0000","last_peered":"2023-05-15T16:40:43.198378+0000","last_clean":"2023-05-15T16:40:43.198378+0000","last_became_active":"2023-05-15T16:40:43.187018+0000","last_became_peered":"2023-05-15T16:40:43.187018+0000","last_unstale":"2023-05-15T16:40:43.198378+0000","last_undegraded":"2023-05-15T16:40:43.198378+0000","last_fullsized":"2023-05-15T16:40:43.198378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:48:36.460921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.215039+0000","last_change":"2023-05-15T16:40:43.213361+0000","last_active":"2023-05-15T16:40:43.215039+0000","last_peered":"2023-05-15T16:40:43.215039+0000","last_clean":"2023-05-15T16:40:43.215039+0000","last_became_active":"2023-05-15T16:40:43.211851+0000","last_became_peered":"2023-05-15T16:40:43.211851+0000","last_unstale":"2023-05-15T16:40:43.215039+0000","last_undegraded":"2023-05-15T16:40:43.215039+0000","last_fullsized":"2023-05-15T16:40:43.215039+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:30:53.186798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.206776+0000","last_change":"2023-05-15T16:40:43.204270+0000","last_active":"2023-05-15T16:40:43.206776+0000","last_peered":"2023-05-15T16:40:43.206776+0000","last_clean":"2023-05-15T16:40:43.206776+0000","last_became_active":"2023-05-15T16:40:43.203576+0000","last_became_peered":"2023-05-15T16:40:43.203576+0000","last_unstale":"2023-05-15T16:40:43.206776+0000","last_undegraded":"2023-05-15T16:40:43.206776+0000","last_fullsized":"2023-05-15T16:40:43.206776+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:40:05.358131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.162936+0000","last_change":"2023-05-15T16:40:43.157463+0000","last_active":"2023-05-15T16:40:43.162936+0000","last_peered":"2023-05-15T16:40:43.162936+0000","last_clean":"2023-05-15T16:40:43.162936+0000","last_became_active":"2023-05-15T16:40:43.157222+0000","last_became_peered":"2023-05-15T16:40:43.157222+0000","last_unstale":"2023-05-15T16:40:43.162936+0000","last_undegraded":"2023-05-15T16:40:43.162936+0000","last_fullsized":"2023-05-15T16:40:43.162936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:54:13.583404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.201319+0000","last_change":"2023-05-15T16:40:43.192183+0000","last_active":"2023-05-15T16:40:43.201319+0000","last_peered":"2023-05-15T16:40:43.201319+0000","last_clean":"2023-05-15T16:40:43.201319+0000","last_became_active":"2023-05-15T16:40:43.191683+0000","last_became_peered":"2023-05-15T16:40:43.191683+0000","last_unstale":"2023-05-15T16:40:43.201319+0000","last_undegraded":"2023-05-15T16:40:43.201319+0000","last_fullsized":"2023-05-15T16:40:43.201319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:32:54.990348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.155222+0000","last_change":"2023-05-15T16:40:43.200989+0000","last_active":"2023-05-15T16:40:44.155222+0000","last_peered":"2023-05-15T16:40:44.155222+0000","last_clean":"2023-05-15T16:40:44.155222+0000","last_became_active":"2023-05-15T16:40:43.200431+0000","last_became_peered":"2023-05-15T16:40:43.200431+0000","last_unstale":"2023-05-15T16:40:44.155222+0000","last_undegraded":"2023-05-15T16:40:44.155222+0000","last_fullsized":"2023-05-15T16:40:44.155222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T03:39:01.931324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.204372+0000","last_change":"2023-05-15T16:40:43.197915+0000","last_active":"2023-05-15T16:40:43.204372+0000","last_peered":"2023-05-15T16:40:43.204372+0000","last_clean":"2023-05-15T16:40:43.204372+0000","last_became_active":"2023-05-15T16:40:43.197279+0000","last_became_peered":"2023-05-15T16:40:43.197279+0000","last_unstale":"2023-05-15T16:40:43.204372+0000","last_undegraded":"2023-05-15T16:40:43.204372+0000","last_fullsized":"2023-05-15T16:40:43.204372+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:22:58.353877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.197590+0000","last_change":"2023-05-15T16:40:43.174445+0000","last_active":"2023-05-15T16:40:43.197590+0000","last_peered":"2023-05-15T16:40:43.197590+0000","last_clean":"2023-05-15T16:40:43.197590+0000","last_became_active":"2023-05-15T16:40:43.173716+0000","last_became_peered":"2023-05-15T16:40:43.173716+0000","last_unstale":"2023-05-15T16:40:43.197590+0000","last_undegraded":"2023-05-15T16:40:43.197590+0000","last_fullsized":"2023-05-15T16:40:43.197590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:23:43.147750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.196588+0000","last_change":"2023-05-15T16:40:43.192786+0000","last_active":"2023-05-15T16:40:43.196588+0000","last_peered":"2023-05-15T16:40:43.196588+0000","last_clean":"2023-05-15T16:40:43.196588+0000","last_became_active":"2023-05-15T16:40:43.192505+0000","last_became_peered":"2023-05-15T16:40:43.192505+0000","last_unstale":"2023-05-15T16:40:43.196588+0000","last_undegraded":"2023-05-15T16:40:43.196588+0000","last_fullsized":"2023-05-15T16:40:43.196588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:02:01.937857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.201194+0000","last_change":"2023-05-15T16:40:43.182966+0000","last_active":"2023-05-15T16:40:43.201194+0000","last_peered":"2023-05-15T16:40:43.201194+0000","last_clean":"2023-05-15T16:40:43.201194+0000","last_became_active":"2023-05-15T16:40:43.182261+0000","last_became_peered":"2023-05-15T16:40:43.182261+0000","last_unstale":"2023-05-15T16:40:43.201194+0000","last_undegraded":"2023-05-15T16:40:43.201194+0000","last_fullsized":"2023-05-15T16:40:43.201194+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:51:23.731969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.210800+0000","last_change":"2023-05-15T16:40:43.209792+0000","last_active":"2023-05-15T16:40:43.210800+0000","last_peered":"2023-05-15T16:40:43.210800+0000","last_clean":"2023-05-15T16:40:43.210800+0000","last_became_active":"2023-05-15T16:40:43.209506+0000","last_became_peered":"2023-05-15T16:40:43.209506+0000","last_unstale":"2023-05-15T16:40:43.210800+0000","last_undegraded":"2023-05-15T16:40:43.210800+0000","last_fullsized":"2023-05-15T16:40:43.210800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:47:32.367510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.196694+0000","last_change":"2023-05-15T16:40:43.180667+0000","last_active":"2023-05-15T16:40:43.196694+0000","last_peered":"2023-05-15T16:40:43.196694+0000","last_clean":"2023-05-15T16:40:43.196694+0000","last_became_active":"2023-05-15T16:40:43.179715+0000","last_became_peered":"2023-05-15T16:40:43.179715+0000","last_unstale":"2023-05-15T16:40:43.196694+0000","last_undegraded":"2023-05-15T16:40:43.196694+0000","last_fullsized":"2023-05-15T16:40:43.196694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:13:17.075472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.155426+0000","last_change":"2023-05-15T16:40:43.199689+0000","last_active":"2023-05-15T16:40:44.155426+0000","last_peered":"2023-05-15T16:40:44.155426+0000","last_clean":"2023-05-15T16:40:44.155426+0000","last_became_active":"2023-05-15T16:40:43.189320+0000","last_became_peered":"2023-05-15T16:40:43.189320+0000","last_unstale":"2023-05-15T16:40:44.155426+0000","last_undegraded":"2023-05-15T16:40:44.155426+0000","last_fullsized":"2023-05-15T16:40:44.155426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:38:59.076397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.196526+0000","last_change":"2023-05-15T16:40:43.180633+0000","last_active":"2023-05-15T16:40:43.196526+0000","last_peered":"2023-05-15T16:40:43.196526+0000","last_clean":"2023-05-15T16:40:43.196526+0000","last_became_active":"2023-05-15T16:40:43.179873+0000","last_became_peered":"2023-05-15T16:40:43.179873+0000","last_unstale":"2023-05-15T16:40:43.196526+0000","last_undegraded":"2023-05-15T16:40:43.196526+0000","last_fullsized":"2023-05-15T16:40:43.196526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:02:01.937857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.182810+0000","last_change":"2023-05-15T16:40:43.170564+0000","last_active":"2023-05-15T16:40:43.182810+0000","last_peered":"2023-05-15T16:40:43.182810+0000","last_clean":"2023-05-15T16:40:43.182810+0000","last_became_active":"2023-05-15T16:40:43.169575+0000","last_became_peered":"2023-05-15T16:40:43.169575+0000","last_unstale":"2023-05-15T16:40:43.182810+0000","last_undegraded":"2023-05-15T16:40:43.182810+0000","last_fullsized":"2023-05-15T16:40:43.182810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:49:09.040666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.197915+0000","last_change":"2023-05-15T16:40:43.175763+0000","last_active":"2023-05-15T16:40:43.197915+0000","last_peered":"2023-05-15T16:40:43.197915+0000","last_clean":"2023-05-15T16:40:43.197915+0000","last_became_active":"2023-05-15T16:40:43.175034+0000","last_became_peered":"2023-05-15T16:40:43.175034+0000","last_unstale":"2023-05-15T16:40:43.197915+0000","last_undegraded":"2023-05-15T16:40:43.197915+0000","last_fullsized":"2023-05-15T16:40:43.197915+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:48:37.795757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.160204+0000","last_change":"2023-05-15T16:40:43.158518+0000","last_active":"2023-05-15T16:40:43.160204+0000","last_peered":"2023-05-15T16:40:43.160204+0000","last_clean":"2023-05-15T16:40:43.160204+0000","last_became_active":"2023-05-15T16:40:43.158185+0000","last_became_peered":"2023-05-15T16:40:43.158185+0000","last_unstale":"2023-05-15T16:40:43.160204+0000","last_undegraded":"2023-05-15T16:40:43.160204+0000","last_fullsized":"2023-05-15T16:40:43.160204+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:32:54.990348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.202296+0000","last_change":"2023-05-15T16:40:43.191948+0000","last_active":"2023-05-15T16:40:43.202296+0000","last_peered":"2023-05-15T16:40:43.202296+0000","last_clean":"2023-05-15T16:40:43.202296+0000","last_became_active":"2023-05-15T16:40:43.190786+0000","last_became_peered":"2023-05-15T16:40:43.190786+0000","last_unstale":"2023-05-15T16:40:43.202296+0000","last_undegraded":"2023-05-15T16:40:43.202296+0000","last_fullsized":"2023-05-15T16:40:43.202296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T03:39:01.931324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.204968+0000","last_change":"2023-05-15T16:40:42.798111+0000","last_active":"2023-05-15T16:40:43.204968+0000","last_peered":"2023-05-15T16:40:43.204968+0000","last_clean":"2023-05-15T16:40:43.204968+0000","last_became_active":"2023-05-15T16:40:42.797408+0000","last_became_peered":"2023-05-15T16:40:42.797408+0000","last_unstale":"2023-05-15T16:40:43.204968+0000","last_undegraded":"2023-05-15T16:40:43.204968+0000","last_fullsized":"2023-05-15T16:40:43.204968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:43:15.634348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.215164+0000","last_change":"2023-05-15T16:40:43.212440+0000","last_active":"2023-05-15T16:40:43.215164+0000","last_peered":"2023-05-15T16:40:43.215164+0000","last_clean":"2023-05-15T16:40:43.215164+0000","last_became_active":"2023-05-15T16:40:43.211953+0000","last_became_peered":"2023-05-15T16:40:43.211953+0000","last_unstale":"2023-05-15T16:40:43.215164+0000","last_undegraded":"2023-05-15T16:40:43.215164+0000","last_fullsized":"2023-05-15T16:40:43.215164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:22:12.321164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.152047+0000","last_change":"2023-05-15T16:40:42.794108+0000","last_active":"2023-05-15T16:40:44.152047+0000","last_peered":"2023-05-15T16:40:44.152047+0000","last_clean":"2023-05-15T16:40:44.152047+0000","last_became_active":"2023-05-15T16:40:42.793728+0000","last_became_peered":"2023-05-15T16:40:42.793728+0000","last_unstale":"2023-05-15T16:40:44.152047+0000","last_undegraded":"2023-05-15T16:40:44.152047+0000","last_fullsized":"2023-05-15T16:40:44.152047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:13:16.059176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.204521+0000","last_change":"2023-05-15T16:40:43.198575+0000","last_active":"2023-05-15T16:40:43.204521+0000","last_peered":"2023-05-15T16:40:43.204521+0000","last_clean":"2023-05-15T16:40:43.204521+0000","last_became_active":"2023-05-15T16:40:43.197924+0000","last_became_peered":"2023-05-15T16:40:43.197924+0000","last_unstale":"2023-05-15T16:40:43.204521+0000","last_undegraded":"2023-05-15T16:40:43.204521+0000","last_fullsized":"2023-05-15T16:40:43.204521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:58:10.796681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.177364+0000","last_change":"2023-05-15T16:40:42.789456+0000","last_active":"2023-05-15T16:40:43.177364+0000","last_peered":"2023-05-15T16:40:43.177364+0000","last_clean":"2023-05-15T16:40:43.177364+0000","last_became_active":"2023-05-15T16:40:42.789033+0000","last_became_peered":"2023-05-15T16:40:42.789033+0000","last_unstale":"2023-05-15T16:40:43.177364+0000","last_undegraded":"2023-05-15T16:40:43.177364+0000","last_fullsized":"2023-05-15T16:40:43.177364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:17:27.771249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.150065+0000","last_change":"2023-05-15T16:40:43.182473+0000","last_active":"2023-05-15T16:40:44.150065+0000","last_peered":"2023-05-15T16:40:44.150065+0000","last_clean":"2023-05-15T16:40:44.150065+0000","last_became_active":"2023-05-15T16:40:43.182160+0000","last_became_peered":"2023-05-15T16:40:43.182160+0000","last_unstale":"2023-05-15T16:40:44.150065+0000","last_undegraded":"2023-05-15T16:40:44.150065+0000","last_fullsized":"2023-05-15T16:40:44.150065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:07:03.252878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.201904+0000","last_change":"2023-05-15T16:40:42.803273+0000","last_active":"2023-05-15T16:40:43.201904+0000","last_peered":"2023-05-15T16:40:43.201904+0000","last_clean":"2023-05-15T16:40:43.201904+0000","last_became_active":"2023-05-15T16:40:42.802648+0000","last_became_peered":"2023-05-15T16:40:42.802648+0000","last_unstale":"2023-05-15T16:40:43.201904+0000","last_undegraded":"2023-05-15T16:40:43.201904+0000","last_fullsized":"2023-05-15T16:40:43.201904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:19:18.442651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.151511+0000","last_change":"2023-05-15T16:40:43.154867+0000","last_active":"2023-05-15T16:40:44.151511+0000","last_peered":"2023-05-15T16:40:44.151511+0000","last_clean":"2023-05-15T16:40:44.151511+0000","last_became_active":"2023-05-15T16:40:43.154606+0000","last_became_peered":"2023-05-15T16:40:43.154606+0000","last_unstale":"2023-05-15T16:40:44.151511+0000","last_undegraded":"2023-05-15T16:40:44.151511+0000","last_fullsized":"2023-05-15T16:40:44.151511+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:19:19.458947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.155469+0000","last_change":"2023-05-15T16:40:42.797172+0000","last_active":"2023-05-15T16:40:44.155469+0000","last_peered":"2023-05-15T16:40:44.155469+0000","last_clean":"2023-05-15T16:40:44.155469+0000","last_became_active":"2023-05-15T16:40:42.796345+0000","last_became_peered":"2023-05-15T16:40:42.796345+0000","last_unstale":"2023-05-15T16:40:44.155469+0000","last_undegraded":"2023-05-15T16:40:44.155469+0000","last_fullsized":"2023-05-15T16:40:44.155469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:15:54.165120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.155027+0000","last_change":"2023-05-15T16:40:43.185226+0000","last_active":"2023-05-15T16:40:44.155027+0000","last_peered":"2023-05-15T16:40:44.155027+0000","last_clean":"2023-05-15T16:40:44.155027+0000","last_became_active":"2023-05-15T16:40:43.183791+0000","last_became_peered":"2023-05-15T16:40:43.183791+0000","last_unstale":"2023-05-15T16:40:44.155027+0000","last_undegraded":"2023-05-15T16:40:44.155027+0000","last_fullsized":"2023-05-15T16:40:44.155027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:07:03.252878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.190090+0000","last_change":"2023-05-15T16:40:42.809671+0000","last_active":"2023-05-15T16:40:43.190090+0000","last_peered":"2023-05-15T16:40:43.190090+0000","last_clean":"2023-05-15T16:40:43.190090+0000","last_became_active":"2023-05-15T16:40:42.808988+0000","last_became_peered":"2023-05-15T16:40:42.808988+0000","last_unstale":"2023-05-15T16:40:43.190090+0000","last_undegraded":"2023-05-15T16:40:43.190090+0000","last_fullsized":"2023-05-15T16:40:43.190090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:13:16.059176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.217376+0000","last_change":"2023-05-15T16:40:43.215464+0000","last_active":"2023-05-15T16:40:43.217376+0000","last_peered":"2023-05-15T16:40:43.217376+0000","last_clean":"2023-05-15T16:40:43.217376+0000","last_became_active":"2023-05-15T16:40:43.215016+0000","last_became_peered":"2023-05-15T16:40:43.215016+0000","last_unstale":"2023-05-15T16:40:43.217376+0000","last_undegraded":"2023-05-15T16:40:43.217376+0000","last_fullsized":"2023-05-15T16:40:43.217376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:45:52.168792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.140216+0000","last_change":"2023-05-15T16:40:42.803457+0000","last_active":"2023-05-15T16:40:43.140216+0000","last_peered":"2023-05-15T16:40:43.140216+0000","last_clean":"2023-05-15T16:40:43.140216+0000","last_became_active":"2023-05-15T16:40:42.802849+0000","last_became_peered":"2023-05-15T16:40:42.802849+0000","last_unstale":"2023-05-15T16:40:43.140216+0000","last_undegraded":"2023-05-15T16:40:43.140216+0000","last_fullsized":"2023-05-15T16:40:43.140216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:52.921387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.149977+0000","last_change":"2023-05-15T16:40:43.189163+0000","last_active":"2023-05-15T16:40:44.149977+0000","last_peered":"2023-05-15T16:40:44.149977+0000","last_clean":"2023-05-15T16:40:44.149977+0000","last_became_active":"2023-05-15T16:40:43.188847+0000","last_became_peered":"2023-05-15T16:40:43.188847+0000","last_unstale":"2023-05-15T16:40:44.149977+0000","last_undegraded":"2023-05-15T16:40:44.149977+0000","last_fullsized":"2023-05-15T16:40:44.149977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:48:37.795757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.173558+0000","last_change":"2023-05-15T16:40:42.794188+0000","last_active":"2023-05-15T16:40:43.173558+0000","last_peered":"2023-05-15T16:40:43.173558+0000","last_clean":"2023-05-15T16:40:43.173558+0000","last_became_active":"2023-05-15T16:40:42.793482+0000","last_became_peered":"2023-05-15T16:40:42.793482+0000","last_unstale":"2023-05-15T16:40:43.173558+0000","last_undegraded":"2023-05-15T16:40:43.173558+0000","last_fullsized":"2023-05-15T16:40:43.173558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:48:35.444625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.188534+0000","last_change":"2023-05-15T16:40:43.183656+0000","last_active":"2023-05-15T16:40:43.188534+0000","last_peered":"2023-05-15T16:40:43.188534+0000","last_clean":"2023-05-15T16:40:43.188534+0000","last_became_active":"2023-05-15T16:40:43.183373+0000","last_became_peered":"2023-05-15T16:40:43.183373+0000","last_unstale":"2023-05-15T16:40:43.188534+0000","last_undegraded":"2023-05-15T16:40:43.188534+0000","last_fullsized":"2023-05-15T16:40:43.188534+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:17:28.787544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.150181+0000","last_change":"2023-05-15T16:40:42.779817+0000","last_active":"2023-05-15T16:40:44.150181+0000","last_peered":"2023-05-15T16:40:44.150181+0000","last_clean":"2023-05-15T16:40:44.150181+0000","last_became_active":"2023-05-15T16:40:42.779435+0000","last_became_peered":"2023-05-15T16:40:42.779435+0000","last_unstale":"2023-05-15T16:40:44.150181+0000","last_undegraded":"2023-05-15T16:40:44.150181+0000","last_fullsized":"2023-05-15T16:40:44.150181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:13:16.059176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.198027+0000","last_change":"2023-05-15T16:40:43.183839+0000","last_active":"2023-05-15T16:40:43.198027+0000","last_peered":"2023-05-15T16:40:43.198027+0000","last_clean":"2023-05-15T16:40:43.198027+0000","last_became_active":"2023-05-15T16:40:43.182959+0000","last_became_peered":"2023-05-15T16:40:43.182959+0000","last_unstale":"2023-05-15T16:40:43.198027+0000","last_undegraded":"2023-05-15T16:40:43.198027+0000","last_fullsized":"2023-05-15T16:40:43.198027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:09:27.509084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.156147+0000","last_change":"2023-05-15T16:40:42.797884+0000","last_active":"2023-05-15T16:40:44.156147+0000","last_peered":"2023-05-15T16:40:44.156147+0000","last_clean":"2023-05-15T16:40:44.156147+0000","last_became_active":"2023-05-15T16:40:42.795368+0000","last_became_peered":"2023-05-15T16:40:42.795368+0000","last_unstale":"2023-05-15T16:40:44.156147+0000","last_undegraded":"2023-05-15T16:40:44.156147+0000","last_fullsized":"2023-05-15T16:40:44.156147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:54:12.567108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.151906+0000","last_change":"2023-05-15T16:40:43.189567+0000","last_active":"2023-05-15T16:40:44.151906+0000","last_peered":"2023-05-15T16:40:44.151906+0000","last_clean":"2023-05-15T16:40:44.151906+0000","last_became_active":"2023-05-15T16:40:43.189206+0000","last_became_peered":"2023-05-15T16:40:43.189206+0000","last_unstale":"2023-05-15T16:40:44.151906+0000","last_undegraded":"2023-05-15T16:40:44.151906+0000","last_fullsized":"2023-05-15T16:40:44.151906+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:01:38.230846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.156352+0000","last_change":"2023-05-15T16:40:42.788993+0000","last_active":"2023-05-15T16:40:44.156352+0000","last_peered":"2023-05-15T16:40:44.156352+0000","last_clean":"2023-05-15T16:40:44.156352+0000","last_became_active":"2023-05-15T16:40:42.788273+0000","last_became_peered":"2023-05-15T16:40:42.788273+0000","last_unstale":"2023-05-15T16:40:44.156352+0000","last_undegraded":"2023-05-15T16:40:44.156352+0000","last_fullsized":"2023-05-15T16:40:44.156352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:52.921387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.201588+0000","last_change":"2023-05-15T16:40:43.181325+0000","last_active":"2023-05-15T16:40:43.201588+0000","last_peered":"2023-05-15T16:40:43.201588+0000","last_clean":"2023-05-15T16:40:43.201588+0000","last_became_active":"2023-05-15T16:40:43.180567+0000","last_became_peered":"2023-05-15T16:40:43.180567+0000","last_unstale":"2023-05-15T16:40:43.201588+0000","last_undegraded":"2023-05-15T16:40:43.201588+0000","last_fullsized":"2023-05-15T16:40:43.201588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:12:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.149844+0000","last_change":"2023-05-15T16:40:42.794923+0000","last_active":"2023-05-15T16:40:44.149844+0000","last_peered":"2023-05-15T16:40:44.149844+0000","last_clean":"2023-05-15T16:40:44.149844+0000","last_became_active":"2023-05-15T16:40:42.794073+0000","last_became_peered":"2023-05-15T16:40:42.794073+0000","last_unstale":"2023-05-15T16:40:44.149844+0000","last_undegraded":"2023-05-15T16:40:44.149844+0000","last_fullsized":"2023-05-15T16:40:44.149844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:51:22.715674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.151619+0000","last_change":"2023-05-15T16:40:43.182140+0000","last_active":"2023-05-15T16:40:44.151619+0000","last_peered":"2023-05-15T16:40:44.151619+0000","last_clean":"2023-05-15T16:40:44.151619+0000","last_became_active":"2023-05-15T16:40:43.181869+0000","last_became_peered":"2023-05-15T16:40:43.181869+0000","last_unstale":"2023-05-15T16:40:44.151619+0000","last_undegraded":"2023-05-15T16:40:44.151619+0000","last_fullsized":"2023-05-15T16:40:44.151619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:16:12.141164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.150512+0000","last_change":"2023-05-15T16:40:42.782184+0000","last_active":"2023-05-15T16:40:44.150512+0000","last_peered":"2023-05-15T16:40:44.150512+0000","last_clean":"2023-05-15T16:40:44.150512+0000","last_became_active":"2023-05-15T16:40:42.781528+0000","last_became_peered":"2023-05-15T16:40:42.781528+0000","last_unstale":"2023-05-15T16:40:44.150512+0000","last_undegraded":"2023-05-15T16:40:44.150512+0000","last_fullsized":"2023-05-15T16:40:44.150512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:02:00.921562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.149372+0000","last_change":"2023-05-15T16:40:43.154427+0000","last_active":"2023-05-15T16:40:44.149372+0000","last_peered":"2023-05-15T16:40:44.149372+0000","last_clean":"2023-05-15T16:40:44.149372+0000","last_became_active":"2023-05-15T16:40:43.154197+0000","last_became_peered":"2023-05-15T16:40:43.154197+0000","last_unstale":"2023-05-15T16:40:44.149372+0000","last_undegraded":"2023-05-15T16:40:44.149372+0000","last_fullsized":"2023-05-15T16:40:44.149372+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:01:38.230846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.140493+0000","last_change":"2023-05-15T16:40:42.795308+0000","last_active":"2023-05-15T16:40:43.140493+0000","last_peered":"2023-05-15T16:40:43.140493+0000","last_clean":"2023-05-15T16:40:43.140493+0000","last_became_active":"2023-05-15T16:40:42.794760+0000","last_became_peered":"2023-05-15T16:40:42.794760+0000","last_unstale":"2023-05-15T16:40:43.140493+0000","last_undegraded":"2023-05-15T16:40:43.140493+0000","last_fullsized":"2023-05-15T16:40:43.140493+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:54:12.567108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.197516+0000","last_change":"2023-05-15T16:40:43.172911+0000","last_active":"2023-05-15T16:40:43.197516+0000","last_peered":"2023-05-15T16:40:43.197516+0000","last_clean":"2023-05-15T16:40:43.197516+0000","last_became_active":"2023-05-15T16:40:43.172131+0000","last_became_peered":"2023-05-15T16:40:43.172131+0000","last_unstale":"2023-05-15T16:40:43.197516+0000","last_undegraded":"2023-05-15T16:40:43.197516+0000","last_fullsized":"2023-05-15T16:40:43.197516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:07:03.252878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.160828+0000","last_change":"2023-05-15T16:40:42.797053+0000","last_active":"2023-05-15T16:40:43.160828+0000","last_peered":"2023-05-15T16:40:43.160828+0000","last_clean":"2023-05-15T16:40:43.160828+0000","last_became_active":"2023-05-15T16:40:42.796375+0000","last_became_peered":"2023-05-15T16:40:42.796375+0000","last_unstale":"2023-05-15T16:40:43.160828+0000","last_undegraded":"2023-05-15T16:40:43.160828+0000","last_fullsized":"2023-05-15T16:40:43.160828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:50:20.441675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.150155+0000","last_change":"2023-05-15T16:40:43.156368+0000","last_active":"2023-05-15T16:40:44.150155+0000","last_peered":"2023-05-15T16:40:44.150155+0000","last_clean":"2023-05-15T16:40:44.150155+0000","last_became_active":"2023-05-15T16:40:43.156071+0000","last_became_peered":"2023-05-15T16:40:43.156071+0000","last_unstale":"2023-05-15T16:40:44.150155+0000","last_undegraded":"2023-05-15T16:40:44.150155+0000","last_fullsized":"2023-05-15T16:40:44.150155+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:38:59.076397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.206239+0000","last_change":"2023-05-15T16:40:42.809640+0000","last_active":"2023-05-15T16:40:43.206239+0000","last_peered":"2023-05-15T16:40:43.206239+0000","last_clean":"2023-05-15T16:40:43.206239+0000","last_became_active":"2023-05-15T16:40:42.808947+0000","last_became_peered":"2023-05-15T16:40:42.808947+0000","last_unstale":"2023-05-15T16:40:43.206239+0000","last_undegraded":"2023-05-15T16:40:43.206239+0000","last_fullsized":"2023-05-15T16:40:43.206239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:02:00.921562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.149794+0000","last_change":"2023-05-15T16:40:43.178287+0000","last_active":"2023-05-15T16:40:44.149794+0000","last_peered":"2023-05-15T16:40:44.149794+0000","last_clean":"2023-05-15T16:40:44.149794+0000","last_became_active":"2023-05-15T16:40:43.178017+0000","last_became_peered":"2023-05-15T16:40:43.178017+0000","last_unstale":"2023-05-15T16:40:44.149794+0000","last_undegraded":"2023-05-15T16:40:44.149794+0000","last_fullsized":"2023-05-15T16:40:44.149794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:36:28.019271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.156019+0000","last_change":"2023-05-15T16:40:42.806721+0000","last_active":"2023-05-15T16:40:44.156019+0000","last_peered":"2023-05-15T16:40:44.156019+0000","last_clean":"2023-05-15T16:40:44.156019+0000","last_became_active":"2023-05-15T16:40:42.806097+0000","last_became_peered":"2023-05-15T16:40:42.806097+0000","last_unstale":"2023-05-15T16:40:44.156019+0000","last_undegraded":"2023-05-15T16:40:44.156019+0000","last_fullsized":"2023-05-15T16:40:44.156019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:13:16.059176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.156162+0000","last_change":"2023-05-15T16:40:43.212213+0000","last_active":"2023-05-15T16:40:44.156162+0000","last_peered":"2023-05-15T16:40:44.156162+0000","last_clean":"2023-05-15T16:40:44.156162+0000","last_became_active":"2023-05-15T16:40:43.211254+0000","last_became_peered":"2023-05-15T16:40:43.211254+0000","last_unstale":"2023-05-15T16:40:44.156162+0000","last_undegraded":"2023-05-15T16:40:44.156162+0000","last_fullsized":"2023-05-15T16:40:44.156162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:19:19.458947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.216270+0000","last_change":"2023-05-15T16:40:42.800787+0000","last_active":"2023-05-15T16:40:43.216270+0000","last_peered":"2023-05-15T16:40:43.216270+0000","last_clean":"2023-05-15T16:40:43.216270+0000","last_became_active":"2023-05-15T16:40:42.800116+0000","last_became_peered":"2023-05-15T16:40:42.800116+0000","last_unstale":"2023-05-15T16:40:43.216270+0000","last_undegraded":"2023-05-15T16:40:43.216270+0000","last_fullsized":"2023-05-15T16:40:43.216270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:07:02.236582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.204474+0000","last_change":"2023-05-15T16:40:43.198615+0000","last_active":"2023-05-15T16:40:43.204474+0000","last_peered":"2023-05-15T16:40:43.204474+0000","last_clean":"2023-05-15T16:40:43.204474+0000","last_became_active":"2023-05-15T16:40:43.197982+0000","last_became_peered":"2023-05-15T16:40:43.197982+0000","last_unstale":"2023-05-15T16:40:43.204474+0000","last_undegraded":"2023-05-15T16:40:43.204474+0000","last_fullsized":"2023-05-15T16:40:43.204474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:13:17.831932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.189561+0000","last_change":"2023-05-15T16:40:42.803931+0000","last_active":"2023-05-15T16:40:43.189561+0000","last_peered":"2023-05-15T16:40:43.189561+0000","last_clean":"2023-05-15T16:40:43.189561+0000","last_became_active":"2023-05-15T16:40:42.803625+0000","last_became_peered":"2023-05-15T16:40:42.803625+0000","last_unstale":"2023-05-15T16:40:43.189561+0000","last_undegraded":"2023-05-15T16:40:43.189561+0000","last_fullsized":"2023-05-15T16:40:43.189561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:57:23.727447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.162753+0000","last_change":"2023-05-15T16:40:43.157494+0000","last_active":"2023-05-15T16:40:43.162753+0000","last_peered":"2023-05-15T16:40:43.162753+0000","last_clean":"2023-05-15T16:40:43.162753+0000","last_became_active":"2023-05-15T16:40:43.156631+0000","last_became_peered":"2023-05-15T16:40:43.156631+0000","last_unstale":"2023-05-15T16:40:43.162753+0000","last_undegraded":"2023-05-15T16:40:43.162753+0000","last_fullsized":"2023-05-15T16:40:43.162753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:15:55.181415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.140798+0000","last_change":"2023-05-15T16:40:42.788906+0000","last_active":"2023-05-15T16:40:43.140798+0000","last_peered":"2023-05-15T16:40:43.140798+0000","last_clean":"2023-05-15T16:40:43.140798+0000","last_became_active":"2023-05-15T16:40:42.788620+0000","last_became_peered":"2023-05-15T16:40:42.788620+0000","last_unstale":"2023-05-15T16:40:43.140798+0000","last_undegraded":"2023-05-15T16:40:43.140798+0000","last_fullsized":"2023-05-15T16:40:43.140798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:25:22.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.197889+0000","last_change":"2023-05-15T16:40:43.181755+0000","last_active":"2023-05-15T16:40:43.197889+0000","last_peered":"2023-05-15T16:40:43.197889+0000","last_clean":"2023-05-15T16:40:43.197889+0000","last_became_active":"2023-05-15T16:40:43.177502+0000","last_became_peered":"2023-05-15T16:40:43.177502+0000","last_unstale":"2023-05-15T16:40:43.197889+0000","last_undegraded":"2023-05-15T16:40:43.197889+0000","last_fullsized":"2023-05-15T16:40:43.197889+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:36:28.019271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.158823+0000","last_change":"2023-05-15T16:40:42.782007+0000","last_active":"2023-05-15T16:40:43.158823+0000","last_peered":"2023-05-15T16:40:43.158823+0000","last_clean":"2023-05-15T16:40:43.158823+0000","last_became_active":"2023-05-15T16:40:42.781542+0000","last_became_peered":"2023-05-15T16:40:42.781542+0000","last_unstale":"2023-05-15T16:40:43.158823+0000","last_undegraded":"2023-05-15T16:40:43.158823+0000","last_fullsized":"2023-05-15T16:40:43.158823+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:13:06.042072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.151725+0000","last_change":"2023-05-15T16:40:43.189345+0000","last_active":"2023-05-15T16:40:44.151725+0000","last_peered":"2023-05-15T16:40:44.151725+0000","last_clean":"2023-05-15T16:40:44.151725+0000","last_became_active":"2023-05-15T16:40:43.189031+0000","last_became_peered":"2023-05-15T16:40:43.189031+0000","last_unstale":"2023-05-15T16:40:44.151725+0000","last_undegraded":"2023-05-15T16:40:44.151725+0000","last_fullsized":"2023-05-15T16:40:44.151725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:48:36.460921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.144502+0000","last_change":"2023-05-15T16:40:42.789040+0000","last_active":"2023-05-15T16:40:43.144502+0000","last_peered":"2023-05-15T16:40:43.144502+0000","last_clean":"2023-05-15T16:40:43.144502+0000","last_became_active":"2023-05-15T16:40:42.788540+0000","last_became_peered":"2023-05-15T16:40:42.788540+0000","last_unstale":"2023-05-15T16:40:43.144502+0000","last_undegraded":"2023-05-15T16:40:43.144502+0000","last_fullsized":"2023-05-15T16:40:43.144502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:39:53.398134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.155072+0000","last_change":"2023-05-15T16:40:43.184388+0000","last_active":"2023-05-15T16:40:44.155072+0000","last_peered":"2023-05-15T16:40:44.155072+0000","last_clean":"2023-05-15T16:40:44.155072+0000","last_became_active":"2023-05-15T16:40:43.183621+0000","last_became_peered":"2023-05-15T16:40:43.183621+0000","last_unstale":"2023-05-15T16:40:44.155072+0000","last_undegraded":"2023-05-15T16:40:44.155072+0000","last_fullsized":"2023-05-15T16:40:44.155072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T03:42:55.273832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.147212+0000","last_change":"2023-05-15T16:40:42.805202+0000","last_active":"2023-05-15T16:40:43.147212+0000","last_peered":"2023-05-15T16:40:43.147212+0000","last_clean":"2023-05-15T16:40:43.147212+0000","last_became_active":"2023-05-15T16:40:42.804546+0000","last_became_peered":"2023-05-15T16:40:42.804546+0000","last_unstale":"2023-05-15T16:40:43.147212+0000","last_undegraded":"2023-05-15T16:40:43.147212+0000","last_fullsized":"2023-05-15T16:40:43.147212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:49:08.024370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.150352+0000","last_change":"2023-05-15T16:40:43.189409+0000","last_active":"2023-05-15T16:40:44.150352+0000","last_peered":"2023-05-15T16:40:44.150352+0000","last_clean":"2023-05-15T16:40:44.150352+0000","last_became_active":"2023-05-15T16:40:43.189124+0000","last_became_peered":"2023-05-15T16:40:43.189124+0000","last_unstale":"2023-05-15T16:40:44.150352+0000","last_undegraded":"2023-05-15T16:40:44.150352+0000","last_fullsized":"2023-05-15T16:40:44.150352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T03:39:01.931324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.144398+0000","last_change":"2023-05-15T16:40:42.783001+0000","last_active":"2023-05-15T16:40:43.144398+0000","last_peered":"2023-05-15T16:40:43.144398+0000","last_clean":"2023-05-15T16:40:43.144398+0000","last_became_active":"2023-05-15T16:40:42.782587+0000","last_became_peered":"2023-05-15T16:40:42.782587+0000","last_unstale":"2023-05-15T16:40:43.144398+0000","last_undegraded":"2023-05-15T16:40:43.144398+0000","last_fullsized":"2023-05-15T16:40:43.144398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:59:24.679349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.155744+0000","last_change":"2023-05-15T16:40:43.215772+0000","last_active":"2023-05-15T16:40:44.155744+0000","last_peered":"2023-05-15T16:40:44.155744+0000","last_clean":"2023-05-15T16:40:44.155744+0000","last_became_active":"2023-05-15T16:40:43.212358+0000","last_became_peered":"2023-05-15T16:40:43.212358+0000","last_unstale":"2023-05-15T16:40:44.155744+0000","last_undegraded":"2023-05-15T16:40:44.155744+0000","last_fullsized":"2023-05-15T16:40:44.155744+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:30:53.186798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.146857+0000","last_change":"2023-05-15T16:40:42.805460+0000","last_active":"2023-05-15T16:40:43.146857+0000","last_peered":"2023-05-15T16:40:43.146857+0000","last_clean":"2023-05-15T16:40:43.146857+0000","last_became_active":"2023-05-15T16:40:42.804833+0000","last_became_peered":"2023-05-15T16:40:42.804833+0000","last_unstale":"2023-05-15T16:40:43.146857+0000","last_undegraded":"2023-05-15T16:40:43.146857+0000","last_fullsized":"2023-05-15T16:40:43.146857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:51:22.715674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-15T16:40:42.783065+0000","last_change":"2023-05-15T16:39:50.637320+0000","last_active":"2023-05-15T16:40:42.783065+0000","last_peered":"2023-05-15T16:40:42.783065+0000","last_clean":"2023-05-15T16:40:42.783065+0000","last_became_active":"2023-05-15T16:39:50.636541+0000","last_became_peered":"2023-05-15T16:39:50.636541+0000","last_unstale":"2023-05-15T16:40:42.783065+0000","last_undegraded":"2023-05-15T16:40:42.783065+0000","last_fullsized":"2023-05-15T16:40:42.783065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:49.601783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:49.601783+0000","last_clean_scrub_stamp":"2023-05-15T16:39:49.601783+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:18:01.941203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.181687+0000","last_change":"2023-05-15T16:39:56.699270+0000","last_active":"2023-05-15T16:40:43.181687+0000","last_peered":"2023-05-15T16:40:43.181687+0000","last_clean":"2023-05-15T16:40:43.181687+0000","last_became_active":"2023-05-15T16:39:56.698429+0000","last_became_peered":"2023-05-15T16:39:56.698429+0000","last_unstale":"2023-05-15T16:40:43.181687+0000","last_undegraded":"2023-05-15T16:40:43.181687+0000","last_fullsized":"2023-05-15T16:40:43.181687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:31.428692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.191080+0000","last_change":"2023-05-15T16:40:43.186396+0000","last_active":"2023-05-15T16:40:43.191080+0000","last_peered":"2023-05-15T16:40:43.191080+0000","last_clean":"2023-05-15T16:40:43.191080+0000","last_became_active":"2023-05-15T16:40:43.186112+0000","last_became_peered":"2023-05-15T16:40:43.186112+0000","last_unstale":"2023-05-15T16:40:43.191080+0000","last_undegraded":"2023-05-15T16:40:43.191080+0000","last_fullsized":"2023-05-15T16:40:43.191080+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:59:12.131028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.156234+0000","last_change":"2023-05-15T16:40:42.799653+0000","last_active":"2023-05-15T16:40:44.156234+0000","last_peered":"2023-05-15T16:40:44.156234+0000","last_clean":"2023-05-15T16:40:44.156234+0000","last_became_active":"2023-05-15T16:40:42.795427+0000","last_became_peered":"2023-05-15T16:40:42.795427+0000","last_unstale":"2023-05-15T16:40:44.156234+0000","last_undegraded":"2023-05-15T16:40:44.156234+0000","last_fullsized":"2023-05-15T16:40:44.156234+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:02:00.921562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-15T16:40:42.782757+0000","last_change":"2023-05-15T16:39:56.700800+0000","last_active":"2023-05-15T16:40:42.782757+0000","last_peered":"2023-05-15T16:40:42.782757+0000","last_clean":"2023-05-15T16:40:42.782757+0000","last_became_active":"2023-05-15T16:39:56.700022+0000","last_became_peered":"2023-05-15T16:39:56.700022+0000","last_unstale":"2023-05-15T16:40:42.782757+0000","last_undegraded":"2023-05-15T16:40:42.782757+0000","last_fullsized":"2023-05-15T16:40:42.782757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:11:54.752932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.202706+0000","last_change":"2023-05-15T16:40:43.193016+0000","last_active":"2023-05-15T16:40:43.202706+0000","last_peered":"2023-05-15T16:40:43.202706+0000","last_clean":"2023-05-15T16:40:43.202706+0000","last_became_active":"2023-05-15T16:40:43.192302+0000","last_became_peered":"2023-05-15T16:40:43.192302+0000","last_unstale":"2023-05-15T16:40:43.202706+0000","last_undegraded":"2023-05-15T16:40:43.202706+0000","last_fullsized":"2023-05-15T16:40:43.202706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:38:59.076397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.144650+0000","last_change":"2023-05-15T16:40:42.794468+0000","last_active":"2023-05-15T16:40:43.144650+0000","last_peered":"2023-05-15T16:40:43.144650+0000","last_clean":"2023-05-15T16:40:43.144650+0000","last_became_active":"2023-05-15T16:40:42.794161+0000","last_became_peered":"2023-05-15T16:40:42.794161+0000","last_unstale":"2023-05-15T16:40:43.144650+0000","last_undegraded":"2023-05-15T16:40:43.144650+0000","last_fullsized":"2023-05-15T16:40:43.144650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:46:06.744347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-15T16:40:42.775394+0000","last_change":"2023-05-15T16:39:57.018815+0000","last_active":"2023-05-15T16:40:42.775394+0000","last_peered":"2023-05-15T16:40:42.775394+0000","last_clean":"2023-05-15T16:40:42.775394+0000","last_became_active":"2023-05-15T16:39:57.018404+0000","last_became_peered":"2023-05-15T16:39:57.018404+0000","last_unstale":"2023-05-15T16:40:42.775394+0000","last_undegraded":"2023-05-15T16:40:42.775394+0000","last_fullsized":"2023-05-15T16:40:42.775394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.149690+0000","last_change":"2023-05-15T16:40:43.204016+0000","last_active":"2023-05-15T16:40:44.149690+0000","last_peered":"2023-05-15T16:40:44.149690+0000","last_clean":"2023-05-15T16:40:44.149690+0000","last_became_active":"2023-05-15T16:40:43.203786+0000","last_became_peered":"2023-05-15T16:40:43.203786+0000","last_unstale":"2023-05-15T16:40:44.149690+0000","last_undegraded":"2023-05-15T16:40:44.149690+0000","last_fullsized":"2023-05-15T16:40:44.149690+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:30:53.186798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.151910+0000","last_change":"2023-05-15T16:40:42.778789+0000","last_active":"2023-05-15T16:40:44.151910+0000","last_peered":"2023-05-15T16:40:44.151910+0000","last_clean":"2023-05-15T16:40:44.151910+0000","last_became_active":"2023-05-15T16:40:42.778337+0000","last_became_peered":"2023-05-15T16:40:42.778337+0000","last_unstale":"2023-05-15T16:40:44.151910+0000","last_undegraded":"2023-05-15T16:40:44.151910+0000","last_fullsized":"2023-05-15T16:40:44.151910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:15:54.165120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.174896+0000","last_change":"2023-05-15T16:39:56.701269+0000","last_active":"2023-05-15T16:40:43.174896+0000","last_peered":"2023-05-15T16:40:43.174896+0000","last_clean":"2023-05-15T16:40:43.174896+0000","last_became_active":"2023-05-15T16:39:56.700221+0000","last_became_peered":"2023-05-15T16:39:56.700221+0000","last_unstale":"2023-05-15T16:40:43.174896+0000","last_undegraded":"2023-05-15T16:40:43.174896+0000","last_fullsized":"2023-05-15T16:40:43.174896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.151645+0000","last_change":"2023-05-15T16:40:43.161444+0000","last_active":"2023-05-15T16:40:44.151645+0000","last_peered":"2023-05-15T16:40:44.151645+0000","last_clean":"2023-05-15T16:40:44.151645+0000","last_became_active":"2023-05-15T16:40:43.161165+0000","last_became_peered":"2023-05-15T16:40:43.161165+0000","last_unstale":"2023-05-15T16:40:44.151645+0000","last_undegraded":"2023-05-15T16:40:44.151645+0000","last_fullsized":"2023-05-15T16:40:44.151645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:36:28.019271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.151867+0000","last_change":"2023-05-15T16:40:42.786170+0000","last_active":"2023-05-15T16:40:44.151867+0000","last_peered":"2023-05-15T16:40:44.151867+0000","last_clean":"2023-05-15T16:40:44.151867+0000","last_became_active":"2023-05-15T16:40:42.785078+0000","last_became_peered":"2023-05-15T16:40:42.785078+0000","last_unstale":"2023-05-15T16:40:44.151867+0000","last_undegraded":"2023-05-15T16:40:44.151867+0000","last_fullsized":"2023-05-15T16:40:44.151867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:02:00.921562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-15T16:40:42.778075+0000","last_change":"2023-05-15T16:39:56.692931+0000","last_active":"2023-05-15T16:40:42.778075+0000","last_peered":"2023-05-15T16:40:42.778075+0000","last_clean":"2023-05-15T16:40:42.778075+0000","last_became_active":"2023-05-15T16:39:56.692557+0000","last_became_peered":"2023-05-15T16:39:56.692557+0000","last_unstale":"2023-05-15T16:40:42.778075+0000","last_undegraded":"2023-05-15T16:40:42.778075+0000","last_fullsized":"2023-05-15T16:40:42.778075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.175146+0000","last_change":"2023-05-15T16:40:43.172843+0000","last_active":"2023-05-15T16:40:43.175146+0000","last_peered":"2023-05-15T16:40:43.175146+0000","last_clean":"2023-05-15T16:40:43.175146+0000","last_became_active":"2023-05-15T16:40:43.172521+0000","last_became_peered":"2023-05-15T16:40:43.172521+0000","last_unstale":"2023-05-15T16:40:43.175146+0000","last_undegraded":"2023-05-15T16:40:43.175146+0000","last_fullsized":"2023-05-15T16:40:43.175146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T03:49:27.348692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.159270+0000","last_change":"2023-05-15T16:40:42.786842+0000","last_active":"2023-05-15T16:40:43.159270+0000","last_peered":"2023-05-15T16:40:43.159270+0000","last_clean":"2023-05-15T16:40:43.159270+0000","last_became_active":"2023-05-15T16:40:42.786172+0000","last_became_peered":"2023-05-15T16:40:42.786172+0000","last_unstale":"2023-05-15T16:40:43.159270+0000","last_undegraded":"2023-05-15T16:40:43.159270+0000","last_fullsized":"2023-05-15T16:40:43.159270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:35:33.445034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-15T16:40:42.785242+0000","last_change":"2023-05-15T16:39:56.698079+0000","last_active":"2023-05-15T16:40:42.785242+0000","last_peered":"2023-05-15T16:40:42.785242+0000","last_clean":"2023-05-15T16:40:42.785242+0000","last_became_active":"2023-05-15T16:39:56.697298+0000","last_became_peered":"2023-05-15T16:39:56.697298+0000","last_unstale":"2023-05-15T16:40:42.785242+0000","last_undegraded":"2023-05-15T16:40:42.785242+0000","last_fullsized":"2023-05-15T16:40:42.785242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:32:01.734351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.204602+0000","last_change":"2023-05-15T16:40:43.199603+0000","last_active":"2023-05-15T16:40:43.204602+0000","last_peered":"2023-05-15T16:40:43.204602+0000","last_clean":"2023-05-15T16:40:43.204602+0000","last_became_active":"2023-05-15T16:40:43.198878+0000","last_became_peered":"2023-05-15T16:40:43.198878+0000","last_unstale":"2023-05-15T16:40:43.204602+0000","last_undegraded":"2023-05-15T16:40:43.204602+0000","last_fullsized":"2023-05-15T16:40:43.204602+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:06:37.098737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.172156+0000","last_change":"2023-05-15T16:40:42.770923+0000","last_active":"2023-05-15T16:40:43.172156+0000","last_peered":"2023-05-15T16:40:43.172156+0000","last_clean":"2023-05-15T16:40:43.172156+0000","last_became_active":"2023-05-15T16:40:42.768742+0000","last_became_peered":"2023-05-15T16:40:42.768742+0000","last_unstale":"2023-05-15T16:40:43.172156+0000","last_undegraded":"2023-05-15T16:40:43.172156+0000","last_fullsized":"2023-05-15T16:40:43.172156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:01:37.214550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-15T16:40:42.778264+0000","last_change":"2023-05-15T16:39:56.694298+0000","last_active":"2023-05-15T16:40:42.778264+0000","last_peered":"2023-05-15T16:40:42.778264+0000","last_clean":"2023-05-15T16:40:42.778264+0000","last_became_active":"2023-05-15T16:39:56.693723+0000","last_became_peered":"2023-05-15T16:39:56.693723+0000","last_unstale":"2023-05-15T16:40:42.778264+0000","last_undegraded":"2023-05-15T16:40:42.778264+0000","last_fullsized":"2023-05-15T16:40:42.778264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:31.428692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.197991+0000","last_change":"2023-05-15T16:40:43.174885+0000","last_active":"2023-05-15T16:40:43.197991+0000","last_peered":"2023-05-15T16:40:43.197991+0000","last_clean":"2023-05-15T16:40:43.197991+0000","last_became_active":"2023-05-15T16:40:43.174094+0000","last_became_peered":"2023-05-15T16:40:43.174094+0000","last_unstale":"2023-05-15T16:40:43.197991+0000","last_undegraded":"2023-05-15T16:40:43.197991+0000","last_fullsized":"2023-05-15T16:40:43.197991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:36:01.464099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.149450+0000","last_change":"2023-05-15T16:40:42.780134+0000","last_active":"2023-05-15T16:40:44.149450+0000","last_peered":"2023-05-15T16:40:44.149450+0000","last_clean":"2023-05-15T16:40:44.149450+0000","last_became_active":"2023-05-15T16:40:42.779554+0000","last_became_peered":"2023-05-15T16:40:42.779554+0000","last_unstale":"2023-05-15T16:40:44.149450+0000","last_undegraded":"2023-05-15T16:40:44.149450+0000","last_fullsized":"2023-05-15T16:40:44.149450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:49:08.024370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-15T16:40:42.778449+0000","last_change":"2023-05-15T16:39:56.697003+0000","last_active":"2023-05-15T16:40:42.778449+0000","last_peered":"2023-05-15T16:40:42.778449+0000","last_clean":"2023-05-15T16:40:42.778449+0000","last_became_active":"2023-05-15T16:39:56.696210+0000","last_became_peered":"2023-05-15T16:39:56.696210+0000","last_unstale":"2023-05-15T16:40:42.778449+0000","last_undegraded":"2023-05-15T16:40:42.778449+0000","last_fullsized":"2023-05-15T16:40:42.778449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:29:27.454964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9544,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362296,"statfs":{"total":96636764160,"available":96626991104,"internally_reserved":0,"allocated":983040,"data_stored":742187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8312,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363528,"statfs":{"total":96636764160,"available":96628252672,"internally_reserved":0,"allocated":376832,"data_stored":150767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8380,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363460,"statfs":{"total":96636764160,"available":96628183040,"internally_reserved":0,"allocated":380928,"data_stored":150313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8508,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363332,"statfs":{"total":96636764160,"available":96628051968,"internally_reserved":0,"allocated":380928,"data_stored":150789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8452,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363388,"statfs":{"total":96636764160,"available":96628109312,"internally_reserved":0,"allocated":389120,"data_stored":151783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8312,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363528,"statfs":{"total":96636764160,"available":96628252672,"internally_reserved":0,"allocated":376832,"data_stored":150271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8376,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363464,"statfs":{"total":96636764160,"available":96628187136,"internally_reserved":0,"allocated":376832,"data_stored":150291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9468,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362372,"statfs":{"total":96636764160,"available":96627068928,"internally_reserved":0,"allocated":970752,"data_stored":740603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-15T16:40:46.171 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-05-15T16:40:46.325 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.323+0000 7fe44954a640 1 Processor -- start 2023-05-15T16:40:46.326 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.323+0000 7fe44954a640 1 -- start start 2023-05-15T16:40:46.327 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.323+0000 7fe44954a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe444071a90 0x7fe4440b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:46.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.323+0000 7fe44954a640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe444144e90 0x7fe444145310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:46.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.323+0000 7fe44954a640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4440716b0 con 0x7fe4440b5330 2023-05-15T16:40:46.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.323+0000 7fe44954a640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4440b2280 con 0x7fe444144e90 2023-05-15T16:40:46.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.323+0000 7fe44954a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4440afa90 con 0x7fe444071a90 2023-05-15T16:40:46.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.323+0000 7fe43bfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe444071a90 0x7fe4440b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:46.328 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.323+0000 7fe4437fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe444144e90 0x7fe444145310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:46.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.323+0000 7fe43bfff640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe444071a90 0x7fe4440b5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3301/0 says I am v2:172.21.15.62:33006/0 (socket says 172.21.15.62:33006) 2023-05-15T16:40:46.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.323+0000 7fe4437fe640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fe444144e90 0x7fe444145310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.62:45176/0 (socket says 172.21.15.62:45176) 2023-05-15T16:40:46.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.323+0000 7fe43bfff640 1 -- 172.21.15.62:0/2754698399 learned_addr learned my addr 172.21.15.62:0/2754698399 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:46.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.323+0000 7fe442ffd640 1 --1- 172.21.15.62:0/2754698399 >> v1:172.21.15.161:6789/0 conn(0x7fe4440b5330 0x7fe4440b16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.62:42026/0 (socket says 172.21.15.62:42026) 2023-05-15T16:40:46.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.323+0000 7fe4437fe640 1 -- 172.21.15.62:0/2754698399 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe444071a90 msgr2=0x7fe4440b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:46.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.323+0000 7fe4437fe640 1 --2- 172.21.15.62:0/2754698399 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe444071a90 0x7fe4440b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.329 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.323+0000 7fe4437fe640 1 -- 172.21.15.62:0/2754698399 >> v1:172.21.15.161:6789/0 conn(0x7fe4440b5330 legacy=0x7fe4440b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:46.330 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.323+0000 7fe4437fe640 1 -- 172.21.15.62:0/2754698399 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4440b0f00 con 0x7fe444144e90 2023-05-15T16:40:46.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe4437fe640 1 --2- 172.21.15.62:0/2754698399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe444144e90 0x7fe444145310 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009d90 tx=0x7fe43c01c920 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bbce1b504190e49a server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:46.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe4427fc640 1 -- 172.21.15.62:0/2754698399 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c0a59e0 con 0x7fe444144e90 2023-05-15T16:40:46.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe4427fc640 1 -- 172.21.15.62:0/2754698399 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe43c0a5b40 con 0x7fe444144e90 2023-05-15T16:40:46.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe4427fc640 1 -- 172.21.15.62:0/2754698399 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe43c0ad440 con 0x7fe444144e90 2023-05-15T16:40:46.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe44954a640 1 -- 172.21.15.62:0/2754698399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe444144e90 msgr2=0x7fe444145310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:46.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe44954a640 1 --2- 172.21.15.62:0/2754698399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe444144e90 0x7fe444145310 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009d90 tx=0x7fe43c01c920 comp rx=0 tx=0).stop 2023-05-15T16:40:46.331 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe44954a640 1 -- 172.21.15.62:0/2754698399 shutdown_connections 2023-05-15T16:40:46.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe44954a640 1 --2- 172.21.15.62:0/2754698399 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe444144e90 0x7fe444145310 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe44954a640 1 --2- 172.21.15.62:0/2754698399 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe444071a90 0x7fe4440b5700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe44954a640 1 -- 172.21.15.62:0/2754698399 >> 172.21.15.62:0/2754698399 conn(0x7fe4440653f0 msgr2=0x7fe4440697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:46.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe44954a640 1 -- 172.21.15.62:0/2754698399 shutdown_connections 2023-05-15T16:40:46.332 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe44954a640 1 -- 172.21.15.62:0/2754698399 wait complete. 2023-05-15T16:40:46.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe44954a640 1 Processor -- start 2023-05-15T16:40:46.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe44954a640 1 -- start start 2023-05-15T16:40:46.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe44954a640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe444071a90 0x7fe4441370c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:46.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe44954a640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4440b5330 0x7fe44413af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:46.335 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe44954a640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe444144e90 0x7fe44413c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:46.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe44954a640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe444137600 con 0x7fe444071a90 2023-05-15T16:40:46.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe44954a640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4441e1c80 con 0x7fe444144e90 2023-05-15T16:40:46.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe44954a640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4441e1ed0 con 0x7fe4440b5330 2023-05-15T16:40:46.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe442ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe444071a90 0x7fe4441370c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:46.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe442ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe444071a90 0x7fe4441370c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43872/0 (socket says 172.21.15.62:43872) 2023-05-15T16:40:46.336 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe442ffd640 1 -- 172.21.15.62:0/2275734027 learned_addr learned my addr 172.21.15.62:0/2275734027 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:46.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe4437fe640 1 --2- 172.21.15.62:0/2275734027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe444144e90 0x7fe44413c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:46.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe43bfff640 1 --2- 172.21.15.62:0/2275734027 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4440b5330 0x7fe44413af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:46.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe442ffd640 1 -- 172.21.15.62:0/2275734027 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4440b5330 msgr2=0x7fe44413af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:46.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe442ffd640 1 --2- 172.21.15.62:0/2275734027 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4440b5330 0x7fe44413af80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe442ffd640 1 -- 172.21.15.62:0/2275734027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe444144e90 msgr2=0x7fe44413c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:46.337 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe442ffd640 1 --2- 172.21.15.62:0/2275734027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe444144e90 0x7fe44413c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe442ffd640 1 -- 172.21.15.62:0/2275734027 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe43c009a70 con 0x7fe444071a90 2023-05-15T16:40:46.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.327+0000 7fe43bfff640 1 --2- 172.21.15.62:0/2275734027 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4440b5330 0x7fe44413af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:46.338 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.331+0000 7fe442ffd640 1 --2- 172.21.15.62:0/2275734027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe444071a90 0x7fe4441370c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe43400c450 tx=0x7fe43400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:46.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.331+0000 7fe43b7fe640 1 -- 172.21.15.62:0/2275734027 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe434007480 con 0x7fe444071a90 2023-05-15T16:40:46.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.331+0000 7fe43b7fe640 1 -- 172.21.15.62:0/2275734027 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4340075e0 con 0x7fe444071a90 2023-05-15T16:40:46.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.331+0000 7fe44954a640 1 -- 172.21.15.62:0/2275734027 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4440b2050 con 0x7fe444071a90 2023-05-15T16:40:46.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.331+0000 7fe43b7fe640 1 -- 172.21.15.62:0/2275734027 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe434004a30 con 0x7fe444071a90 2023-05-15T16:40:46.339 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.331+0000 7fe44954a640 1 -- 172.21.15.62:0/2275734027 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4440b1ec0 con 0x7fe444071a90 2023-05-15T16:40:46.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.331+0000 7fe44954a640 1 -- 172.21.15.62:0/2275734027 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe44414b000 con 0x7fe444071a90 2023-05-15T16:40:46.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.331+0000 7fe43b7fe640 1 -- 172.21.15.62:0/2275734027 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fe434004b90 con 0x7fe444071a90 2023-05-15T16:40:46.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.331+0000 7fe43b7fe640 1 --2- 172.21.15.62:0/2275734027 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe424065380 0x7fe424067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:46.340 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.331+0000 7fe43b7fe640 1 -- 172.21.15.62:0/2275734027 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fe434081c70 con 0x7fe444071a90 2023-05-15T16:40:46.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.331+0000 7fe43bfff640 1 --2- 172.21.15.62:0/2275734027 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe424065380 0x7fe424067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:46.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.331+0000 7fe43bfff640 1 --2- 172.21.15.62:0/2275734027 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe424065380 0x7fe424067830 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe4440715d0 tx=0x7fe42c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:46.341 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.335+0000 7fe43b7fe640 1 -- 172.21.15.62:0/2275734027 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fe43404f890 con 0x7fe444071a90 2023-05-15T16:40:46.491 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.487+0000 7fe44954a640 1 -- 172.21.15.62:0/2275734027 --> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe44404dbe0 con 0x7fe424065380 2023-05-15T16:40:46.513 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.507+0000 7fe43b7fe640 1 -- 172.21.15.62:0/2275734027 <== mgr.4105 v2:172.21.15.161:6832/37541 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286623 (secure 0 0 0) 0x7fe44404dbe0 con 0x7fe424065380 2023-05-15T16:40:46.514 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:46.516 INFO:teuthology.orchestra.run.smithi062.stderr:dumped all 2023-05-15T16:40:46.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.515+0000 7fe44954a640 1 -- 172.21.15.62:0/2275734027 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe424065380 msgr2=0x7fe424067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:46.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.515+0000 7fe44954a640 1 --2- 172.21.15.62:0/2275734027 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe424065380 0x7fe424067830 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe4440715d0 tx=0x7fe42c008040 comp rx=0 tx=0).stop 2023-05-15T16:40:46.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.515+0000 7fe44954a640 1 -- 172.21.15.62:0/2275734027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe444071a90 msgr2=0x7fe4441370c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:46.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.515+0000 7fe44954a640 1 --2- 172.21.15.62:0/2275734027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe444071a90 0x7fe4441370c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe43400c450 tx=0x7fe43400c910 comp rx=0 tx=0).stop 2023-05-15T16:40:46.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.515+0000 7fe44954a640 1 -- 172.21.15.62:0/2275734027 shutdown_connections 2023-05-15T16:40:46.518 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.515+0000 7fe44954a640 1 --2- 172.21.15.62:0/2275734027 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fe444144e90 0x7fe44413c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.515+0000 7fe44954a640 1 --2- 172.21.15.62:0/2275734027 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fe4440b5330 0x7fe44413af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.515+0000 7fe44954a640 1 --2- 172.21.15.62:0/2275734027 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fe424065380 0x7fe424067830 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.515+0000 7fe44954a640 1 --2- 172.21.15.62:0/2275734027 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fe444071a90 0x7fe4441370c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.515+0000 7fe44954a640 1 -- 172.21.15.62:0/2275734027 >> 172.21.15.62:0/2275734027 conn(0x7fe4440653f0 msgr2=0x7fe4440baae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:46.519 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.515+0000 7fe44954a640 1 -- 172.21.15.62:0/2275734027 shutdown_connections 2023-05-15T16:40:46.520 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.515+0000 7fe44954a640 1 -- 172.21.15.62:0/2275734027 wait complete. 2023-05-15T16:40:46.536 INFO:teuthology.orchestra.run.smithi062.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-05-15T16:40:45.331432+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592698,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":69352,"kb_used_data":4136,"kb_used_omap":0,"kb_used_meta":65152,"kb_avail":754905368,"statfs":{"total":773094113280,"available":773023096832,"internally_reserved":0,"allocated":4235264,"data_stored":2387004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":66715648},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":65,"apply_latency_ms":65,"commit_latency_ns":65000000,"apply_latency_ns":65000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001238"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.150182+0000","last_change":"2023-05-15T16:40:43.160673+0000","last_active":"2023-05-15T16:40:44.150182+0000","last_peered":"2023-05-15T16:40:44.150182+0000","last_clean":"2023-05-15T16:40:44.150182+0000","last_became_active":"2023-05-15T16:40:43.160400+0000","last_became_peered":"2023-05-15T16:40:43.160400+0000","last_unstale":"2023-05-15T16:40:44.150182+0000","last_undegraded":"2023-05-15T16:40:44.150182+0000","last_fullsized":"2023-05-15T16:40:44.150182+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:09:27.509084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.149657+0000","last_change":"2023-05-15T16:40:43.163583+0000","last_active":"2023-05-15T16:40:44.149657+0000","last_peered":"2023-05-15T16:40:44.149657+0000","last_clean":"2023-05-15T16:40:44.149657+0000","last_became_active":"2023-05-15T16:40:43.163382+0000","last_became_peered":"2023-05-15T16:40:43.163382+0000","last_unstale":"2023-05-15T16:40:44.149657+0000","last_undegraded":"2023-05-15T16:40:44.149657+0000","last_fullsized":"2023-05-15T16:40:44.149657+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:48:36.460921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.152070+0000","last_change":"2023-05-15T16:40:43.211610+0000","last_active":"2023-05-15T16:40:44.152070+0000","last_peered":"2023-05-15T16:40:44.152070+0000","last_clean":"2023-05-15T16:40:44.152070+0000","last_became_active":"2023-05-15T16:40:43.211274+0000","last_became_peered":"2023-05-15T16:40:43.211274+0000","last_unstale":"2023-05-15T16:40:44.152070+0000","last_undegraded":"2023-05-15T16:40:44.152070+0000","last_fullsized":"2023-05-15T16:40:44.152070+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:36:01.464099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.200273+0000","last_change":"2023-05-15T16:40:43.197080+0000","last_active":"2023-05-15T16:40:43.200273+0000","last_peered":"2023-05-15T16:40:43.200273+0000","last_clean":"2023-05-15T16:40:43.200273+0000","last_became_active":"2023-05-15T16:40:43.196772+0000","last_became_peered":"2023-05-15T16:40:43.196772+0000","last_unstale":"2023-05-15T16:40:43.200273+0000","last_undegraded":"2023-05-15T16:40:43.200273+0000","last_fullsized":"2023-05-15T16:40:43.200273+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:28:36.725852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.183148+0000","last_change":"2023-05-15T16:40:43.178213+0000","last_active":"2023-05-15T16:40:43.183148+0000","last_peered":"2023-05-15T16:40:43.183148+0000","last_clean":"2023-05-15T16:40:43.183148+0000","last_became_active":"2023-05-15T16:40:43.177948+0000","last_became_peered":"2023-05-15T16:40:43.177948+0000","last_unstale":"2023-05-15T16:40:43.183148+0000","last_undegraded":"2023-05-15T16:40:43.183148+0000","last_fullsized":"2023-05-15T16:40:43.183148+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:53.937682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.164050+0000","last_change":"2023-05-15T16:40:43.162143+0000","last_active":"2023-05-15T16:40:43.164050+0000","last_peered":"2023-05-15T16:40:43.164050+0000","last_clean":"2023-05-15T16:40:43.164050+0000","last_became_active":"2023-05-15T16:40:43.161588+0000","last_became_peered":"2023-05-15T16:40:43.161588+0000","last_unstale":"2023-05-15T16:40:43.164050+0000","last_undegraded":"2023-05-15T16:40:43.164050+0000","last_fullsized":"2023-05-15T16:40:43.164050+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:41:07.655815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.154775+0000","last_change":"2023-05-15T16:40:43.185677+0000","last_active":"2023-05-15T16:40:44.154775+0000","last_peered":"2023-05-15T16:40:44.154775+0000","last_clean":"2023-05-15T16:40:44.154775+0000","last_became_active":"2023-05-15T16:40:43.184529+0000","last_became_peered":"2023-05-15T16:40:43.184529+0000","last_unstale":"2023-05-15T16:40:44.154775+0000","last_undegraded":"2023-05-15T16:40:44.154775+0000","last_fullsized":"2023-05-15T16:40:44.154775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:48:37.795757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.149294+0000","last_change":"2023-05-15T16:40:43.185390+0000","last_active":"2023-05-15T16:40:44.149294+0000","last_peered":"2023-05-15T16:40:44.149294+0000","last_clean":"2023-05-15T16:40:44.149294+0000","last_became_active":"2023-05-15T16:40:43.185090+0000","last_became_peered":"2023-05-15T16:40:43.185090+0000","last_unstale":"2023-05-15T16:40:44.149294+0000","last_undegraded":"2023-05-15T16:40:44.149294+0000","last_fullsized":"2023-05-15T16:40:44.149294+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:36:01.464099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.152079+0000","last_change":"2023-05-15T16:40:43.210314+0000","last_active":"2023-05-15T16:40:44.152079+0000","last_peered":"2023-05-15T16:40:44.152079+0000","last_clean":"2023-05-15T16:40:44.152079+0000","last_became_active":"2023-05-15T16:40:43.209965+0000","last_became_peered":"2023-05-15T16:40:43.209965+0000","last_unstale":"2023-05-15T16:40:44.152079+0000","last_undegraded":"2023-05-15T16:40:44.152079+0000","last_fullsized":"2023-05-15T16:40:44.152079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:07:03.252878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.155637+0000","last_change":"2023-05-15T16:40:43.214512+0000","last_active":"2023-05-15T16:40:44.155637+0000","last_peered":"2023-05-15T16:40:44.155637+0000","last_clean":"2023-05-15T16:40:44.155637+0000","last_became_active":"2023-05-15T16:40:43.211314+0000","last_became_peered":"2023-05-15T16:40:43.211314+0000","last_unstale":"2023-05-15T16:40:44.155637+0000","last_undegraded":"2023-05-15T16:40:44.155637+0000","last_fullsized":"2023-05-15T16:40:44.155637+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:36:28.019271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.156140+0000","last_change":"2023-05-15T16:40:43.213368+0000","last_active":"2023-05-15T16:40:44.156140+0000","last_peered":"2023-05-15T16:40:44.156140+0000","last_clean":"2023-05-15T16:40:44.156140+0000","last_became_active":"2023-05-15T16:40:43.212895+0000","last_became_peered":"2023-05-15T16:40:43.212895+0000","last_unstale":"2023-05-15T16:40:44.156140+0000","last_undegraded":"2023-05-15T16:40:44.156140+0000","last_fullsized":"2023-05-15T16:40:44.156140+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:09:27.509084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.151822+0000","last_change":"2023-05-15T16:40:43.163691+0000","last_active":"2023-05-15T16:40:44.151822+0000","last_peered":"2023-05-15T16:40:44.151822+0000","last_clean":"2023-05-15T16:40:44.151822+0000","last_became_active":"2023-05-15T16:40:43.163387+0000","last_became_peered":"2023-05-15T16:40:43.163387+0000","last_unstale":"2023-05-15T16:40:44.151822+0000","last_undegraded":"2023-05-15T16:40:44.151822+0000","last_fullsized":"2023-05-15T16:40:44.151822+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:20:07.783148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.155744+0000","last_change":"2023-05-15T16:40:43.202451+0000","last_active":"2023-05-15T16:40:44.155744+0000","last_peered":"2023-05-15T16:40:44.155744+0000","last_clean":"2023-05-15T16:40:44.155744+0000","last_became_active":"2023-05-15T16:40:43.201781+0000","last_became_peered":"2023-05-15T16:40:43.201781+0000","last_unstale":"2023-05-15T16:40:44.155744+0000","last_undegraded":"2023-05-15T16:40:44.155744+0000","last_fullsized":"2023-05-15T16:40:44.155744+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:48:36.460921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.205367+0000","last_change":"2023-05-15T16:40:43.203715+0000","last_active":"2023-05-15T16:40:43.205367+0000","last_peered":"2023-05-15T16:40:43.205367+0000","last_clean":"2023-05-15T16:40:43.205367+0000","last_became_active":"2023-05-15T16:40:43.203124+0000","last_became_peered":"2023-05-15T16:40:43.203124+0000","last_unstale":"2023-05-15T16:40:43.205367+0000","last_undegraded":"2023-05-15T16:40:43.205367+0000","last_fullsized":"2023-05-15T16:40:43.205367+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:34:13.546068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.154878+0000","last_change":"2023-05-15T16:40:43.198632+0000","last_active":"2023-05-15T16:40:44.154878+0000","last_peered":"2023-05-15T16:40:44.154878+0000","last_clean":"2023-05-15T16:40:44.154878+0000","last_became_active":"2023-05-15T16:40:43.189529+0000","last_became_peered":"2023-05-15T16:40:43.189529+0000","last_unstale":"2023-05-15T16:40:44.154878+0000","last_undegraded":"2023-05-15T16:40:44.154878+0000","last_fullsized":"2023-05-15T16:40:44.154878+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:36:01.464099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.198378+0000","last_change":"2023-05-15T16:40:43.187747+0000","last_active":"2023-05-15T16:40:43.198378+0000","last_peered":"2023-05-15T16:40:43.198378+0000","last_clean":"2023-05-15T16:40:43.198378+0000","last_became_active":"2023-05-15T16:40:43.187018+0000","last_became_peered":"2023-05-15T16:40:43.187018+0000","last_unstale":"2023-05-15T16:40:43.198378+0000","last_undegraded":"2023-05-15T16:40:43.198378+0000","last_fullsized":"2023-05-15T16:40:43.198378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:48:36.460921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.215039+0000","last_change":"2023-05-15T16:40:43.213361+0000","last_active":"2023-05-15T16:40:43.215039+0000","last_peered":"2023-05-15T16:40:43.215039+0000","last_clean":"2023-05-15T16:40:43.215039+0000","last_became_active":"2023-05-15T16:40:43.211851+0000","last_became_peered":"2023-05-15T16:40:43.211851+0000","last_unstale":"2023-05-15T16:40:43.215039+0000","last_undegraded":"2023-05-15T16:40:43.215039+0000","last_fullsized":"2023-05-15T16:40:43.215039+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:30:53.186798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.206776+0000","last_change":"2023-05-15T16:40:43.204270+0000","last_active":"2023-05-15T16:40:43.206776+0000","last_peered":"2023-05-15T16:40:43.206776+0000","last_clean":"2023-05-15T16:40:43.206776+0000","last_became_active":"2023-05-15T16:40:43.203576+0000","last_became_peered":"2023-05-15T16:40:43.203576+0000","last_unstale":"2023-05-15T16:40:43.206776+0000","last_undegraded":"2023-05-15T16:40:43.206776+0000","last_fullsized":"2023-05-15T16:40:43.206776+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:40:05.358131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.162936+0000","last_change":"2023-05-15T16:40:43.157463+0000","last_active":"2023-05-15T16:40:43.162936+0000","last_peered":"2023-05-15T16:40:43.162936+0000","last_clean":"2023-05-15T16:40:43.162936+0000","last_became_active":"2023-05-15T16:40:43.157222+0000","last_became_peered":"2023-05-15T16:40:43.157222+0000","last_unstale":"2023-05-15T16:40:43.162936+0000","last_undegraded":"2023-05-15T16:40:43.162936+0000","last_fullsized":"2023-05-15T16:40:43.162936+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:54:13.583404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.201319+0000","last_change":"2023-05-15T16:40:43.192183+0000","last_active":"2023-05-15T16:40:43.201319+0000","last_peered":"2023-05-15T16:40:43.201319+0000","last_clean":"2023-05-15T16:40:43.201319+0000","last_became_active":"2023-05-15T16:40:43.191683+0000","last_became_peered":"2023-05-15T16:40:43.191683+0000","last_unstale":"2023-05-15T16:40:43.201319+0000","last_undegraded":"2023-05-15T16:40:43.201319+0000","last_fullsized":"2023-05-15T16:40:43.201319+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:32:54.990348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.155222+0000","last_change":"2023-05-15T16:40:43.200989+0000","last_active":"2023-05-15T16:40:44.155222+0000","last_peered":"2023-05-15T16:40:44.155222+0000","last_clean":"2023-05-15T16:40:44.155222+0000","last_became_active":"2023-05-15T16:40:43.200431+0000","last_became_peered":"2023-05-15T16:40:43.200431+0000","last_unstale":"2023-05-15T16:40:44.155222+0000","last_undegraded":"2023-05-15T16:40:44.155222+0000","last_fullsized":"2023-05-15T16:40:44.155222+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T03:39:01.931324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.204372+0000","last_change":"2023-05-15T16:40:43.197915+0000","last_active":"2023-05-15T16:40:43.204372+0000","last_peered":"2023-05-15T16:40:43.204372+0000","last_clean":"2023-05-15T16:40:43.204372+0000","last_became_active":"2023-05-15T16:40:43.197279+0000","last_became_peered":"2023-05-15T16:40:43.197279+0000","last_unstale":"2023-05-15T16:40:43.204372+0000","last_undegraded":"2023-05-15T16:40:43.204372+0000","last_fullsized":"2023-05-15T16:40:43.204372+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:22:58.353877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.197590+0000","last_change":"2023-05-15T16:40:43.174445+0000","last_active":"2023-05-15T16:40:43.197590+0000","last_peered":"2023-05-15T16:40:43.197590+0000","last_clean":"2023-05-15T16:40:43.197590+0000","last_became_active":"2023-05-15T16:40:43.173716+0000","last_became_peered":"2023-05-15T16:40:43.173716+0000","last_unstale":"2023-05-15T16:40:43.197590+0000","last_undegraded":"2023-05-15T16:40:43.197590+0000","last_fullsized":"2023-05-15T16:40:43.197590+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:23:43.147750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.196588+0000","last_change":"2023-05-15T16:40:43.192786+0000","last_active":"2023-05-15T16:40:43.196588+0000","last_peered":"2023-05-15T16:40:43.196588+0000","last_clean":"2023-05-15T16:40:43.196588+0000","last_became_active":"2023-05-15T16:40:43.192505+0000","last_became_peered":"2023-05-15T16:40:43.192505+0000","last_unstale":"2023-05-15T16:40:43.196588+0000","last_undegraded":"2023-05-15T16:40:43.196588+0000","last_fullsized":"2023-05-15T16:40:43.196588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:02:01.937857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.201194+0000","last_change":"2023-05-15T16:40:43.182966+0000","last_active":"2023-05-15T16:40:43.201194+0000","last_peered":"2023-05-15T16:40:43.201194+0000","last_clean":"2023-05-15T16:40:43.201194+0000","last_became_active":"2023-05-15T16:40:43.182261+0000","last_became_peered":"2023-05-15T16:40:43.182261+0000","last_unstale":"2023-05-15T16:40:43.201194+0000","last_undegraded":"2023-05-15T16:40:43.201194+0000","last_fullsized":"2023-05-15T16:40:43.201194+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:51:23.731969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.210800+0000","last_change":"2023-05-15T16:40:43.209792+0000","last_active":"2023-05-15T16:40:43.210800+0000","last_peered":"2023-05-15T16:40:43.210800+0000","last_clean":"2023-05-15T16:40:43.210800+0000","last_became_active":"2023-05-15T16:40:43.209506+0000","last_became_peered":"2023-05-15T16:40:43.209506+0000","last_unstale":"2023-05-15T16:40:43.210800+0000","last_undegraded":"2023-05-15T16:40:43.210800+0000","last_fullsized":"2023-05-15T16:40:43.210800+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T16:47:32.367510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.196694+0000","last_change":"2023-05-15T16:40:43.180667+0000","last_active":"2023-05-15T16:40:43.196694+0000","last_peered":"2023-05-15T16:40:43.196694+0000","last_clean":"2023-05-15T16:40:43.196694+0000","last_became_active":"2023-05-15T16:40:43.179715+0000","last_became_peered":"2023-05-15T16:40:43.179715+0000","last_unstale":"2023-05-15T16:40:43.196694+0000","last_undegraded":"2023-05-15T16:40:43.196694+0000","last_fullsized":"2023-05-15T16:40:43.196694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:13:17.075472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.155426+0000","last_change":"2023-05-15T16:40:43.199689+0000","last_active":"2023-05-15T16:40:44.155426+0000","last_peered":"2023-05-15T16:40:44.155426+0000","last_clean":"2023-05-15T16:40:44.155426+0000","last_became_active":"2023-05-15T16:40:43.189320+0000","last_became_peered":"2023-05-15T16:40:43.189320+0000","last_unstale":"2023-05-15T16:40:44.155426+0000","last_undegraded":"2023-05-15T16:40:44.155426+0000","last_fullsized":"2023-05-15T16:40:44.155426+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:38:59.076397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.196526+0000","last_change":"2023-05-15T16:40:43.180633+0000","last_active":"2023-05-15T16:40:43.196526+0000","last_peered":"2023-05-15T16:40:43.196526+0000","last_clean":"2023-05-15T16:40:43.196526+0000","last_became_active":"2023-05-15T16:40:43.179873+0000","last_became_peered":"2023-05-15T16:40:43.179873+0000","last_unstale":"2023-05-15T16:40:43.196526+0000","last_undegraded":"2023-05-15T16:40:43.196526+0000","last_fullsized":"2023-05-15T16:40:43.196526+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:02:01.937857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.182810+0000","last_change":"2023-05-15T16:40:43.170564+0000","last_active":"2023-05-15T16:40:43.182810+0000","last_peered":"2023-05-15T16:40:43.182810+0000","last_clean":"2023-05-15T16:40:43.182810+0000","last_became_active":"2023-05-15T16:40:43.169575+0000","last_became_peered":"2023-05-15T16:40:43.169575+0000","last_unstale":"2023-05-15T16:40:43.182810+0000","last_undegraded":"2023-05-15T16:40:43.182810+0000","last_fullsized":"2023-05-15T16:40:43.182810+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:49:09.040666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.197915+0000","last_change":"2023-05-15T16:40:43.175763+0000","last_active":"2023-05-15T16:40:43.197915+0000","last_peered":"2023-05-15T16:40:43.197915+0000","last_clean":"2023-05-15T16:40:43.197915+0000","last_became_active":"2023-05-15T16:40:43.175034+0000","last_became_peered":"2023-05-15T16:40:43.175034+0000","last_unstale":"2023-05-15T16:40:43.197915+0000","last_undegraded":"2023-05-15T16:40:43.197915+0000","last_fullsized":"2023-05-15T16:40:43.197915+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:48:37.795757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.160204+0000","last_change":"2023-05-15T16:40:43.158518+0000","last_active":"2023-05-15T16:40:43.160204+0000","last_peered":"2023-05-15T16:40:43.160204+0000","last_clean":"2023-05-15T16:40:43.160204+0000","last_became_active":"2023-05-15T16:40:43.158185+0000","last_became_peered":"2023-05-15T16:40:43.158185+0000","last_unstale":"2023-05-15T16:40:43.160204+0000","last_undegraded":"2023-05-15T16:40:43.160204+0000","last_fullsized":"2023-05-15T16:40:43.160204+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:32:54.990348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.202296+0000","last_change":"2023-05-15T16:40:43.191948+0000","last_active":"2023-05-15T16:40:43.202296+0000","last_peered":"2023-05-15T16:40:43.202296+0000","last_clean":"2023-05-15T16:40:43.202296+0000","last_became_active":"2023-05-15T16:40:43.190786+0000","last_became_peered":"2023-05-15T16:40:43.190786+0000","last_unstale":"2023-05-15T16:40:43.202296+0000","last_undegraded":"2023-05-15T16:40:43.202296+0000","last_fullsized":"2023-05-15T16:40:43.202296+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T03:39:01.931324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"33'4","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.204968+0000","last_change":"2023-05-15T16:40:42.798111+0000","last_active":"2023-05-15T16:40:43.204968+0000","last_peered":"2023-05-15T16:40:43.204968+0000","last_clean":"2023-05-15T16:40:43.204968+0000","last_became_active":"2023-05-15T16:40:42.797408+0000","last_became_peered":"2023-05-15T16:40:42.797408+0000","last_unstale":"2023-05-15T16:40:43.204968+0000","last_undegraded":"2023-05-15T16:40:43.204968+0000","last_fullsized":"2023-05-15T16:40:43.204968+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:43:15.634348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":566,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.215164+0000","last_change":"2023-05-15T16:40:43.212440+0000","last_active":"2023-05-15T16:40:43.215164+0000","last_peered":"2023-05-15T16:40:43.215164+0000","last_clean":"2023-05-15T16:40:43.215164+0000","last_became_active":"2023-05-15T16:40:43.211953+0000","last_became_peered":"2023-05-15T16:40:43.211953+0000","last_unstale":"2023-05-15T16:40:43.215164+0000","last_undegraded":"2023-05-15T16:40:43.215164+0000","last_fullsized":"2023-05-15T16:40:43.215164+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:22:12.321164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.152047+0000","last_change":"2023-05-15T16:40:42.794108+0000","last_active":"2023-05-15T16:40:44.152047+0000","last_peered":"2023-05-15T16:40:44.152047+0000","last_clean":"2023-05-15T16:40:44.152047+0000","last_became_active":"2023-05-15T16:40:42.793728+0000","last_became_peered":"2023-05-15T16:40:42.793728+0000","last_unstale":"2023-05-15T16:40:44.152047+0000","last_undegraded":"2023-05-15T16:40:44.152047+0000","last_fullsized":"2023-05-15T16:40:44.152047+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:13:16.059176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.204521+0000","last_change":"2023-05-15T16:40:43.198575+0000","last_active":"2023-05-15T16:40:43.204521+0000","last_peered":"2023-05-15T16:40:43.204521+0000","last_clean":"2023-05-15T16:40:43.204521+0000","last_became_active":"2023-05-15T16:40:43.197924+0000","last_became_peered":"2023-05-15T16:40:43.197924+0000","last_unstale":"2023-05-15T16:40:43.204521+0000","last_undegraded":"2023-05-15T16:40:43.204521+0000","last_fullsized":"2023-05-15T16:40:43.204521+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:58:10.796681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.177364+0000","last_change":"2023-05-15T16:40:42.789456+0000","last_active":"2023-05-15T16:40:43.177364+0000","last_peered":"2023-05-15T16:40:43.177364+0000","last_clean":"2023-05-15T16:40:43.177364+0000","last_became_active":"2023-05-15T16:40:42.789033+0000","last_became_peered":"2023-05-15T16:40:42.789033+0000","last_unstale":"2023-05-15T16:40:43.177364+0000","last_undegraded":"2023-05-15T16:40:43.177364+0000","last_fullsized":"2023-05-15T16:40:43.177364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:17:27.771249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.150065+0000","last_change":"2023-05-15T16:40:43.182473+0000","last_active":"2023-05-15T16:40:44.150065+0000","last_peered":"2023-05-15T16:40:44.150065+0000","last_clean":"2023-05-15T16:40:44.150065+0000","last_became_active":"2023-05-15T16:40:43.182160+0000","last_became_peered":"2023-05-15T16:40:43.182160+0000","last_unstale":"2023-05-15T16:40:44.150065+0000","last_undegraded":"2023-05-15T16:40:44.150065+0000","last_fullsized":"2023-05-15T16:40:44.150065+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:07:03.252878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.201904+0000","last_change":"2023-05-15T16:40:42.803273+0000","last_active":"2023-05-15T16:40:43.201904+0000","last_peered":"2023-05-15T16:40:43.201904+0000","last_clean":"2023-05-15T16:40:43.201904+0000","last_became_active":"2023-05-15T16:40:42.802648+0000","last_became_peered":"2023-05-15T16:40:42.802648+0000","last_unstale":"2023-05-15T16:40:43.201904+0000","last_undegraded":"2023-05-15T16:40:43.201904+0000","last_fullsized":"2023-05-15T16:40:43.201904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:19:18.442651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.151511+0000","last_change":"2023-05-15T16:40:43.154867+0000","last_active":"2023-05-15T16:40:44.151511+0000","last_peered":"2023-05-15T16:40:44.151511+0000","last_clean":"2023-05-15T16:40:44.151511+0000","last_became_active":"2023-05-15T16:40:43.154606+0000","last_became_peered":"2023-05-15T16:40:43.154606+0000","last_unstale":"2023-05-15T16:40:44.151511+0000","last_undegraded":"2023-05-15T16:40:44.151511+0000","last_fullsized":"2023-05-15T16:40:44.151511+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:19:19.458947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.155469+0000","last_change":"2023-05-15T16:40:42.797172+0000","last_active":"2023-05-15T16:40:44.155469+0000","last_peered":"2023-05-15T16:40:44.155469+0000","last_clean":"2023-05-15T16:40:44.155469+0000","last_became_active":"2023-05-15T16:40:42.796345+0000","last_became_peered":"2023-05-15T16:40:42.796345+0000","last_unstale":"2023-05-15T16:40:44.155469+0000","last_undegraded":"2023-05-15T16:40:44.155469+0000","last_fullsized":"2023-05-15T16:40:44.155469+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:15:54.165120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.155027+0000","last_change":"2023-05-15T16:40:43.185226+0000","last_active":"2023-05-15T16:40:44.155027+0000","last_peered":"2023-05-15T16:40:44.155027+0000","last_clean":"2023-05-15T16:40:44.155027+0000","last_became_active":"2023-05-15T16:40:43.183791+0000","last_became_peered":"2023-05-15T16:40:43.183791+0000","last_unstale":"2023-05-15T16:40:44.155027+0000","last_undegraded":"2023-05-15T16:40:44.155027+0000","last_fullsized":"2023-05-15T16:40:44.155027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:07:03.252878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.190090+0000","last_change":"2023-05-15T16:40:42.809671+0000","last_active":"2023-05-15T16:40:43.190090+0000","last_peered":"2023-05-15T16:40:43.190090+0000","last_clean":"2023-05-15T16:40:43.190090+0000","last_became_active":"2023-05-15T16:40:42.808988+0000","last_became_peered":"2023-05-15T16:40:42.808988+0000","last_unstale":"2023-05-15T16:40:43.190090+0000","last_undegraded":"2023-05-15T16:40:43.190090+0000","last_fullsized":"2023-05-15T16:40:43.190090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:13:16.059176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.217376+0000","last_change":"2023-05-15T16:40:43.215464+0000","last_active":"2023-05-15T16:40:43.217376+0000","last_peered":"2023-05-15T16:40:43.217376+0000","last_clean":"2023-05-15T16:40:43.217376+0000","last_became_active":"2023-05-15T16:40:43.215016+0000","last_became_peered":"2023-05-15T16:40:43.215016+0000","last_unstale":"2023-05-15T16:40:43.217376+0000","last_undegraded":"2023-05-15T16:40:43.217376+0000","last_fullsized":"2023-05-15T16:40:43.217376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:45:52.168792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.140216+0000","last_change":"2023-05-15T16:40:42.803457+0000","last_active":"2023-05-15T16:40:43.140216+0000","last_peered":"2023-05-15T16:40:43.140216+0000","last_clean":"2023-05-15T16:40:43.140216+0000","last_became_active":"2023-05-15T16:40:42.802849+0000","last_became_peered":"2023-05-15T16:40:42.802849+0000","last_unstale":"2023-05-15T16:40:43.140216+0000","last_undegraded":"2023-05-15T16:40:43.140216+0000","last_fullsized":"2023-05-15T16:40:43.140216+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:52.921387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.149977+0000","last_change":"2023-05-15T16:40:43.189163+0000","last_active":"2023-05-15T16:40:44.149977+0000","last_peered":"2023-05-15T16:40:44.149977+0000","last_clean":"2023-05-15T16:40:44.149977+0000","last_became_active":"2023-05-15T16:40:43.188847+0000","last_became_peered":"2023-05-15T16:40:43.188847+0000","last_unstale":"2023-05-15T16:40:44.149977+0000","last_undegraded":"2023-05-15T16:40:44.149977+0000","last_fullsized":"2023-05-15T16:40:44.149977+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:48:37.795757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.173558+0000","last_change":"2023-05-15T16:40:42.794188+0000","last_active":"2023-05-15T16:40:43.173558+0000","last_peered":"2023-05-15T16:40:43.173558+0000","last_clean":"2023-05-15T16:40:43.173558+0000","last_became_active":"2023-05-15T16:40:42.793482+0000","last_became_peered":"2023-05-15T16:40:42.793482+0000","last_unstale":"2023-05-15T16:40:43.173558+0000","last_undegraded":"2023-05-15T16:40:43.173558+0000","last_fullsized":"2023-05-15T16:40:43.173558+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:48:35.444625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.188534+0000","last_change":"2023-05-15T16:40:43.183656+0000","last_active":"2023-05-15T16:40:43.188534+0000","last_peered":"2023-05-15T16:40:43.188534+0000","last_clean":"2023-05-15T16:40:43.188534+0000","last_became_active":"2023-05-15T16:40:43.183373+0000","last_became_peered":"2023-05-15T16:40:43.183373+0000","last_unstale":"2023-05-15T16:40:43.188534+0000","last_undegraded":"2023-05-15T16:40:43.188534+0000","last_fullsized":"2023-05-15T16:40:43.188534+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:17:28.787544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.150181+0000","last_change":"2023-05-15T16:40:42.779817+0000","last_active":"2023-05-15T16:40:44.150181+0000","last_peered":"2023-05-15T16:40:44.150181+0000","last_clean":"2023-05-15T16:40:44.150181+0000","last_became_active":"2023-05-15T16:40:42.779435+0000","last_became_peered":"2023-05-15T16:40:42.779435+0000","last_unstale":"2023-05-15T16:40:44.150181+0000","last_undegraded":"2023-05-15T16:40:44.150181+0000","last_fullsized":"2023-05-15T16:40:44.150181+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:13:16.059176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.198027+0000","last_change":"2023-05-15T16:40:43.183839+0000","last_active":"2023-05-15T16:40:43.198027+0000","last_peered":"2023-05-15T16:40:43.198027+0000","last_clean":"2023-05-15T16:40:43.198027+0000","last_became_active":"2023-05-15T16:40:43.182959+0000","last_became_peered":"2023-05-15T16:40:43.182959+0000","last_unstale":"2023-05-15T16:40:43.198027+0000","last_undegraded":"2023-05-15T16:40:43.198027+0000","last_fullsized":"2023-05-15T16:40:43.198027+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:09:27.509084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.156147+0000","last_change":"2023-05-15T16:40:42.797884+0000","last_active":"2023-05-15T16:40:44.156147+0000","last_peered":"2023-05-15T16:40:44.156147+0000","last_clean":"2023-05-15T16:40:44.156147+0000","last_became_active":"2023-05-15T16:40:42.795368+0000","last_became_peered":"2023-05-15T16:40:42.795368+0000","last_unstale":"2023-05-15T16:40:44.156147+0000","last_undegraded":"2023-05-15T16:40:44.156147+0000","last_fullsized":"2023-05-15T16:40:44.156147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:54:12.567108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.151906+0000","last_change":"2023-05-15T16:40:43.189567+0000","last_active":"2023-05-15T16:40:44.151906+0000","last_peered":"2023-05-15T16:40:44.151906+0000","last_clean":"2023-05-15T16:40:44.151906+0000","last_became_active":"2023-05-15T16:40:43.189206+0000","last_became_peered":"2023-05-15T16:40:43.189206+0000","last_unstale":"2023-05-15T16:40:44.151906+0000","last_undegraded":"2023-05-15T16:40:44.151906+0000","last_fullsized":"2023-05-15T16:40:44.151906+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:01:38.230846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"33'3","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.156352+0000","last_change":"2023-05-15T16:40:42.788993+0000","last_active":"2023-05-15T16:40:44.156352+0000","last_peered":"2023-05-15T16:40:44.156352+0000","last_clean":"2023-05-15T16:40:44.156352+0000","last_became_active":"2023-05-15T16:40:42.788273+0000","last_became_peered":"2023-05-15T16:40:42.788273+0000","last_unstale":"2023-05-15T16:40:44.156352+0000","last_undegraded":"2023-05-15T16:40:44.156352+0000","last_fullsized":"2023-05-15T16:40:44.156352+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:52.921387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.201588+0000","last_change":"2023-05-15T16:40:43.181325+0000","last_active":"2023-05-15T16:40:43.201588+0000","last_peered":"2023-05-15T16:40:43.201588+0000","last_clean":"2023-05-15T16:40:43.201588+0000","last_became_active":"2023-05-15T16:40:43.180567+0000","last_became_peered":"2023-05-15T16:40:43.180567+0000","last_unstale":"2023-05-15T16:40:43.201588+0000","last_undegraded":"2023-05-15T16:40:43.201588+0000","last_fullsized":"2023-05-15T16:40:43.201588+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:12:54.346821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"33'6","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.149844+0000","last_change":"2023-05-15T16:40:42.794923+0000","last_active":"2023-05-15T16:40:44.149844+0000","last_peered":"2023-05-15T16:40:44.149844+0000","last_clean":"2023-05-15T16:40:44.149844+0000","last_became_active":"2023-05-15T16:40:42.794073+0000","last_became_peered":"2023-05-15T16:40:42.794073+0000","last_unstale":"2023-05-15T16:40:44.149844+0000","last_undegraded":"2023-05-15T16:40:44.149844+0000","last_fullsized":"2023-05-15T16:40:44.149844+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:51:22.715674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1548,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.151619+0000","last_change":"2023-05-15T16:40:43.182140+0000","last_active":"2023-05-15T16:40:44.151619+0000","last_peered":"2023-05-15T16:40:44.151619+0000","last_clean":"2023-05-15T16:40:44.151619+0000","last_became_active":"2023-05-15T16:40:43.181869+0000","last_became_peered":"2023-05-15T16:40:43.181869+0000","last_unstale":"2023-05-15T16:40:44.151619+0000","last_undegraded":"2023-05-15T16:40:44.151619+0000","last_fullsized":"2023-05-15T16:40:44.151619+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:16:12.141164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.150512+0000","last_change":"2023-05-15T16:40:42.782184+0000","last_active":"2023-05-15T16:40:44.150512+0000","last_peered":"2023-05-15T16:40:44.150512+0000","last_clean":"2023-05-15T16:40:44.150512+0000","last_became_active":"2023-05-15T16:40:42.781528+0000","last_became_peered":"2023-05-15T16:40:42.781528+0000","last_unstale":"2023-05-15T16:40:44.150512+0000","last_undegraded":"2023-05-15T16:40:44.150512+0000","last_fullsized":"2023-05-15T16:40:44.150512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:02:00.921562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.149372+0000","last_change":"2023-05-15T16:40:43.154427+0000","last_active":"2023-05-15T16:40:44.149372+0000","last_peered":"2023-05-15T16:40:44.149372+0000","last_clean":"2023-05-15T16:40:44.149372+0000","last_became_active":"2023-05-15T16:40:43.154197+0000","last_became_peered":"2023-05-15T16:40:43.154197+0000","last_unstale":"2023-05-15T16:40:44.149372+0000","last_undegraded":"2023-05-15T16:40:44.149372+0000","last_fullsized":"2023-05-15T16:40:44.149372+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:01:38.230846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.140493+0000","last_change":"2023-05-15T16:40:42.795308+0000","last_active":"2023-05-15T16:40:43.140493+0000","last_peered":"2023-05-15T16:40:43.140493+0000","last_clean":"2023-05-15T16:40:43.140493+0000","last_became_active":"2023-05-15T16:40:42.794760+0000","last_became_peered":"2023-05-15T16:40:42.794760+0000","last_unstale":"2023-05-15T16:40:43.140493+0000","last_undegraded":"2023-05-15T16:40:43.140493+0000","last_fullsized":"2023-05-15T16:40:43.140493+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:54:12.567108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.197516+0000","last_change":"2023-05-15T16:40:43.172911+0000","last_active":"2023-05-15T16:40:43.197516+0000","last_peered":"2023-05-15T16:40:43.197516+0000","last_clean":"2023-05-15T16:40:43.197516+0000","last_became_active":"2023-05-15T16:40:43.172131+0000","last_became_peered":"2023-05-15T16:40:43.172131+0000","last_unstale":"2023-05-15T16:40:43.197516+0000","last_undegraded":"2023-05-15T16:40:43.197516+0000","last_fullsized":"2023-05-15T16:40:43.197516+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:07:03.252878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.160828+0000","last_change":"2023-05-15T16:40:42.797053+0000","last_active":"2023-05-15T16:40:43.160828+0000","last_peered":"2023-05-15T16:40:43.160828+0000","last_clean":"2023-05-15T16:40:43.160828+0000","last_became_active":"2023-05-15T16:40:42.796375+0000","last_became_peered":"2023-05-15T16:40:42.796375+0000","last_unstale":"2023-05-15T16:40:43.160828+0000","last_undegraded":"2023-05-15T16:40:43.160828+0000","last_fullsized":"2023-05-15T16:40:43.160828+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:50:20.441675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.150155+0000","last_change":"2023-05-15T16:40:43.156368+0000","last_active":"2023-05-15T16:40:44.150155+0000","last_peered":"2023-05-15T16:40:44.150155+0000","last_clean":"2023-05-15T16:40:44.150155+0000","last_became_active":"2023-05-15T16:40:43.156071+0000","last_became_peered":"2023-05-15T16:40:43.156071+0000","last_unstale":"2023-05-15T16:40:44.150155+0000","last_undegraded":"2023-05-15T16:40:44.150155+0000","last_fullsized":"2023-05-15T16:40:44.150155+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:38:59.076397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"33'8","reported_seq":18,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.206239+0000","last_change":"2023-05-15T16:40:42.809640+0000","last_active":"2023-05-15T16:40:43.206239+0000","last_peered":"2023-05-15T16:40:43.206239+0000","last_clean":"2023-05-15T16:40:43.206239+0000","last_became_active":"2023-05-15T16:40:42.808947+0000","last_became_peered":"2023-05-15T16:40:42.808947+0000","last_unstale":"2023-05-15T16:40:43.206239+0000","last_undegraded":"2023-05-15T16:40:43.206239+0000","last_fullsized":"2023-05-15T16:40:43.206239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:02:00.921562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.149794+0000","last_change":"2023-05-15T16:40:43.178287+0000","last_active":"2023-05-15T16:40:44.149794+0000","last_peered":"2023-05-15T16:40:44.149794+0000","last_clean":"2023-05-15T16:40:44.149794+0000","last_became_active":"2023-05-15T16:40:43.178017+0000","last_became_peered":"2023-05-15T16:40:43.178017+0000","last_unstale":"2023-05-15T16:40:44.149794+0000","last_undegraded":"2023-05-15T16:40:44.149794+0000","last_fullsized":"2023-05-15T16:40:44.149794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:36:28.019271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"33'1","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.156019+0000","last_change":"2023-05-15T16:40:42.806721+0000","last_active":"2023-05-15T16:40:44.156019+0000","last_peered":"2023-05-15T16:40:44.156019+0000","last_clean":"2023-05-15T16:40:44.156019+0000","last_became_active":"2023-05-15T16:40:42.806097+0000","last_became_peered":"2023-05-15T16:40:42.806097+0000","last_unstale":"2023-05-15T16:40:44.156019+0000","last_undegraded":"2023-05-15T16:40:44.156019+0000","last_fullsized":"2023-05-15T16:40:44.156019+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:13:16.059176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.156162+0000","last_change":"2023-05-15T16:40:43.212213+0000","last_active":"2023-05-15T16:40:44.156162+0000","last_peered":"2023-05-15T16:40:44.156162+0000","last_clean":"2023-05-15T16:40:44.156162+0000","last_became_active":"2023-05-15T16:40:43.211254+0000","last_became_peered":"2023-05-15T16:40:43.211254+0000","last_unstale":"2023-05-15T16:40:44.156162+0000","last_undegraded":"2023-05-15T16:40:44.156162+0000","last_fullsized":"2023-05-15T16:40:44.156162+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:19:19.458947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.216270+0000","last_change":"2023-05-15T16:40:42.800787+0000","last_active":"2023-05-15T16:40:43.216270+0000","last_peered":"2023-05-15T16:40:43.216270+0000","last_clean":"2023-05-15T16:40:43.216270+0000","last_became_active":"2023-05-15T16:40:42.800116+0000","last_became_peered":"2023-05-15T16:40:42.800116+0000","last_unstale":"2023-05-15T16:40:43.216270+0000","last_undegraded":"2023-05-15T16:40:43.216270+0000","last_fullsized":"2023-05-15T16:40:43.216270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:07:02.236582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.204474+0000","last_change":"2023-05-15T16:40:43.198615+0000","last_active":"2023-05-15T16:40:43.204474+0000","last_peered":"2023-05-15T16:40:43.204474+0000","last_clean":"2023-05-15T16:40:43.204474+0000","last_became_active":"2023-05-15T16:40:43.197982+0000","last_became_peered":"2023-05-15T16:40:43.197982+0000","last_unstale":"2023-05-15T16:40:43.204474+0000","last_undegraded":"2023-05-15T16:40:43.204474+0000","last_fullsized":"2023-05-15T16:40:43.204474+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T22:13:17.831932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"33'1","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.189561+0000","last_change":"2023-05-15T16:40:42.803931+0000","last_active":"2023-05-15T16:40:43.189561+0000","last_peered":"2023-05-15T16:40:43.189561+0000","last_clean":"2023-05-15T16:40:43.189561+0000","last_became_active":"2023-05-15T16:40:42.803625+0000","last_became_peered":"2023-05-15T16:40:42.803625+0000","last_unstale":"2023-05-15T16:40:43.189561+0000","last_undegraded":"2023-05-15T16:40:43.189561+0000","last_fullsized":"2023-05-15T16:40:43.189561+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:57:23.727447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.162753+0000","last_change":"2023-05-15T16:40:43.157494+0000","last_active":"2023-05-15T16:40:43.162753+0000","last_peered":"2023-05-15T16:40:43.162753+0000","last_clean":"2023-05-15T16:40:43.162753+0000","last_became_active":"2023-05-15T16:40:43.156631+0000","last_became_peered":"2023-05-15T16:40:43.156631+0000","last_unstale":"2023-05-15T16:40:43.162753+0000","last_undegraded":"2023-05-15T16:40:43.162753+0000","last_fullsized":"2023-05-15T16:40:43.162753+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:15:55.181415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.140798+0000","last_change":"2023-05-15T16:40:42.788906+0000","last_active":"2023-05-15T16:40:43.140798+0000","last_peered":"2023-05-15T16:40:43.140798+0000","last_clean":"2023-05-15T16:40:43.140798+0000","last_became_active":"2023-05-15T16:40:42.788620+0000","last_became_peered":"2023-05-15T16:40:42.788620+0000","last_unstale":"2023-05-15T16:40:43.140798+0000","last_undegraded":"2023-05-15T16:40:43.140798+0000","last_fullsized":"2023-05-15T16:40:43.140798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:25:22.938761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.197889+0000","last_change":"2023-05-15T16:40:43.181755+0000","last_active":"2023-05-15T16:40:43.197889+0000","last_peered":"2023-05-15T16:40:43.197889+0000","last_clean":"2023-05-15T16:40:43.197889+0000","last_became_active":"2023-05-15T16:40:43.177502+0000","last_became_peered":"2023-05-15T16:40:43.177502+0000","last_unstale":"2023-05-15T16:40:43.197889+0000","last_undegraded":"2023-05-15T16:40:43.197889+0000","last_fullsized":"2023-05-15T16:40:43.197889+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:36:28.019271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"33'2","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.158823+0000","last_change":"2023-05-15T16:40:42.782007+0000","last_active":"2023-05-15T16:40:43.158823+0000","last_peered":"2023-05-15T16:40:43.158823+0000","last_clean":"2023-05-15T16:40:43.158823+0000","last_became_active":"2023-05-15T16:40:42.781542+0000","last_became_peered":"2023-05-15T16:40:42.781542+0000","last_unstale":"2023-05-15T16:40:43.158823+0000","last_undegraded":"2023-05-15T16:40:43.158823+0000","last_fullsized":"2023-05-15T16:40:43.158823+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:13:06.042072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.151725+0000","last_change":"2023-05-15T16:40:43.189345+0000","last_active":"2023-05-15T16:40:44.151725+0000","last_peered":"2023-05-15T16:40:44.151725+0000","last_clean":"2023-05-15T16:40:44.151725+0000","last_became_active":"2023-05-15T16:40:43.189031+0000","last_became_peered":"2023-05-15T16:40:43.189031+0000","last_unstale":"2023-05-15T16:40:44.151725+0000","last_undegraded":"2023-05-15T16:40:44.151725+0000","last_fullsized":"2023-05-15T16:40:44.151725+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:48:36.460921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.144502+0000","last_change":"2023-05-15T16:40:42.789040+0000","last_active":"2023-05-15T16:40:43.144502+0000","last_peered":"2023-05-15T16:40:43.144502+0000","last_clean":"2023-05-15T16:40:43.144502+0000","last_became_active":"2023-05-15T16:40:42.788540+0000","last_became_peered":"2023-05-15T16:40:42.788540+0000","last_unstale":"2023-05-15T16:40:43.144502+0000","last_undegraded":"2023-05-15T16:40:43.144502+0000","last_fullsized":"2023-05-15T16:40:43.144502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:39:53.398134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.155072+0000","last_change":"2023-05-15T16:40:43.184388+0000","last_active":"2023-05-15T16:40:44.155072+0000","last_peered":"2023-05-15T16:40:44.155072+0000","last_clean":"2023-05-15T16:40:44.155072+0000","last_became_active":"2023-05-15T16:40:43.183621+0000","last_became_peered":"2023-05-15T16:40:43.183621+0000","last_unstale":"2023-05-15T16:40:44.155072+0000","last_undegraded":"2023-05-15T16:40:44.155072+0000","last_fullsized":"2023-05-15T16:40:44.155072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T03:42:55.273832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.147212+0000","last_change":"2023-05-15T16:40:42.805202+0000","last_active":"2023-05-15T16:40:43.147212+0000","last_peered":"2023-05-15T16:40:43.147212+0000","last_clean":"2023-05-15T16:40:43.147212+0000","last_became_active":"2023-05-15T16:40:42.804546+0000","last_became_peered":"2023-05-15T16:40:42.804546+0000","last_unstale":"2023-05-15T16:40:43.147212+0000","last_undegraded":"2023-05-15T16:40:43.147212+0000","last_fullsized":"2023-05-15T16:40:43.147212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:49:08.024370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.150352+0000","last_change":"2023-05-15T16:40:43.189409+0000","last_active":"2023-05-15T16:40:44.150352+0000","last_peered":"2023-05-15T16:40:44.150352+0000","last_clean":"2023-05-15T16:40:44.150352+0000","last_became_active":"2023-05-15T16:40:43.189124+0000","last_became_peered":"2023-05-15T16:40:43.189124+0000","last_unstale":"2023-05-15T16:40:44.150352+0000","last_undegraded":"2023-05-15T16:40:44.150352+0000","last_fullsized":"2023-05-15T16:40:44.150352+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T03:39:01.931324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.144398+0000","last_change":"2023-05-15T16:40:42.783001+0000","last_active":"2023-05-15T16:40:43.144398+0000","last_peered":"2023-05-15T16:40:43.144398+0000","last_clean":"2023-05-15T16:40:43.144398+0000","last_became_active":"2023-05-15T16:40:42.782587+0000","last_became_peered":"2023-05-15T16:40:42.782587+0000","last_unstale":"2023-05-15T16:40:43.144398+0000","last_undegraded":"2023-05-15T16:40:43.144398+0000","last_fullsized":"2023-05-15T16:40:43.144398+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:59:24.679349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.155744+0000","last_change":"2023-05-15T16:40:43.215772+0000","last_active":"2023-05-15T16:40:44.155744+0000","last_peered":"2023-05-15T16:40:44.155744+0000","last_clean":"2023-05-15T16:40:44.155744+0000","last_became_active":"2023-05-15T16:40:43.212358+0000","last_became_peered":"2023-05-15T16:40:43.212358+0000","last_unstale":"2023-05-15T16:40:44.155744+0000","last_undegraded":"2023-05-15T16:40:44.155744+0000","last_fullsized":"2023-05-15T16:40:44.155744+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:30:53.186798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.146857+0000","last_change":"2023-05-15T16:40:42.805460+0000","last_active":"2023-05-15T16:40:43.146857+0000","last_peered":"2023-05-15T16:40:43.146857+0000","last_clean":"2023-05-15T16:40:43.146857+0000","last_became_active":"2023-05-15T16:40:42.804833+0000","last_became_peered":"2023-05-15T16:40:42.804833+0000","last_unstale":"2023-05-15T16:40:43.146857+0000","last_undegraded":"2023-05-15T16:40:43.146857+0000","last_fullsized":"2023-05-15T16:40:43.146857+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:51:22.715674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":175,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-15T16:40:42.783065+0000","last_change":"2023-05-15T16:39:50.637320+0000","last_active":"2023-05-15T16:40:42.783065+0000","last_peered":"2023-05-15T16:40:42.783065+0000","last_clean":"2023-05-15T16:40:42.783065+0000","last_became_active":"2023-05-15T16:39:50.636541+0000","last_became_peered":"2023-05-15T16:39:50.636541+0000","last_unstale":"2023-05-15T16:40:42.783065+0000","last_undegraded":"2023-05-15T16:40:42.783065+0000","last_fullsized":"2023-05-15T16:40:42.783065+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:49.601783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:49.601783+0000","last_clean_scrub_stamp":"2023-05-15T16:39:49.601783+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:18:01.941203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.181687+0000","last_change":"2023-05-15T16:39:56.699270+0000","last_active":"2023-05-15T16:40:43.181687+0000","last_peered":"2023-05-15T16:40:43.181687+0000","last_clean":"2023-05-15T16:40:43.181687+0000","last_became_active":"2023-05-15T16:39:56.698429+0000","last_became_peered":"2023-05-15T16:39:56.698429+0000","last_unstale":"2023-05-15T16:40:43.181687+0000","last_undegraded":"2023-05-15T16:40:43.181687+0000","last_fullsized":"2023-05-15T16:40:43.181687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:31.428692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.191080+0000","last_change":"2023-05-15T16:40:43.186396+0000","last_active":"2023-05-15T16:40:43.191080+0000","last_peered":"2023-05-15T16:40:43.191080+0000","last_clean":"2023-05-15T16:40:43.191080+0000","last_became_active":"2023-05-15T16:40:43.186112+0000","last_became_peered":"2023-05-15T16:40:43.186112+0000","last_unstale":"2023-05-15T16:40:43.191080+0000","last_undegraded":"2023-05-15T16:40:43.191080+0000","last_fullsized":"2023-05-15T16:40:43.191080+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:59:12.131028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"33'2","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.156234+0000","last_change":"2023-05-15T16:40:42.799653+0000","last_active":"2023-05-15T16:40:44.156234+0000","last_peered":"2023-05-15T16:40:44.156234+0000","last_clean":"2023-05-15T16:40:44.156234+0000","last_became_active":"2023-05-15T16:40:42.795427+0000","last_became_peered":"2023-05-15T16:40:42.795427+0000","last_unstale":"2023-05-15T16:40:44.156234+0000","last_undegraded":"2023-05-15T16:40:44.156234+0000","last_fullsized":"2023-05-15T16:40:44.156234+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:02:00.921562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-15T16:40:42.782757+0000","last_change":"2023-05-15T16:39:56.700800+0000","last_active":"2023-05-15T16:40:42.782757+0000","last_peered":"2023-05-15T16:40:42.782757+0000","last_clean":"2023-05-15T16:40:42.782757+0000","last_became_active":"2023-05-15T16:39:56.700022+0000","last_became_peered":"2023-05-15T16:39:56.700022+0000","last_unstale":"2023-05-15T16:40:42.782757+0000","last_undegraded":"2023-05-15T16:40:42.782757+0000","last_fullsized":"2023-05-15T16:40:42.782757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T04:11:54.752932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.202706+0000","last_change":"2023-05-15T16:40:43.193016+0000","last_active":"2023-05-15T16:40:43.202706+0000","last_peered":"2023-05-15T16:40:43.202706+0000","last_clean":"2023-05-15T16:40:43.202706+0000","last_became_active":"2023-05-15T16:40:43.192302+0000","last_became_peered":"2023-05-15T16:40:43.192302+0000","last_unstale":"2023-05-15T16:40:43.202706+0000","last_undegraded":"2023-05-15T16:40:43.202706+0000","last_fullsized":"2023-05-15T16:40:43.202706+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:38:59.076397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.144650+0000","last_change":"2023-05-15T16:40:42.794468+0000","last_active":"2023-05-15T16:40:43.144650+0000","last_peered":"2023-05-15T16:40:43.144650+0000","last_clean":"2023-05-15T16:40:43.144650+0000","last_became_active":"2023-05-15T16:40:42.794161+0000","last_became_peered":"2023-05-15T16:40:42.794161+0000","last_unstale":"2023-05-15T16:40:43.144650+0000","last_undegraded":"2023-05-15T16:40:43.144650+0000","last_fullsized":"2023-05-15T16:40:43.144650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:46:06.744347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-15T16:40:42.775394+0000","last_change":"2023-05-15T16:39:57.018815+0000","last_active":"2023-05-15T16:40:42.775394+0000","last_peered":"2023-05-15T16:40:42.775394+0000","last_clean":"2023-05-15T16:40:42.775394+0000","last_became_active":"2023-05-15T16:39:57.018404+0000","last_became_peered":"2023-05-15T16:39:57.018404+0000","last_unstale":"2023-05-15T16:40:42.775394+0000","last_undegraded":"2023-05-15T16:40:42.775394+0000","last_fullsized":"2023-05-15T16:40:42.775394+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.149690+0000","last_change":"2023-05-15T16:40:43.204016+0000","last_active":"2023-05-15T16:40:44.149690+0000","last_peered":"2023-05-15T16:40:44.149690+0000","last_clean":"2023-05-15T16:40:44.149690+0000","last_became_active":"2023-05-15T16:40:43.203786+0000","last_became_peered":"2023-05-15T16:40:43.203786+0000","last_unstale":"2023-05-15T16:40:44.149690+0000","last_undegraded":"2023-05-15T16:40:44.149690+0000","last_fullsized":"2023-05-15T16:40:44.149690+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T17:30:53.186798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.151910+0000","last_change":"2023-05-15T16:40:42.778789+0000","last_active":"2023-05-15T16:40:44.151910+0000","last_peered":"2023-05-15T16:40:44.151910+0000","last_clean":"2023-05-15T16:40:44.151910+0000","last_became_active":"2023-05-15T16:40:42.778337+0000","last_became_peered":"2023-05-15T16:40:42.778337+0000","last_unstale":"2023-05-15T16:40:44.151910+0000","last_undegraded":"2023-05-15T16:40:44.151910+0000","last_fullsized":"2023-05-15T16:40:44.151910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:15:54.165120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.174896+0000","last_change":"2023-05-15T16:39:56.701269+0000","last_active":"2023-05-15T16:40:43.174896+0000","last_peered":"2023-05-15T16:40:43.174896+0000","last_clean":"2023-05-15T16:40:43.174896+0000","last_became_active":"2023-05-15T16:39:56.700221+0000","last_became_peered":"2023-05-15T16:39:56.700221+0000","last_unstale":"2023-05-15T16:40:43.174896+0000","last_undegraded":"2023-05-15T16:40:43.174896+0000","last_fullsized":"2023-05-15T16:40:43.174896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":10,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.151645+0000","last_change":"2023-05-15T16:40:43.161444+0000","last_active":"2023-05-15T16:40:44.151645+0000","last_peered":"2023-05-15T16:40:44.151645+0000","last_clean":"2023-05-15T16:40:44.151645+0000","last_became_active":"2023-05-15T16:40:43.161165+0000","last_became_peered":"2023-05-15T16:40:43.161165+0000","last_unstale":"2023-05-15T16:40:44.151645+0000","last_undegraded":"2023-05-15T16:40:44.151645+0000","last_fullsized":"2023-05-15T16:40:44.151645+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:36:28.019271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.151867+0000","last_change":"2023-05-15T16:40:42.786170+0000","last_active":"2023-05-15T16:40:44.151867+0000","last_peered":"2023-05-15T16:40:44.151867+0000","last_clean":"2023-05-15T16:40:44.151867+0000","last_became_active":"2023-05-15T16:40:42.785078+0000","last_became_peered":"2023-05-15T16:40:42.785078+0000","last_unstale":"2023-05-15T16:40:44.151867+0000","last_undegraded":"2023-05-15T16:40:44.151867+0000","last_fullsized":"2023-05-15T16:40:44.151867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:02:00.921562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-15T16:40:42.778075+0000","last_change":"2023-05-15T16:39:56.692931+0000","last_active":"2023-05-15T16:40:42.778075+0000","last_peered":"2023-05-15T16:40:42.778075+0000","last_clean":"2023-05-15T16:40:42.778075+0000","last_became_active":"2023-05-15T16:39:56.692557+0000","last_became_peered":"2023-05-15T16:39:56.692557+0000","last_unstale":"2023-05-15T16:40:42.778075+0000","last_undegraded":"2023-05-15T16:40:42.778075+0000","last_fullsized":"2023-05-15T16:40:42.778075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:04:42.838139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.175146+0000","last_change":"2023-05-15T16:40:43.172843+0000","last_active":"2023-05-15T16:40:43.175146+0000","last_peered":"2023-05-15T16:40:43.175146+0000","last_clean":"2023-05-15T16:40:43.175146+0000","last_became_active":"2023-05-15T16:40:43.172521+0000","last_became_peered":"2023-05-15T16:40:43.172521+0000","last_unstale":"2023-05-15T16:40:43.175146+0000","last_undegraded":"2023-05-15T16:40:43.175146+0000","last_fullsized":"2023-05-15T16:40:43.175146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T03:49:27.348692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.159270+0000","last_change":"2023-05-15T16:40:42.786842+0000","last_active":"2023-05-15T16:40:43.159270+0000","last_peered":"2023-05-15T16:40:43.159270+0000","last_clean":"2023-05-15T16:40:43.159270+0000","last_became_active":"2023-05-15T16:40:42.786172+0000","last_became_peered":"2023-05-15T16:40:42.786172+0000","last_unstale":"2023-05-15T16:40:43.159270+0000","last_undegraded":"2023-05-15T16:40:43.159270+0000","last_fullsized":"2023-05-15T16:40:43.159270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T19:35:33.445034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-15T16:40:42.785242+0000","last_change":"2023-05-15T16:39:56.698079+0000","last_active":"2023-05-15T16:40:42.785242+0000","last_peered":"2023-05-15T16:40:42.785242+0000","last_clean":"2023-05-15T16:40:42.785242+0000","last_became_active":"2023-05-15T16:39:56.697298+0000","last_became_peered":"2023-05-15T16:39:56.697298+0000","last_unstale":"2023-05-15T16:40:42.785242+0000","last_undegraded":"2023-05-15T16:40:42.785242+0000","last_fullsized":"2023-05-15T16:40:42.785242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T01:32:01.734351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.204602+0000","last_change":"2023-05-15T16:40:43.199603+0000","last_active":"2023-05-15T16:40:43.204602+0000","last_peered":"2023-05-15T16:40:43.204602+0000","last_clean":"2023-05-15T16:40:43.204602+0000","last_became_active":"2023-05-15T16:40:43.198878+0000","last_became_peered":"2023-05-15T16:40:43.198878+0000","last_unstale":"2023-05-15T16:40:43.204602+0000","last_undegraded":"2023-05-15T16:40:43.204602+0000","last_fullsized":"2023-05-15T16:40:43.204602+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T00:06:37.098737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.172156+0000","last_change":"2023-05-15T16:40:42.770923+0000","last_active":"2023-05-15T16:40:43.172156+0000","last_peered":"2023-05-15T16:40:43.172156+0000","last_clean":"2023-05-15T16:40:43.172156+0000","last_became_active":"2023-05-15T16:40:42.768742+0000","last_became_peered":"2023-05-15T16:40:42.768742+0000","last_unstale":"2023-05-15T16:40:43.172156+0000","last_undegraded":"2023-05-15T16:40:43.172156+0000","last_fullsized":"2023-05-15T16:40:43.172156+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:01:37.214550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":22,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-15T16:40:42.778264+0000","last_change":"2023-05-15T16:39:56.694298+0000","last_active":"2023-05-15T16:40:42.778264+0000","last_peered":"2023-05-15T16:40:42.778264+0000","last_clean":"2023-05-15T16:40:42.778264+0000","last_became_active":"2023-05-15T16:39:56.693723+0000","last_became_peered":"2023-05-15T16:39:56.693723+0000","last_unstale":"2023-05-15T16:40:42.778264+0000","last_undegraded":"2023-05-15T16:40:42.778264+0000","last_fullsized":"2023-05-15T16:40:42.778264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T23:29:31.428692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-05-15T16:40:43.197991+0000","last_change":"2023-05-15T16:40:43.174885+0000","last_active":"2023-05-15T16:40:43.197991+0000","last_peered":"2023-05-15T16:40:43.197991+0000","last_clean":"2023-05-15T16:40:43.197991+0000","last_became_active":"2023-05-15T16:40:43.174094+0000","last_became_peered":"2023-05-15T16:40:43.174094+0000","last_unstale":"2023-05-15T16:40:43.197991+0000","last_undegraded":"2023-05-15T16:40:43.197991+0000","last_fullsized":"2023-05-15T16:40:43.197991+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:42.738611+0000","last_clean_scrub_stamp":"2023-05-15T16:40:42.738611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-17T02:36:01.464099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":11,"reported_epoch":34,"state":"active+clean","last_fresh":"2023-05-15T16:40:44.149450+0000","last_change":"2023-05-15T16:40:42.780134+0000","last_active":"2023-05-15T16:40:44.149450+0000","last_peered":"2023-05-15T16:40:44.149450+0000","last_clean":"2023-05-15T16:40:44.149450+0000","last_became_active":"2023-05-15T16:40:42.779554+0000","last_became_peered":"2023-05-15T16:40:42.779554+0000","last_unstale":"2023-05-15T16:40:44.149450+0000","last_undegraded":"2023-05-15T16:40:44.149450+0000","last_fullsized":"2023-05-15T16:40:44.149450+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:40:41.722315+0000","last_clean_scrub_stamp":"2023-05-15T16:40:41.722315+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T20:49:08.024370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-05-15T16:40:42.778449+0000","last_change":"2023-05-15T16:39:56.697003+0000","last_active":"2023-05-15T16:40:42.778449+0000","last_peered":"2023-05-15T16:40:42.778449+0000","last_clean":"2023-05-15T16:40:42.778449+0000","last_became_active":"2023-05-15T16:39:56.696210+0000","last_became_peered":"2023-05-15T16:39:56.696210+0000","last_unstale":"2023-05-15T16:40:42.778449+0000","last_undegraded":"2023-05-15T16:40:42.778449+0000","last_fullsized":"2023-05-15T16:40:42.778449+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-05-15T16:39:55.652345+0000","last_clean_scrub_stamp":"2023-05-15T16:39:55.652345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-05-16T18:29:27.454964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2330,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574862,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9544,"kb_used_data":960,"kb_used_omap":0,"kb_used_meta":8576,"kb_avail":94362296,"statfs":{"total":96636764160,"available":96626991104,"internally_reserved":0,"allocated":983040,"data_stored":742187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8781824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97899999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.131}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78900000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8312,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363528,"statfs":{"total":96636764160,"available":96628252672,"internally_reserved":0,"allocated":376832,"data_stored":150767,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93700000000000006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0509999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1539999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574862,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8380,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363460,"statfs":{"total":96636764160,"available":96628183040,"internally_reserved":0,"allocated":380928,"data_stored":150313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71199999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95799999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.008}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.085}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81200000000000006}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8508,"kb_used_data":372,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363332,"statfs":{"total":96636764160,"available":96628051968,"internally_reserved":0,"allocated":380928,"data_stored":150789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0449999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88600000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86299999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8452,"kb_used_data":380,"kb_used_omap":0,"kb_used_meta":8064,"kb_avail":94363388,"statfs":{"total":96636764160,"available":96628109312,"internally_reserved":0,"allocated":389120,"data_stored":151783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8257536},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0169999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.03}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8312,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363528,"statfs":{"total":96636764160,"available":96628252672,"internally_reserved":0,"allocated":376832,"data_stored":150271,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39000000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8376,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":8000,"kb_avail":94363464,"statfs":{"total":96636764160,"available":96628187136,"internally_reserved":0,"allocated":376832,"data_stored":150291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8192000},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79800000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.081}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0009999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9468,"kb_used_data":948,"kb_used_omap":0,"kb_used_meta":8512,"kb_avail":94362372,"statfs":{"total":96636764160,"available":96627068928,"internally_reserved":0,"allocated":970752,"data_stored":740603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8716288},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79500000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.88400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91900000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.028}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1618,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-05-15T16:40:46.547 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-05-15T16:40:46.548 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw pool=cephfs_data' mds allow 2023-05-15T16:40:46.711 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.707+0000 7f0fdd5f5640 1 Processor -- start 2023-05-15T16:40:46.712 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.707+0000 7f0fdd5f5640 1 -- start start 2023-05-15T16:40:46.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.707+0000 7f0fdd5f5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0fd80ba180 0x7f0fd8070fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:46.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.707+0000 7f0fdd5f5640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0fd806f6c0 0x7f0fd806fb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:46.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.707+0000 7f0fdd5f5640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fd806d610 con 0x7f0fd8143ba0 2023-05-15T16:40:46.713 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.707+0000 7f0fdd5f5640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fd806e0f0 con 0x7f0fd806f6c0 2023-05-15T16:40:46.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.707+0000 7f0fdd5f5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd806d8f0 con 0x7f0fd80ba180 2023-05-15T16:40:46.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.707+0000 7f0fd67fc640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f0fd806f6c0 0x7f0fd806fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:46.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.707+0000 7f0fd6ffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0fd80ba180 0x7f0fd8070fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:46.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.707+0000 7f0fd77fe640 1 --1- >> v1:172.21.15.161:6789/0 conn(0x7f0fd8143ba0 0x7f0fd8144000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.62:42028/0 (socket says 172.21.15.62:42028) 2023-05-15T16:40:46.714 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.707+0000 7f0fd77fe640 1 -- 172.21.15.62:0/3924054502 learned_addr learned my addr 172.21.15.62:0/3924054502 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:46.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.711+0000 7f0fd6ffd640 1 -- 172.21.15.62:0/3924054502 >> v2:172.21.15.161:3300/0 conn(0x7f0fd806f6c0 msgr2=0x7f0fd806fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:46.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.711+0000 7f0fd6ffd640 1 --2- 172.21.15.62:0/3924054502 >> v2:172.21.15.161:3300/0 conn(0x7f0fd806f6c0 0x7f0fd806fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.715 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.711+0000 7f0fd6ffd640 1 -- 172.21.15.62:0/3924054502 >> v1:172.21.15.161:6789/0 conn(0x7f0fd8143ba0 legacy=0x7f0fd8144000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:46.716 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.711+0000 7f0fd6ffd640 1 -- 172.21.15.62:0/3924054502 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fd806dbd0 con 0x7f0fd80ba180 2023-05-15T16:40:46.717 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.711+0000 7f0fd6ffd640 1 --2- 172.21.15.62:0/3924054502 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0fd80ba180 0x7f0fd8070fd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80097c0 tx=0x7f0fc801c3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d419c5367f614f4e server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:46.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.711+0000 7f0fd5ffb640 1 -- 172.21.15.62:0/3924054502 <== mon.2 v2:172.21.15.161:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc80ab600 con 0x7f0fd80ba180 2023-05-15T16:40:46.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.711+0000 7f0fd5ffb640 1 -- 172.21.15.62:0/3924054502 <== mon.2 v2:172.21.15.161:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc80a7050 con 0x7f0fd80ba180 2023-05-15T16:40:46.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.711+0000 7f0fd5ffb640 1 -- 172.21.15.62:0/3924054502 <== mon.2 v2:172.21.15.161:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc80ab980 con 0x7f0fd80ba180 2023-05-15T16:40:46.718 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.711+0000 7f0fdd5f5640 1 -- 172.21.15.62:0/3924054502 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0fd80ba180 msgr2=0x7f0fd8070fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:46.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.711+0000 7f0fdd5f5640 1 --2- 172.21.15.62:0/3924054502 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0fd80ba180 0x7f0fd8070fd0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f0fc80097c0 tx=0x7f0fc801c3f0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.711+0000 7f0fdd5f5640 1 -- 172.21.15.62:0/3924054502 shutdown_connections 2023-05-15T16:40:46.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.711+0000 7f0fdd5f5640 1 --2- 172.21.15.62:0/3924054502 >> v2:172.21.15.161:3300/0 conn(0x7f0fd806f6c0 0x7f0fd806fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.719 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.711+0000 7f0fdd5f5640 1 --2- 172.21.15.62:0/3924054502 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0fd80ba180 0x7f0fd8070fd0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.711+0000 7f0fdd5f5640 1 -- 172.21.15.62:0/3924054502 >> 172.21.15.62:0/3924054502 conn(0x7f0fd80bdab0 msgr2=0x7f0fd80b98a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:46.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.711+0000 7f0fdd5f5640 1 -- 172.21.15.62:0/3924054502 shutdown_connections 2023-05-15T16:40:46.720 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fdd5f5640 1 -- 172.21.15.62:0/3924054502 wait complete. 2023-05-15T16:40:46.724 INFO:tasks.ceph.mds.c.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f147e088640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-05-15T16:40:46.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fdd5f5640 1 Processor -- start 2023-05-15T16:40:46.729 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fdd5f5640 1 -- start start 2023-05-15T16:40:46.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fdd5f5640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fd806f6c0 0x7f0fd814a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:46.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fdd5f5640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fd80ba180 0x7f0fd81e2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:46.730 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fdd5f5640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0fd8143ba0 0x7f0fd81e2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:46.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fdd5f5640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd814a6a0 con 0x7f0fd806f6c0 2023-05-15T16:40:46.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fdd5f5640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd81e5f70 con 0x7f0fd80ba180 2023-05-15T16:40:46.731 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fdd5f5640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fd81e6250 con 0x7f0fd8143ba0 2023-05-15T16:40:46.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fd6ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fd806f6c0 0x7f0fd814a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:46.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fd6ffd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fd806f6c0 0x7f0fd814a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43880/0 (socket says 172.21.15.62:43880) 2023-05-15T16:40:46.732 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fd6ffd640 1 -- 172.21.15.62:0/4052352655 learned_addr learned my addr 172.21.15.62:0/4052352655 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:46.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fd67fc640 1 --2- 172.21.15.62:0/4052352655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fd80ba180 0x7f0fd81e2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:46.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fd77fe640 1 --2- 172.21.15.62:0/4052352655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0fd8143ba0 0x7f0fd81e2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:46.733 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fd6ffd640 1 -- 172.21.15.62:0/4052352655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0fd8143ba0 msgr2=0x7f0fd81e2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:46.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fd6ffd640 1 --2- 172.21.15.62:0/4052352655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0fd8143ba0 0x7f0fd81e2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fd6ffd640 1 -- 172.21.15.62:0/4052352655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fd80ba180 msgr2=0x7f0fd81e2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:46.734 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fd6ffd640 1 --2- 172.21.15.62:0/4052352655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fd80ba180 0x7f0fd81e2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fd6ffd640 1 -- 172.21.15.62:0/4052352655 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc8009420 con 0x7f0fd806f6c0 2023-05-15T16:40:46.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fd67fc640 1 --2- 172.21.15.62:0/4052352655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fd80ba180 0x7f0fd81e2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-15T16:40:46.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fd6ffd640 1 --2- 172.21.15.62:0/4052352655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fd806f6c0 0x7f0fd814a160 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0fc801a020 tx=0x7f0fc8019190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:46.735 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fbf7fe640 1 -- 172.21.15.62:0/4052352655 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc80b4410 con 0x7f0fd806f6c0 2023-05-15T16:40:46.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fbf7fe640 1 -- 172.21.15.62:0/4052352655 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc80b4590 con 0x7f0fd806f6c0 2023-05-15T16:40:46.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fdd5f5640 1 -- 172.21.15.62:0/4052352655 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fd806d250 con 0x7f0fd806f6c0 2023-05-15T16:40:46.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fbf7fe640 1 -- 172.21.15.62:0/4052352655 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc80b4940 con 0x7f0fd806f6c0 2023-05-15T16:40:46.736 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fdd5f5640 1 -- 172.21.15.62:0/4052352655 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fd80b3e70 con 0x7f0fd806f6c0 2023-05-15T16:40:46.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.715+0000 7f0fdd5f5640 1 -- 172.21.15.62:0/4052352655 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fd806d3e0 con 0x7f0fd806f6c0 2023-05-15T16:40:46.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.719+0000 7f0fbf7fe640 1 -- 172.21.15.62:0/4052352655 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f0fc80b2040 con 0x7f0fd806f6c0 2023-05-15T16:40:46.737 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.719+0000 7f0fbf7fe640 1 --2- 172.21.15.62:0/4052352655 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0fc4065380 0x7f0fc4067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:46.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.719+0000 7f0fbf7fe640 1 -- 172.21.15.62:0/4052352655 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f0fc811c810 con 0x7f0fd806f6c0 2023-05-15T16:40:46.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.719+0000 7f0fd67fc640 1 --2- 172.21.15.62:0/4052352655 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0fc4065380 0x7f0fc4067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:46.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.719+0000 7f0fd67fc640 1 --2- 172.21.15.62:0/4052352655 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0fc4065380 0x7f0fc4067830 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8147940 tx=0x7f0fcc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:46.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.723+0000 7f0fbf7fe640 1 -- 172.21.15.62:0/4052352655 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f0fc80ea4c0 con 0x7f0fd806f6c0 2023-05-15T16:40:46.935 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.931+0000 7f0fdd5f5640 1 -- 172.21.15.62:0/4052352655 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]} v 0) v1 -- 0x7f0fd804dbe0 con 0x7f0fd806f6c0 2023-05-15T16:40:46.941 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.939+0000 7f0fbf7fe640 1 -- 172.21.15.62:0/4052352655 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw pool=cephfs_data", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 184+0+0 (secure 0 0 0) 0x7f0fc80edae0 con 0x7f0fd806f6c0 2023-05-15T16:40:46.941 INFO:teuthology.orchestra.run.smithi062.stderr:updated caps for client.0 2023-05-15T16:40:46.943 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.939+0000 7f0fdd5f5640 1 -- 172.21.15.62:0/4052352655 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0fc4065380 msgr2=0x7f0fc4067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:46.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.939+0000 7f0fdd5f5640 1 --2- 172.21.15.62:0/4052352655 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0fc4065380 0x7f0fc4067830 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0fd8147940 tx=0x7f0fcc008040 comp rx=0 tx=0).stop 2023-05-15T16:40:46.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.939+0000 7f0fdd5f5640 1 -- 172.21.15.62:0/4052352655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fd806f6c0 msgr2=0x7f0fd814a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:46.944 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.939+0000 7f0fdd5f5640 1 --2- 172.21.15.62:0/4052352655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fd806f6c0 0x7f0fd814a160 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f0fc801a020 tx=0x7f0fc8019190 comp rx=0 tx=0).stop 2023-05-15T16:40:46.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.939+0000 7f0fdd5f5640 1 -- 172.21.15.62:0/4052352655 shutdown_connections 2023-05-15T16:40:46.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.939+0000 7f0fdd5f5640 1 --2- 172.21.15.62:0/4052352655 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f0fd8143ba0 0x7f0fd81e2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.939+0000 7f0fdd5f5640 1 --2- 172.21.15.62:0/4052352655 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f0fd80ba180 0x7f0fd81e2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.945 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.939+0000 7f0fdd5f5640 1 --2- 172.21.15.62:0/4052352655 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f0fc4065380 0x7f0fc4067830 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.939+0000 7f0fdd5f5640 1 --2- 172.21.15.62:0/4052352655 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f0fd806f6c0 0x7f0fd814a160 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:46.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.939+0000 7f0fdd5f5640 1 -- 172.21.15.62:0/4052352655 >> 172.21.15.62:0/4052352655 conn(0x7f0fd80bdab0 msgr2=0x7f0fd80b2bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:46.946 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.939+0000 7f0fdd5f5640 1 -- 172.21.15.62:0/4052352655 shutdown_connections 2023-05-15T16:40:46.947 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:46.939+0000 7f0fdd5f5640 1 -- 172.21.15.62:0/4052352655 wait complete. 2023-05-15T16:40:46.960 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-05-15T16:40:47.084 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f6972bde640 1 Processor -- start 2023-05-15T16:40:47.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f6972bde640 1 -- start start 2023-05-15T16:40:47.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f6972bde640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f696c148820 0x7f696c0b8c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f6972bde640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f696c0b83c0 0x7f696c070a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.085 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f6972bde640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f696c0713b0 con 0x7f696c070f70 2023-05-15T16:40:47.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f6972bde640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f696c070410 con 0x7f696c0b83c0 2023-05-15T16:40:47.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f6972bde640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c071ce0 con 0x7f696c148820 2023-05-15T16:40:47.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f697117b640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f696c070f70 0x7f696c0b9600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39266/0 (socket says 172.21.15.62:39266) 2023-05-15T16:40:47.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f697117b640 1 -- 172.21.15.62:0/1658212146 learned_addr learned my addr 172.21.15.62:0/1658212146 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:47.086 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f696bfff640 1 --2- 172.21.15.62:0/1658212146 >> v2:172.21.15.161:3300/0 conn(0x7f696c0b83c0 0x7f696c070a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f696b7fe640 1 -- 172.21.15.62:0/1658212146 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1883181467 0 0) 0x7f696c0713b0 con 0x7f696c070f70 2023-05-15T16:40:47.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f697097a640 1 --2- 172.21.15.62:0/1658212146 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f696c148820 0x7f696c0b8c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f696b7fe640 1 -- 172.21.15.62:0/1658212146 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f695c003530 con 0x7f696c070f70 2023-05-15T16:40:47.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f696b7fe640 1 -- 172.21.15.62:0/1658212146 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3707391244 0 0) 0x7f695c003530 con 0x7f696c070f70 2023-05-15T16:40:47.087 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f696b7fe640 1 -- 172.21.15.62:0/1658212146 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f696c148820 msgr2=0x7f696c0b8c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:47.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f696b7fe640 1 --2- 172.21.15.62:0/1658212146 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f696c148820 0x7f696c0b8c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f696b7fe640 1 -- 172.21.15.62:0/1658212146 >> v2:172.21.15.161:3300/0 conn(0x7f696c0b83c0 msgr2=0x7f696c070a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:47.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f696b7fe640 1 --2- 172.21.15.62:0/1658212146 >> v2:172.21.15.161:3300/0 conn(0x7f696c0b83c0 0x7f696c070a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f696b7fe640 1 -- 172.21.15.62:0/1658212146 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c0697b0 con 0x7f696c070f70 2023-05-15T16:40:47.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f696b7fe640 1 -- 172.21.15.62:0/1658212146 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7f6964001a00 con 0x7f696c070f70 2023-05-15T16:40:47.088 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f696b7fe640 1 -- 172.21.15.62:0/1658212146 >> v1:172.21.15.62:6789/0 conn(0x7f696c070f70 legacy=0x7f696c0b9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:47.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f696b7fe640 1 --2- 172.21.15.62:0/1658212146 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f696c148820 0x7f695c003980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f696b7fe640 1 --2- 172.21.15.62:0/1658212146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f695c003f00 0x7f695c0047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f696b7fe640 1 --2- 172.21.15.62:0/1658212146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f695c004d10 0x7f695c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f696b7fe640 1 -- 172.21.15.62:0/1658212146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c070410 con 0x7f695c004d10 2023-05-15T16:40:47.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f696b7fe640 1 -- 172.21.15.62:0/1658212146 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c071ce0 con 0x7f695c003f00 2023-05-15T16:40:47.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f696b7fe640 1 -- 172.21.15.62:0/1658212146 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f695c00b9c0 con 0x7f696c148820 2023-05-15T16:40:47.089 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f697117b640 1 --2- 172.21.15.62:0/1658212146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f695c004d10 0x7f695c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f697097a640 1 --2- 172.21.15.62:0/1658212146 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f696c148820 0x7f695c003980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f696bfff640 1 --2- 172.21.15.62:0/1658212146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f695c003f00 0x7f695c0047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f697117b640 1 -- 172.21.15.62:0/1658212146 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f696c148820 msgr2=0x7f695c003980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:47.090 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f697117b640 1 --2- 172.21.15.62:0/1658212146 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f696c148820 0x7f695c003980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f697117b640 1 -- 172.21.15.62:0/1658212146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f695c003f00 msgr2=0x7f695c0047d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:47.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f697117b640 1 --2- 172.21.15.62:0/1658212146 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f695c003f00 0x7f695c0047d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.091 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.079+0000 7f697117b640 1 -- 172.21.15.62:0/1658212146 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c003530 con 0x7f695c004d10 2023-05-15T16:40:47.094 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f697117b640 1 --2- 172.21.15.62:0/1658212146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f695c004d10 0x7f695c005180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f696400a860 tx=0x7f696401d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d47cea745818cda0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:47.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f696b7fe640 1 -- 172.21.15.62:0/1658212146 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69640ad630 con 0x7f695c004d10 2023-05-15T16:40:47.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f696b7fe640 1 -- 172.21.15.62:0/1658212146 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69640a8070 con 0x7f695c004d10 2023-05-15T16:40:47.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f696b7fe640 1 -- 172.21.15.62:0/1658212146 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69640ada50 con 0x7f695c004d10 2023-05-15T16:40:47.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f6972bde640 1 -- 172.21.15.62:0/1658212146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f695c004d10 msgr2=0x7f695c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:47.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f6972bde640 1 --2- 172.21.15.62:0/1658212146 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f695c004d10 0x7f695c005180 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f696400a860 tx=0x7f696401d360 comp rx=0 tx=0).stop 2023-05-15T16:40:47.095 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f697117b640 1 -- 172.21.15.62:0/1658212146 reap_dead start 2023-05-15T16:40:47.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f6972bde640 1 -- 172.21.15.62:0/1658212146 shutdown_connections 2023-05-15T16:40:47.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f6972bde640 1 -- 172.21.15.62:0/1658212146 >> 172.21.15.62:0/1658212146 conn(0x7f696c06cf80 msgr2=0x7f696c06d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:47.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f6972bde640 1 -- 172.21.15.62:0/1658212146 shutdown_connections 2023-05-15T16:40:47.096 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f6972bde640 1 -- 172.21.15.62:0/1658212146 wait complete. 2023-05-15T16:40:47.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f6972bde640 1 Processor -- start 2023-05-15T16:40:47.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f6972bde640 1 -- start start 2023-05-15T16:40:47.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f6972bde640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f695c004d10 0x7f696c1ce990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f6972bde640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f696c0b45b0 0x7f696c0b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f6972bde640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f696c1cf140 0x7f696c1cf5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.097 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f6972bde640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c1ceed0 con 0x7f696c0b45b0 2023-05-15T16:40:47.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f6972bde640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f696c0b4120 con 0x7f696c1cf140 2023-05-15T16:40:47.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f6972bde640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f696c0b4f40 con 0x7f695c004d10 2023-05-15T16:40:47.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f696bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f696c0b45b0 0x7f696c0b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f696bfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f696c0b45b0 0x7f696c0b4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43896/0 (socket says 172.21.15.62:43896) 2023-05-15T16:40:47.098 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f696bfff640 1 -- 172.21.15.62:0/2722092221 learned_addr learned my addr 172.21.15.62:0/2722092221 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:47.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f697117b640 1 --2- 172.21.15.62:0/2722092221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f696c1cf140 0x7f696c1cf5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f697097a640 1 --2- 172.21.15.62:0/2722092221 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f695c004d10 0x7f696c1ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f696bfff640 1 -- 172.21.15.62:0/2722092221 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f695c004d10 msgr2=0x7f696c1ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:47.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.083+0000 7f696bfff640 1 --2- 172.21.15.62:0/2722092221 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f695c004d10 0x7f696c1ce990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.087+0000 7f696bfff640 1 -- 172.21.15.62:0/2722092221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f696c1cf140 msgr2=0x7f696c1cf5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:47.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.087+0000 7f696bfff640 1 --2- 172.21.15.62:0/2722092221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f696c1cf140 0x7f696c1cf5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.099 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.087+0000 7f696bfff640 1 -- 172.21.15.62:0/2722092221 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f696c069d70 con 0x7f696c0b45b0 2023-05-15T16:40:47.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.087+0000 7f696bfff640 1 --2- 172.21.15.62:0/2722092221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f696c0b45b0 0x7f696c0b4a00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f69580115e0 tx=0x7f6958011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:47.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.087+0000 7f69697fa640 1 -- 172.21.15.62:0/2722092221 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6958015870 con 0x7f696c0b45b0 2023-05-15T16:40:47.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.087+0000 7f69697fa640 1 -- 172.21.15.62:0/2722092221 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69580159d0 con 0x7f696c0b45b0 2023-05-15T16:40:47.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.087+0000 7f6972bde640 1 -- 172.21.15.62:0/2722092221 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f696c069a90 con 0x7f696c0b45b0 2023-05-15T16:40:47.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.087+0000 7f69697fa640 1 -- 172.21.15.62:0/2722092221 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6958015d40 con 0x7f696c0b45b0 2023-05-15T16:40:47.100 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.087+0000 7f6972bde640 1 -- 172.21.15.62:0/2722092221 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f696c070050 con 0x7f696c0b45b0 2023-05-15T16:40:47.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.087+0000 7f6972bde640 1 -- 172.21.15.62:0/2722092221 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f696c067960 con 0x7f696c0b45b0 2023-05-15T16:40:47.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.087+0000 7f69697fa640 1 -- 172.21.15.62:0/2722092221 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f695800f480 con 0x7f696c0b45b0 2023-05-15T16:40:47.101 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.087+0000 7f69697fa640 1 --2- 172.21.15.62:0/2722092221 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6950065380 0x7f6950067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.087+0000 7f69697fa640 1 -- 172.21.15.62:0/2722092221 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f69580830b0 con 0x7f696c0b45b0 2023-05-15T16:40:47.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.087+0000 7f697097a640 1 --2- 172.21.15.62:0/2722092221 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6950065380 0x7f6950067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.087+0000 7f697097a640 1 --2- 172.21.15.62:0/2722092221 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6950065380 0x7f6950067830 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6960009a30 tx=0x7f6960008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:47.102 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.091+0000 7f69697fa640 1 -- 172.21.15.62:0/2722092221 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f69580547f0 con 0x7f696c0b45b0 2023-05-15T16:40:47.283 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.279+0000 7f6972bde640 1 -- 172.21.15.62:0/2722092221 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f696c0b4260 con 0x7f696c0b45b0 2023-05-15T16:40:47.284 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.279+0000 7f69697fa640 1 -- 172.21.15.62:0/2722092221 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3891 (secure 0 0 0) 0x7f6958054380 con 0x7f696c0b45b0 2023-05-15T16:40:47.284 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:40:47.285 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4571,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.62:6834/4029121060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6832","nonce":4029121060},{"type":"v1","addr":"172.21.15.62:6834","nonce":4029121060}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10},{"gid":4672,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.161:6835/1717488141","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:6834","nonce":1717488141},{"type":"v1","addr":"172.21.15.161:6835","nonce":1717488141}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-05-15T16:40:43.133344+0000","modified":"2023-05-15T16:40:45.146541+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4959},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4959":{"gid":4959,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.62:6835/303746399","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:6833","nonce":303746399},{"type":"v1","addr":"172.21.15.62:6835","nonce":303746399}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-05-15T16:40:47.285 INFO:teuthology.orchestra.run.smithi062.stderr:dumped fsmap epoch 13 2023-05-15T16:40:47.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.283+0000 7f6972bde640 1 -- 172.21.15.62:0/2722092221 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6950065380 msgr2=0x7f6950067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:47.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.283+0000 7f6972bde640 1 --2- 172.21.15.62:0/2722092221 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6950065380 0x7f6950067830 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6960009a30 tx=0x7f6960008040 comp rx=0 tx=0).stop 2023-05-15T16:40:47.286 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.283+0000 7f6972bde640 1 -- 172.21.15.62:0/2722092221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f696c0b45b0 msgr2=0x7f696c0b4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:47.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.283+0000 7f6972bde640 1 --2- 172.21.15.62:0/2722092221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f696c0b45b0 0x7f696c0b4a00 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f69580115e0 tx=0x7f6958011aa0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.283+0000 7f6972bde640 1 -- 172.21.15.62:0/2722092221 shutdown_connections 2023-05-15T16:40:47.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.283+0000 7f6972bde640 1 --2- 172.21.15.62:0/2722092221 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f696c1cf140 0x7f696c1cf5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.283+0000 7f6972bde640 1 --2- 172.21.15.62:0/2722092221 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6950065380 0x7f6950067830 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.283+0000 7f6972bde640 1 --2- 172.21.15.62:0/2722092221 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f696c0b45b0 0x7f696c0b4a00 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.283+0000 7f6972bde640 1 --2- 172.21.15.62:0/2722092221 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f695c004d10 0x7f696c1ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.287 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.283+0000 7f6972bde640 1 -- 172.21.15.62:0/2722092221 >> 172.21.15.62:0/2722092221 conn(0x7f696c06cf80 msgr2=0x7f696c0b9600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:47.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.283+0000 7f6972bde640 1 -- 172.21.15.62:0/2722092221 shutdown_connections 2023-05-15T16:40:47.288 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.283+0000 7f6972bde640 1 -- 172.21.15.62:0/2722092221 wait complete. 2023-05-15T16:40:47.604 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-05-15T16:40:43.133344+0000', 'modified': '2023-05-15T16:40:45.146541+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4959}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4959': {'gid': 4959, 'name': 'c', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.62:6835/303746399', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.62:6833', 'nonce': 303746399}, {'type': 'v1', 'addr': '172.21.15.62:6835', 'nonce': 303746399}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-05-15T16:40:47.605 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-05-15T16:40:47.606 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-05-15T16:40:47.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.735+0000 7fbdfe661640 1 Processor -- start 2023-05-15T16:40:47.738 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.735+0000 7fbdfe661640 1 -- start start 2023-05-15T16:40:47.739 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.735+0000 7fbdfe661640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbdf8071930 0x7fbdf814b050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.735+0000 7fbdfe661640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdf81486f0 0x7fbdf8141de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.735+0000 7fbdfe661640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbdf8147b50 con 0x7fbdf8141960 2023-05-15T16:40:47.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.735+0000 7fbdfe661640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbdf814b590 con 0x7fbdf8071930 2023-05-15T16:40:47.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.735+0000 7fbdfe661640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf814b7e0 con 0x7fbdf81486f0 2023-05-15T16:40:47.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.735+0000 7fbdf7fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbdf8071930 0x7fbdf814b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.735+0000 7fbdf7fff640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fbdf8071930 0x7fbdf814b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43912/0 (socket says 172.21.15.62:43912) 2023-05-15T16:40:47.740 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.735+0000 7fbdf7fff640 1 -- 172.21.15.62:0/516662496 learned_addr learned my addr 172.21.15.62:0/516662496 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:47.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.735+0000 7fbdfcbfe640 1 --2- 172.21.15.62:0/516662496 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdf81486f0 0x7fbdf8141de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.735+0000 7fbdf7fff640 1 -- 172.21.15.62:0/516662496 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdf81486f0 msgr2=0x7fbdf8141de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:47.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.735+0000 7fbdf7fff640 1 --2- 172.21.15.62:0/516662496 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdf81486f0 0x7fbdf8141de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.741 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.735+0000 7fbdf7fff640 1 -- 172.21.15.62:0/516662496 >> v1:172.21.15.161:6789/0 conn(0x7fbdf8141960 legacy=0x7fbdf8147fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:47.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.735+0000 7fbdf7fff640 1 -- 172.21.15.62:0/516662496 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf814bac0 con 0x7fbdf8071930 2023-05-15T16:40:47.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdf7fff640 1 --2- 172.21.15.62:0/516662496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdf8071930 0x7fbdf814b050 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009e50 tx=0x7fbdf001ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e8254ab831a41e server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:47.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdf6ffd640 1 -- 172.21.15.62:0/516662496 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf00a5790 con 0x7fbdf8071930 2023-05-15T16:40:47.742 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdf6ffd640 1 -- 172.21.15.62:0/516662496 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbdf00a58f0 con 0x7fbdf8071930 2023-05-15T16:40:47.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdf6ffd640 1 -- 172.21.15.62:0/516662496 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf00a5c80 con 0x7fbdf8071930 2023-05-15T16:40:47.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdfe661640 1 -- 172.21.15.62:0/516662496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdf8071930 msgr2=0x7fbdf814b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:47.743 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdfe661640 1 --2- 172.21.15.62:0/516662496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdf8071930 0x7fbdf814b050 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fbdf0009e50 tx=0x7fbdf001ca10 comp rx=0 tx=0).stop 2023-05-15T16:40:47.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdfe661640 1 -- 172.21.15.62:0/516662496 shutdown_connections 2023-05-15T16:40:47.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdfe661640 1 --2- 172.21.15.62:0/516662496 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdf81486f0 0x7fbdf8141de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdfe661640 1 --2- 172.21.15.62:0/516662496 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdf8071930 0x7fbdf814b050 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdfe661640 1 -- 172.21.15.62:0/516662496 >> 172.21.15.62:0/516662496 conn(0x7fbdf806cfc0 msgr2=0x7fbdf806d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:47.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdfe661640 1 -- 172.21.15.62:0/516662496 shutdown_connections 2023-05-15T16:40:47.744 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdfe661640 1 -- 172.21.15.62:0/516662496 wait complete. 2023-05-15T16:40:47.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdfe661640 1 Processor -- start 2023-05-15T16:40:47.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdfe661640 1 -- start start 2023-05-15T16:40:47.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdfe661640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdf8071930 0x7fbdf8146aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.746 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdfe661640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdf8141960 0x7fbdf81e5470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdfe661640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdf81486f0 0x7fbdf813bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdfe661640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf80bad00 con 0x7fbdf8141960 2023-05-15T16:40:47.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdfe661640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf8146fe0 con 0x7fbdf81486f0 2023-05-15T16:40:47.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdfe661640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbdf806f8d0 con 0x7fbdf8071930 2023-05-15T16:40:47.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdf77fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdf8141960 0x7fbdf81e5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.739+0000 7fbdf77fe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdf8141960 0x7fbdf81e5470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43926/0 (socket says 172.21.15.62:43926) 2023-05-15T16:40:47.747 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.743+0000 7fbdf77fe640 1 -- 172.21.15.62:0/477897015 learned_addr learned my addr 172.21.15.62:0/477897015 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:47.748 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.743+0000 7fbdf7fff640 1 --2- 172.21.15.62:0/477897015 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdf8071930 0x7fbdf8146aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.743+0000 7fbdf77fe640 1 -- 172.21.15.62:0/477897015 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdf8071930 msgr2=0x7fbdf8146aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:47.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.743+0000 7fbdf77fe640 1 --2- 172.21.15.62:0/477897015 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdf8071930 0x7fbdf8146aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.743+0000 7fbdf77fe640 1 -- 172.21.15.62:0/477897015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdf81486f0 msgr2=0x7fbdf813bb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:47.749 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.743+0000 7fbdf77fe640 1 --2- 172.21.15.62:0/477897015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdf81486f0 0x7fbdf813bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.743+0000 7fbdf77fe640 1 -- 172.21.15.62:0/477897015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdf0009b30 con 0x7fbdf8141960 2023-05-15T16:40:47.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.743+0000 7fbdf77fe640 1 --2- 172.21.15.62:0/477897015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdf8141960 0x7fbdf81e5470 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbde000c500 tx=0x7fbde000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:47.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.743+0000 7fbdf4ff9640 1 -- 172.21.15.62:0/477897015 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde0005220 con 0x7fbdf8141960 2023-05-15T16:40:47.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.743+0000 7fbdf4ff9640 1 -- 172.21.15.62:0/477897015 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde0005380 con 0x7fbdf8141960 2023-05-15T16:40:47.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.743+0000 7fbdfe661640 1 -- 172.21.15.62:0/477897015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdf80b46c0 con 0x7fbdf8141960 2023-05-15T16:40:47.750 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.743+0000 7fbdf4ff9640 1 -- 172.21.15.62:0/477897015 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde0007270 con 0x7fbdf8141960 2023-05-15T16:40:47.751 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.743+0000 7fbdfe661640 1 -- 172.21.15.62:0/477897015 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdf8071d00 con 0x7fbdf8141960 2023-05-15T16:40:47.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.743+0000 7fbdf4ff9640 1 -- 172.21.15.62:0/477897015 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fbde00073d0 con 0x7fbdf8141960 2023-05-15T16:40:47.756 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.743+0000 7fbdf4ff9640 1 --2- 172.21.15.62:0/477897015 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbdd8065380 0x7fbdd8067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.743+0000 7fbdf4ff9640 1 -- 172.21.15.62:0/477897015 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbde0081b80 con 0x7fbdf8141960 2023-05-15T16:40:47.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.743+0000 7fbdf7fff640 1 --2- 172.21.15.62:0/477897015 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbdd8065380 0x7fbdd8067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.743+0000 7fbe01782000 1 Processor -- start 2023-05-15T16:40:47.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.743+0000 7fbe01782000 1 -- start start 2023-05-15T16:40:47.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdf7fff640 1 --2- 172.21.15.62:0/477897015 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbdd8065380 0x7fbdd8067830 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00ae000 tx=0x7fbdf00a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:47.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55da4719ffd0 0x55da473fc380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55da473fc8c0 0x55da473f9070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.757 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da473f95b0 0x55da473f6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da47290b50 con 0x55da473f95b0 2023-05-15T16:40:47.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da471addd0 con 0x55da4719ffd0 2023-05-15T16:40:47.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da4721e640 con 0x55da473fc8c0 2023-05-15T16:40:47.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdfcbfe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da473f95b0 0x55da473f6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdfcbfe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da473f95b0 0x55da473f6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43930/0 (socket says 172.21.15.62:43930) 2023-05-15T16:40:47.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdfcbfe640 1 -- 172.21.15.62:0/3573900424 learned_addr learned my addr 172.21.15.62:0/3573900424 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:47.758 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdf77fe640 1 --2- 172.21.15.62:0/3573900424 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55da473fc8c0 0x55da473f9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdf7fff640 1 --2- 172.21.15.62:0/3573900424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55da4719ffd0 0x55da473fc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdfcbfe640 1 -- 172.21.15.62:0/3573900424 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55da473fc8c0 msgr2=0x55da473f9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:47.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdfcbfe640 1 --2- 172.21.15.62:0/3573900424 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55da473fc8c0 0x55da473f9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdfcbfe640 1 -- 172.21.15.62:0/3573900424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55da4719ffd0 msgr2=0x55da473fc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:47.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdfcbfe640 1 --2- 172.21.15.62:0/3573900424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55da4719ffd0 0x55da473fc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.759 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdfcbfe640 1 -- 172.21.15.62:0/3573900424 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da471dd0b0 con 0x55da473f95b0 2023-05-15T16:40:47.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdf77fe640 1 --2- 172.21.15.62:0/3573900424 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55da473fc8c0 0x55da473f9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:47.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdfcbfe640 1 --2- 172.21.15.62:0/3573900424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da473f95b0 0x55da473f6c30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009a50 tx=0x7fbde8009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ed3bfd1045e2928 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:47.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdedffb640 1 -- 172.21.15.62:0/3573900424 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde80095a0 con 0x55da473f95b0 2023-05-15T16:40:47.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdedffb640 1 -- 172.21.15.62:0/3573900424 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde800eaa0 con 0x55da473f95b0 2023-05-15T16:40:47.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdedffb640 1 -- 172.21.15.62:0/3573900424 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde800ee30 con 0x55da473f95b0 2023-05-15T16:40:47.760 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 -- 172.21.15.62:0/3573900424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da473f95b0 msgr2=0x55da473f6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:47.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 --2- 172.21.15.62:0/3573900424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da473f95b0 0x55da473f6c30 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fbde8009a50 tx=0x7fbde8009f10 comp rx=0 tx=0).stop 2023-05-15T16:40:47.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 -- 172.21.15.62:0/3573900424 shutdown_connections 2023-05-15T16:40:47.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 --2- 172.21.15.62:0/3573900424 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da473f95b0 0x55da473f6c30 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 --2- 172.21.15.62:0/3573900424 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55da473fc8c0 0x55da473f9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 --2- 172.21.15.62:0/3573900424 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55da4719ffd0 0x55da473fc380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 -- 172.21.15.62:0/3573900424 >> 172.21.15.62:0/3573900424 conn(0x55da4726f1f0 msgr2=0x55da473fbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:47.761 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 -- 172.21.15.62:0/3573900424 shutdown_connections 2023-05-15T16:40:47.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 -- 172.21.15.62:0/3573900424 wait complete. 2023-05-15T16:40:47.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 -- start start 2023-05-15T16:40:47.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 Processor -- start 2023-05-15T16:40:47.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55da4719ffd0 0x55da473ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.762 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55da473f95b0 0x55da473cf060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da473fc8c0 0x55da47403320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da47217780 con 0x55da473fc8c0 2023-05-15T16:40:47.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da471d5250 con 0x55da473f95b0 2023-05-15T16:40:47.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da471d4ef0 con 0x55da4719ffd0 2023-05-15T16:40:47.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 10 client.0 _ll_register_callbacks cb 0x55da473b5130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-15T16:40:47.763 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdfcbfe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da473fc8c0 0x55da47403320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdfcbfe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da473fc8c0 0x55da47403320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43944/0 (socket says 172.21.15.62:43944) 2023-05-15T16:40:47.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdfcbfe640 1 -- 172.21.15.62:0/3990615647 learned_addr learned my addr 172.21.15.62:0/3990615647 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:47.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdfcbfe640 1 -- 172.21.15.62:0/3990615647 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55da4719ffd0 msgr2=0x55da473ceb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:47.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdf7fff640 1 --2- 172.21.15.62:0/3990615647 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55da4719ffd0 0x55da473ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdf77fe640 1 --2- 172.21.15.62:0/3990615647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55da473f95b0 0x55da473cf060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdfcbfe640 1 --2- 172.21.15.62:0/3990615647 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55da4719ffd0 0x55da473ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.764 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdfcbfe640 1 -- 172.21.15.62:0/3990615647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55da473f95b0 msgr2=0x55da473cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:47.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdfcbfe640 1 --2- 172.21.15.62:0/3990615647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55da473f95b0 0x55da473cf060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdfcbfe640 1 -- 172.21.15.62:0/3990615647 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbde8009700 con 0x55da473fc8c0 2023-05-15T16:40:47.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdfcbfe640 1 --2- 172.21.15.62:0/3990615647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da473fc8c0 0x55da47403320 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55da472b86c0 tx=0x7fbde8009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab745f509c6c7bd4 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:47.765 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdd6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-05-15T16:40:47.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdd6ffd640 1 -- 172.21.15.62:0/3990615647 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8003820 con 0x55da473fc8c0 2023-05-15T16:40:47.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbdd6ffd640 1 -- 172.21.15.62:0/3990615647 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbde8003980 con 0x55da473fc8c0 2023-05-15T16:40:47.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.747+0000 7fbe01782000 1 -- 172.21.15.62:0/3990615647 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55da471dbc60 con 0x55da473fc8c0 2023-05-15T16:40:47.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbdd6ffd640 1 -- 172.21.15.62:0/3990615647 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbde8003b40 con 0x55da473fc8c0 2023-05-15T16:40:47.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbe01782000 10 client.5115 fetch_fsmap learned FSMap version 13 2023-05-15T16:40:47.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbe01782000 1 -- 172.21.15.62:0/3990615647 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x55da46f14890 con 0x55da473fc8c0 2023-05-15T16:40:47.766 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbdd6ffd640 1 -- 172.21.15.62:0/3990615647 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55da471dbc60 con 0x55da473fc8c0 2023-05-15T16:40:47.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbdd6ffd640 1 -- 172.21.15.62:0/3990615647 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 13) v1 ==== 2561+0+0 (secure 0 0 0) 0x7fbde8011070 con 0x55da473fc8c0 2023-05-15T16:40:47.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbe01782000 10 client.5115 fetch_fsmap finished waiting for FSMap version 13 2023-05-15T16:40:47.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbe01782000 10 client.5115 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-15T16:40:47.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbe01782000 20 client.5115 populate_metadata read hostname 'smithi062' 2023-05-15T16:40:47.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbe01782000 1 --2- 172.21.15.62:0/3990615647 >> [v2:172.21.15.62:6833/303746399,v1:172.21.15.62:6835/303746399] conn(0x55da47403d30 0x55da47404100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbe01782000 4 client.5115 mds_command: new command op to 4959 tid=0[{"prefix": "get_command_descriptions"}] 2023-05-15T16:40:47.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbe01782000 1 -- 172.21.15.62:0/3990615647 --> [v2:172.21.15.62:6833/303746399,v1:172.21.15.62:6835/303746399] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55da472160d0 con 0x55da47403d30 2023-05-15T16:40:47.767 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbdf7fff640 1 --2- 172.21.15.62:0/3990615647 >> [v2:172.21.15.62:6833/303746399,v1:172.21.15.62:6835/303746399] conn(0x55da47403d30 0x55da47404100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbdd6ffd640 10 client.5115 ms_handle_connect on v2:172.21.15.62:6833/303746399 2023-05-15T16:40:47.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbdf7fff640 1 --2- 172.21.15.62:0/3990615647 >> [v2:172.21.15.62:6833/303746399,v1:172.21.15.62:6835/303746399] conn(0x55da47403d30 0x55da47404100 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a6f3e9f0933a6976 server_cookie=9056b5a998089f18 in_seq=0 out_seq=0 2023-05-15T16:40:47.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbdd6ffd640 1 -- 172.21.15.62:0/3990615647 <== mds.0 v2:172.21.15.62:6833/303746399 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17888 (crc 0 0 0) 0x55da472160d0 con 0x55da47403d30 2023-05-15T16:40:47.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbdd6ffd640 10 client.5115 handle_command_reply: tid=0 2023-05-15T16:40:47.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbe01782000 1 client.5115 shutdown 2023-05-15T16:40:47.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbe01782000 1 -- 172.21.15.62:0/3990615647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da473fc8c0 msgr2=0x55da47403320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:47.768 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbe01782000 1 --2- 172.21.15.62:0/3990615647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da473fc8c0 0x55da47403320 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55da472b86c0 tx=0x7fbde8009190 comp rx=0 tx=0).stop 2023-05-15T16:40:47.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbe01782000 1 -- 172.21.15.62:0/3990615647 shutdown_connections 2023-05-15T16:40:47.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbe01782000 1 --2- 172.21.15.62:0/3990615647 >> [v2:172.21.15.62:6833/303746399,v1:172.21.15.62:6835/303746399] conn(0x55da47403d30 0x55da47404100 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbe01782000 1 --2- 172.21.15.62:0/3990615647 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da473fc8c0 0x55da47403320 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbe01782000 1 --2- 172.21.15.62:0/3990615647 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55da473f95b0 0x55da473cf060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbdd6ffd640 0 client.5115 ms_handle_reset on v2:172.21.15.62:6833/303746399 2023-05-15T16:40:47.769 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbe01782000 1 --2- 172.21.15.62:0/3990615647 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55da4719ffd0 0x55da473ceb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbe01782000 1 -- 172.21.15.62:0/3990615647 >> 172.21.15.62:0/3990615647 conn(0x55da4726f1f0 msgr2=0x55da473fb990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:47.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbe01782000 1 -- 172.21.15.62:0/3990615647 shutdown_connections 2023-05-15T16:40:47.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbe01782000 1 -- 172.21.15.62:0/3990615647 wait complete. 2023-05-15T16:40:47.770 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.751+0000 7fbe01782000 20 client.5115 trim_cache size 0 max 16384 2023-05-15T16:40:47.772 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbe01782000 1 Processor -- start 2023-05-15T16:40:47.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbe01782000 1 -- start start 2023-05-15T16:40:47.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbe01782000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55da4719ffd0 0x55da473c5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbe01782000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55da473f95b0 0x55da47457c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.773 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbe01782000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da473fc8c0 0x55da47458160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbe01782000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da46ed5940 con 0x55da473fc8c0 2023-05-15T16:40:47.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbe01782000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da47214b80 con 0x55da473f95b0 2023-05-15T16:40:47.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbe01782000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da473c1460 con 0x55da4719ffd0 2023-05-15T16:40:47.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbdfcbfe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da473fc8c0 0x55da47458160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.774 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbdfcbfe640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da473fc8c0 0x55da47458160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43946/0 (socket says 172.21.15.62:43946) 2023-05-15T16:40:47.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbdfcbfe640 1 -- 172.21.15.62:0/899234573 learned_addr learned my addr 172.21.15.62:0/899234573 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:47.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbdfcbfe640 1 -- 172.21.15.62:0/899234573 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55da4719ffd0 msgr2=0x55da473c5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:47.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbdfcbfe640 1 --2- 172.21.15.62:0/899234573 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55da4719ffd0 0x55da473c5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbdfcbfe640 1 -- 172.21.15.62:0/899234573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55da473f95b0 msgr2=0x55da47457c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:47.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbdfcbfe640 1 --2- 172.21.15.62:0/899234573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55da473f95b0 0x55da47457c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.775 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbdfcbfe640 1 -- 172.21.15.62:0/899234573 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55da471dd360 con 0x55da473fc8c0 2023-05-15T16:40:47.776 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbdfcbfe640 1 --2- 172.21.15.62:0/899234573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da473fc8c0 0x55da47458160 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbde800e6e0 tx=0x7fbde801f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9e125dff191fce server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:47.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbdee7fc640 1 -- 172.21.15.62:0/899234573 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8009920 con 0x55da473fc8c0 2023-05-15T16:40:47.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbdee7fc640 1 -- 172.21.15.62:0/899234573 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbde8028840 con 0x55da473fc8c0 2023-05-15T16:40:47.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbdee7fc640 1 -- 172.21.15.62:0/899234573 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbde8028bd0 con 0x55da473fc8c0 2023-05-15T16:40:47.777 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbe01782000 1 -- 172.21.15.62:0/899234573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da473fc8c0 msgr2=0x55da47458160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:47.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbe01782000 1 --2- 172.21.15.62:0/899234573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da473fc8c0 0x55da47458160 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fbde800e6e0 tx=0x7fbde801f040 comp rx=0 tx=0).stop 2023-05-15T16:40:47.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbe01782000 1 -- 172.21.15.62:0/899234573 shutdown_connections 2023-05-15T16:40:47.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbe01782000 1 --2- 172.21.15.62:0/899234573 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da473fc8c0 0x55da47458160 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.778 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbe01782000 1 --2- 172.21.15.62:0/899234573 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55da473f95b0 0x55da47457c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbe01782000 1 --2- 172.21.15.62:0/899234573 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55da4719ffd0 0x55da473c5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbe01782000 1 -- 172.21.15.62:0/899234573 >> 172.21.15.62:0/899234573 conn(0x55da4726f1f0 msgr2=0x55da47405530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:47.779 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbe01782000 1 -- 172.21.15.62:0/899234573 shutdown_connections 2023-05-15T16:40:47.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbe01782000 1 -- 172.21.15.62:0/899234573 wait complete. 2023-05-15T16:40:47.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbe01782000 1 -- start start 2023-05-15T16:40:47.780 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.767+0000 7fbe01782000 1 Processor -- start 2023-05-15T16:40:47.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da4719ffd0 0x55da47456df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55da473f95b0 0x55da47457330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55da473fc8c0 0x55da47414ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.785 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da472a11d0 con 0x55da4719ffd0 2023-05-15T16:40:47.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x55da47216610 con 0x55da473fc8c0 2023-05-15T16:40:47.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x55da47216f90 con 0x55da473f95b0 2023-05-15T16:40:47.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 10 client.0 _ll_register_callbacks cb 0x55da471d95e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-05-15T16:40:47.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdf7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da4719ffd0 0x55da47456df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.786 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdf7fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da4719ffd0 0x55da47456df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43958/0 (socket says 172.21.15.62:43958) 2023-05-15T16:40:47.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdf7fff640 1 -- 172.21.15.62:0/1036271491 learned_addr learned my addr 172.21.15.62:0/1036271491 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:47.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdfcbfe640 1 --2- 172.21.15.62:0/1036271491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55da473fc8c0 0x55da47414ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.787 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdf7fff640 1 -- 172.21.15.62:0/1036271491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55da473f95b0 msgr2=0x55da47457330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:47.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdf77fe640 1 --2- 172.21.15.62:0/1036271491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55da473f95b0 0x55da47457330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdf7fff640 1 --2- 172.21.15.62:0/1036271491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55da473f95b0 0x55da47457330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdf7fff640 1 -- 172.21.15.62:0/1036271491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55da473fc8c0 msgr2=0x55da47414ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:47.788 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdf7fff640 1 --2- 172.21.15.62:0/1036271491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55da473fc8c0 0x55da47414ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdf7fff640 1 -- 172.21.15.62:0/1036271491 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55da46f14890 con 0x55da4719ffd0 2023-05-15T16:40:47.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdfcbfe640 1 --2- 172.21.15.62:0/1036271491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55da473fc8c0 0x55da47414ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:40:47.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdf7fff640 1 --2- 172.21.15.62:0/1036271491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da4719ffd0 0x55da47456df0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbdf001c480 tx=0x7fbdf001b250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab33e22789bc52b8 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:47.789 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdd6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.62:3300/0 2023-05-15T16:40:47.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdd6ffd640 1 -- 172.21.15.62:0/1036271491 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbdf00be040 con 0x55da4719ffd0 2023-05-15T16:40:47.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdd6ffd640 1 -- 172.21.15.62:0/1036271491 <== mon.0 v2:172.21.15.62:3300/0 2 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fbdf00a5de0 con 0x55da4719ffd0 2023-05-15T16:40:47.790 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 1 -- 172.21.15.62:0/1036271491 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55da471be4d0 con 0x55da4719ffd0 2023-05-15T16:40:47.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdd6ffd640 1 -- 172.21.15.62:0/1036271491 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbdf00c7050 con 0x55da4719ffd0 2023-05-15T16:40:47.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 10 client.5121 fetch_fsmap learned FSMap version 13 2023-05-15T16:40:47.791 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 1 -- 172.21.15.62:0/1036271491 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x55da471c2be0 con 0x55da4719ffd0 2023-05-15T16:40:47.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdd6ffd640 1 -- 172.21.15.62:0/1036271491 <== mon.0 v2:172.21.15.62:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55da471be4d0 con 0x55da4719ffd0 2023-05-15T16:40:47.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdd6ffd640 1 -- 172.21.15.62:0/1036271491 <== mon.0 v2:172.21.15.62:3300/0 5 ==== fsmap(e 13) v1 ==== 2561+0+0 (secure 0 0 0) 0x7fbdf00b5040 con 0x55da4719ffd0 2023-05-15T16:40:47.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 10 client.5121 fetch_fsmap finished waiting for FSMap version 13 2023-05-15T16:40:47.792 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 10 client.5121 resolve_mds: resolved name 'c' to daemon mds.c 2023-05-15T16:40:47.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 20 client.5121 populate_metadata read hostname 'smithi062' 2023-05-15T16:40:47.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 1 --2- 172.21.15.62:0/1036271491 >> [v2:172.21.15.62:6833/303746399,v1:172.21.15.62:6835/303746399] conn(0x55da474650e0 0x55da474674c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.793 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 4 client.5121 mds_command: new command op to 4959 tid=0[{"prefix": "status"}] 2023-05-15T16:40:47.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 1 -- 172.21.15.62:0/1036271491 --> [v2:172.21.15.62:6833/303746399,v1:172.21.15.62:6835/303746399] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55da47210800 con 0x55da474650e0 2023-05-15T16:40:47.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdf77fe640 1 --2- 172.21.15.62:0/1036271491 >> [v2:172.21.15.62:6833/303746399,v1:172.21.15.62:6835/303746399] conn(0x55da474650e0 0x55da474674c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdd6ffd640 10 client.5121 ms_handle_connect on v2:172.21.15.62:6833/303746399 2023-05-15T16:40:47.794 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdf77fe640 1 --2- 172.21.15.62:0/1036271491 >> [v2:172.21.15.62:6833/303746399,v1:172.21.15.62:6835/303746399] conn(0x55da474650e0 0x55da474674c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3ab666244f31786 server_cookie=74b62c82f572ef2 in_seq=0 out_seq=0 2023-05-15T16:40:47.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdd6ffd640 1 -- 172.21.15.62:0/1036271491 <== mds.0 v2:172.21.15.62:6833/303746399 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55da47210800 con 0x55da474650e0 2023-05-15T16:40:47.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdd6ffd640 10 client.5121 handle_command_reply: tid=0 2023-05-15T16:40:47.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 1 client.5121 shutdown 2023-05-15T16:40:47.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 1 -- 172.21.15.62:0/1036271491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da4719ffd0 msgr2=0x55da47456df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:47.795 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 1 --2- 172.21.15.62:0/1036271491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da4719ffd0 0x55da47456df0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fbdf001c480 tx=0x7fbdf001b250 comp rx=0 tx=0).stop 2023-05-15T16:40:47.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 1 -- 172.21.15.62:0/1036271491 shutdown_connections 2023-05-15T16:40:47.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 1 --2- 172.21.15.62:0/1036271491 >> [v2:172.21.15.62:6833/303746399,v1:172.21.15.62:6835/303746399] conn(0x55da474650e0 0x55da474674c0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.796 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 1 --2- 172.21.15.62:0/1036271491 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x55da473fc8c0 0x55da47414ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 1 --2- 172.21.15.62:0/1036271491 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x55da473f95b0 0x55da47457330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdd6ffd640 0 client.5121 ms_handle_reset on v2:172.21.15.62:6833/303746399 2023-05-15T16:40:47.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 1 --2- 172.21.15.62:0/1036271491 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x55da4719ffd0 0x55da47456df0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.797 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 1 -- 172.21.15.62:0/1036271491 >> 172.21.15.62:0/1036271491 conn(0x55da4726f1f0 msgr2=0x55da47405320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:47.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 1 -- 172.21.15.62:0/1036271491 shutdown_connections 2023-05-15T16:40:47.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 1 -- 172.21.15.62:0/1036271491 wait complete. 2023-05-15T16:40:47.798 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbe01782000 20 client.5121 trim_cache size 0 max 16384 2023-05-15T16:40:47.798 INFO:teuthology.orchestra.run.smithi062.stdout:{ 2023-05-15T16:40:47.798 INFO:teuthology.orchestra.run.smithi062.stdout: "cluster_fsid": "fed834dd-24d2-40f4-8361-7c8c5a9484de", 2023-05-15T16:40:47.799 INFO:teuthology.orchestra.run.smithi062.stdout: "whoami": 0, 2023-05-15T16:40:47.799 INFO:teuthology.orchestra.run.smithi062.stdout: "id": 4959, 2023-05-15T16:40:47.799 INFO:teuthology.orchestra.run.smithi062.stdout: "want_state": "up:active", 2023-05-15T16:40:47.799 INFO:teuthology.orchestra.run.smithi062.stdout: "state": "up:active", 2023-05-15T16:40:47.799 INFO:teuthology.orchestra.run.smithi062.stdout: "fs_name": "cephfs", 2023-05-15T16:40:47.799 INFO:teuthology.orchestra.run.smithi062.stdout: "rank_uptime": 4.6367841299999997, 2023-05-15T16:40:47.799 INFO:teuthology.orchestra.run.smithi062.stdout: "mdsmap_epoch": 13, 2023-05-15T16:40:47.800 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch": 34, 2023-05-15T16:40:47.800 INFO:teuthology.orchestra.run.smithi062.stdout: "osdmap_epoch_barrier": 34, 2023-05-15T16:40:47.800 INFO:teuthology.orchestra.run.smithi062.stdout: "uptime": 11.88726613 2023-05-15T16:40:47.800 INFO:teuthology.orchestra.run.smithi062.stdout:} 2023-05-15T16:40:47.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdfe661640 1 -- 172.21.15.62:0/477897015 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbdd8065380 msgr2=0x7fbdd8067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:47.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdfe661640 1 --2- 172.21.15.62:0/477897015 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbdd8065380 0x7fbdd8067830 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fbdf00ae000 tx=0x7fbdf00a7070 comp rx=0 tx=0).stop 2023-05-15T16:40:47.801 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdfe661640 1 -- 172.21.15.62:0/477897015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdf8141960 msgr2=0x7fbdf81e5470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:47.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdfe661640 1 --2- 172.21.15.62:0/477897015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdf8141960 0x7fbdf81e5470 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fbde000c500 tx=0x7fbde000c9c0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdfe661640 1 -- 172.21.15.62:0/477897015 shutdown_connections 2023-05-15T16:40:47.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdfe661640 1 --2- 172.21.15.62:0/477897015 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fbdf81486f0 0x7fbdf813bb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdfe661640 1 --2- 172.21.15.62:0/477897015 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fbdd8065380 0x7fbdd8067830 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdfe661640 1 --2- 172.21.15.62:0/477897015 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fbdf8141960 0x7fbdf81e5470 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdfe661640 1 --2- 172.21.15.62:0/477897015 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fbdf8071930 0x7fbdf8146aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.802 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdfe661640 1 -- 172.21.15.62:0/477897015 >> 172.21.15.62:0/477897015 conn(0x7fbdf806cfc0 msgr2=0x7fbdf813cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:47.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdfe661640 1 -- 172.21.15.62:0/477897015 shutdown_connections 2023-05-15T16:40:47.803 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.771+0000 7fbdfe661640 1 -- 172.21.15.62:0/477897015 wait complete. 2023-05-15T16:40:47.803 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-05-15T16:40:47.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.915+0000 7fa66ef3c640 1 Processor -- start 2023-05-15T16:40:47.921 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.919+0000 7fa66ef3c640 1 -- start start 2023-05-15T16:40:47.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.919+0000 7fa66ef3c640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fa66814a8d0 0x7fa6681554e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.919+0000 7fa66ef3c640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa668149d30 con 0x7fa66806b050 2023-05-15T16:40:47.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.919+0000 7fa66ef3c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa66806b5e0 con 0x7fa6680bcd70 2023-05-15T16:40:47.922 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.919+0000 7fa66ef3c640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa66806b8c0 con 0x7fa66814a8d0 2023-05-15T16:40:47.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.919+0000 7fa667fff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fa66806b050 0x7fa66814a1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:39268/0 (socket says 172.21.15.62:39268) 2023-05-15T16:40:47.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.919+0000 7fa667fff640 1 -- 172.21.15.62:0/1868496799 learned_addr learned my addr 172.21.15.62:0/1868496799 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:40:47.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.919+0000 7fa66d4d9640 1 --2- 172.21.15.62:0/1868496799 >> v2:172.21.15.62:3300/0 conn(0x7fa66814a8d0 0x7fa6681554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.919+0000 7fa66d4d9640 1 -- 172.21.15.62:0/1868496799 >> v1:172.21.15.161:6789/0 conn(0x7fa6680bcd70 legacy=0x7fa6680badc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:40:47.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.919+0000 7fa66d4d9640 1 -- 172.21.15.62:0/1868496799 >> v1:172.21.15.62:6789/0 conn(0x7fa66806b050 legacy=0x7fa66814a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:47.923 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.919+0000 7fa66d4d9640 1 -- 172.21.15.62:0/1868496799 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa66806bba0 con 0x7fa66814a8d0 2023-05-15T16:40:47.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.919+0000 7fa66d4d9640 1 --2- 172.21.15.62:0/1868496799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa66814a8d0 0x7fa6681554e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa660009dc0 tx=0x7fa66001c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=448134946b423ba5 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:47.924 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.919+0000 7fa6677fe640 1 -- 172.21.15.62:0/1868496799 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6600a58c0 con 0x7fa66814a8d0 2023-05-15T16:40:47.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.919+0000 7fa6677fe640 1 -- 172.21.15.62:0/1868496799 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6600a5a20 con 0x7fa66814a8d0 2023-05-15T16:40:47.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.919+0000 7fa6677fe640 1 -- 172.21.15.62:0/1868496799 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6600a5db0 con 0x7fa66814a8d0 2023-05-15T16:40:47.925 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66ef3c640 1 -- 172.21.15.62:0/1868496799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa66814a8d0 msgr2=0x7fa6681554e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:47.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66ef3c640 1 --2- 172.21.15.62:0/1868496799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa66814a8d0 0x7fa6681554e0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fa660009dc0 tx=0x7fa66001c8f0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66ef3c640 1 -- 172.21.15.62:0/1868496799 shutdown_connections 2023-05-15T16:40:47.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66ef3c640 1 --2- 172.21.15.62:0/1868496799 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa66814a8d0 0x7fa6681554e0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66ef3c640 1 -- 172.21.15.62:0/1868496799 >> 172.21.15.62:0/1868496799 conn(0x7fa6680bff80 msgr2=0x7fa6680c0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:47.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66ef3c640 1 -- 172.21.15.62:0/1868496799 shutdown_connections 2023-05-15T16:40:47.926 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66ef3c640 1 -- 172.21.15.62:0/1868496799 wait complete. 2023-05-15T16:40:47.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66ef3c640 1 Processor -- start 2023-05-15T16:40:47.927 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66ef3c640 1 -- start start 2023-05-15T16:40:47.928 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66ef3c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa66806b050 0x7fa668143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66ef3c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6680bcd70 0x7fa668140cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66ef3c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa66814a8d0 0x7fa668141200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66ef3c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6680a4910 con 0x7fa66814a8d0 2023-05-15T16:40:47.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66ef3c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa668144270 con 0x7fa66806b050 2023-05-15T16:40:47.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66ef3c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6680a5d70 con 0x7fa6680bcd70 2023-05-15T16:40:47.929 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66d4d9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa66814a8d0 0x7fa668141200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66d4d9640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa66814a8d0 0x7fa668141200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:43984/0 (socket says 172.21.15.62:43984) 2023-05-15T16:40:47.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66d4d9640 1 -- 172.21.15.62:0/3258000476 learned_addr learned my addr 172.21.15.62:0/3258000476 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:40:47.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa667fff640 1 --2- 172.21.15.62:0/3258000476 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6680bcd70 0x7fa668140cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66ccd8640 1 --2- 172.21.15.62:0/3258000476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa66806b050 0x7fa668143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66d4d9640 1 -- 172.21.15.62:0/3258000476 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6680bcd70 msgr2=0x7fa668140cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:47.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66d4d9640 1 --2- 172.21.15.62:0/3258000476 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6680bcd70 0x7fa668140cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66d4d9640 1 -- 172.21.15.62:0/3258000476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa66806b050 msgr2=0x7fa668143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:47.930 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66d4d9640 1 --2- 172.21.15.62:0/3258000476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa66806b050 0x7fa668143d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:47.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66d4d9640 1 -- 172.21.15.62:0/3258000476 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa660009a70 con 0x7fa66814a8d0 2023-05-15T16:40:47.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66d4d9640 1 --2- 172.21.15.62:0/3258000476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa66814a8d0 0x7fa668141200 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa66001a520 tx=0x7fa660019690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:47.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa6657fa640 1 -- 172.21.15.62:0/3258000476 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6600ad9d0 con 0x7fa66814a8d0 2023-05-15T16:40:47.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa6657fa640 1 -- 172.21.15.62:0/3258000476 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6600adb30 con 0x7fa66814a8d0 2023-05-15T16:40:47.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66ef3c640 1 -- 172.21.15.62:0/3258000476 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6681587e0 con 0x7fa66814a8d0 2023-05-15T16:40:47.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa6657fa640 1 -- 172.21.15.62:0/3258000476 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6600b7410 con 0x7fa66814a8d0 2023-05-15T16:40:47.931 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.923+0000 7fa66ef3c640 1 -- 172.21.15.62:0/3258000476 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa668158650 con 0x7fa66814a8d0 2023-05-15T16:40:47.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.927+0000 7fa66ef3c640 1 -- 172.21.15.62:0/3258000476 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa668158970 con 0x7fa66814a8d0 2023-05-15T16:40:47.932 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.927+0000 7fa6657fa640 1 -- 172.21.15.62:0/3258000476 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fa6600b4050 con 0x7fa66814a8d0 2023-05-15T16:40:47.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.927+0000 7fa6657fa640 1 --2- 172.21.15.62:0/3258000476 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa654065380 0x7fa654067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:40:47.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.927+0000 7fa6657fa640 1 -- 172.21.15.62:0/3258000476 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fa66011d8b0 con 0x7fa66814a8d0 2023-05-15T16:40:47.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.927+0000 7fa66ccd8640 1 --2- 172.21.15.62:0/3258000476 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa654065380 0x7fa654067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:40:47.933 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.927+0000 7fa66ccd8640 1 --2- 172.21.15.62:0/3258000476 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa654065380 0x7fa654067830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa658004e30 tx=0x7fa658009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:40:47.936 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:47.931+0000 7fa6657fa640 1 -- 172.21.15.62:0/3258000476 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fa6600eb530 con 0x7fa66814a8d0 2023-05-15T16:40:48.122 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:48.119+0000 7fa66ef3c640 1 -- 172.21.15.62:0/3258000476 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa668158970 con 0x7fa66814a8d0 2023-05-15T16:40:48.123 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:48.119+0000 7fa6657fa640 1 -- 172.21.15.62:0/3258000476 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa6600b2020 con 0x7fa66814a8d0 2023-05-15T16:40:48.123 INFO:teuthology.orchestra.run.smithi062.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-05-15T16:40:48.126 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:48.123+0000 7fa66ef3c640 1 -- 172.21.15.62:0/3258000476 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa654065380 msgr2=0x7fa654067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:48.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:48.123+0000 7fa66ef3c640 1 --2- 172.21.15.62:0/3258000476 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa654065380 0x7fa654067830 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa658004e30 tx=0x7fa658009040 comp rx=0 tx=0).stop 2023-05-15T16:40:48.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:48.123+0000 7fa66ef3c640 1 -- 172.21.15.62:0/3258000476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa66814a8d0 msgr2=0x7fa668141200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:40:48.127 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:48.123+0000 7fa66ef3c640 1 --2- 172.21.15.62:0/3258000476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa66814a8d0 0x7fa668141200 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fa66001a520 tx=0x7fa660019690 comp rx=0 tx=0).stop 2023-05-15T16:40:48.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:48.123+0000 7fa66ef3c640 1 -- 172.21.15.62:0/3258000476 shutdown_connections 2023-05-15T16:40:48.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:48.123+0000 7fa66ef3c640 1 --2- 172.21.15.62:0/3258000476 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fa654065380 0x7fa654067830 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:48.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:48.123+0000 7fa66ef3c640 1 --2- 172.21.15.62:0/3258000476 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fa66814a8d0 0x7fa668141200 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:48.128 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:48.123+0000 7fa66ef3c640 1 --2- 172.21.15.62:0/3258000476 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fa6680bcd70 0x7fa668140cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:48.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:48.123+0000 7fa66ef3c640 1 --2- 172.21.15.62:0/3258000476 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fa66806b050 0x7fa668143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:40:48.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:48.123+0000 7fa66ef3c640 1 -- 172.21.15.62:0/3258000476 >> 172.21.15.62:0/3258000476 conn(0x7fa6680bff80 msgr2=0x7fa6681451c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:40:48.129 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:48.123+0000 7fa66ef3c640 1 -- 172.21.15.62:0/3258000476 shutdown_connections 2023-05-15T16:40:48.130 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:40:48.123+0000 7fa66ef3c640 1 -- 172.21.15.62:0/3258000476 wait complete. 2023-05-15T16:40:48.142 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-05-15T16:40:48.142 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-05-15T16:40:48.143 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi171.front.sepia.ceph.com 2023-05-15T16:40:48.143 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-05-15T16:40:48.143 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-05-15T16:40:48.143 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-05-15T16:40:48.144 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-05-15T16:40:48.144 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-05-15T16:40:48.144 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-15T16:40:48.145 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:48.145 DEBUG:teuthology.orchestra.run.smithi171:> ip addr 2023-05-15T16:40:48.155 INFO:teuthology.orchestra.run.smithi171.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-05-15T16:40:48.155 INFO:teuthology.orchestra.run.smithi171.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-05-15T16:40:48.155 INFO:teuthology.orchestra.run.smithi171.stdout: inet 127.0.0.1/8 scope host lo 2023-05-15T16:40:48.155 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2023-05-15T16:40:48.156 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 ::1/128 scope host 2023-05-15T16:40:48.156 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2023-05-15T16:40:48.156 INFO:teuthology.orchestra.run.smithi171.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-15T16:40:48.156 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a2 brd ff:ff:ff:ff:ff:ff 2023-05-15T16:40:48.156 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f0 2023-05-15T16:40:48.156 INFO:teuthology.orchestra.run.smithi171.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-15T16:40:48.157 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:d9:39:a3 brd ff:ff:ff:ff:ff:ff 2023-05-15T16:40:48.157 INFO:teuthology.orchestra.run.smithi171.stdout: altname enp7s0f1 2023-05-15T16:40:48.157 INFO:teuthology.orchestra.run.smithi171.stdout:4: enp3s0f0: mtu 1500 qdisc noop state DOWN group default qlen 1000 2023-05-15T16:40:48.157 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6c brd ff:ff:ff:ff:ff:ff 2023-05-15T16:40:48.157 INFO:teuthology.orchestra.run.smithi171.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-05-15T16:40:48.158 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0c:c4:7a:88:6f:6d brd ff:ff:ff:ff:ff:ff 2023-05-15T16:40:48.158 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.21.15.171/20 metric 100 brd 172.21.15.255 scope global dynamic enp3s0f1 2023-05-15T16:40:48.158 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft 42018sec preferred_lft 42018sec 2023-05-15T16:40:48.158 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::ec4:7aff:fe88:6f6d/64 scope link 2023-05-15T16:40:48.158 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2023-05-15T16:40:48.158 INFO:teuthology.orchestra.run.smithi171.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2023-05-15T16:40:48.158 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 02:42:7a:d8:55:72 brd ff:ff:ff:ff:ff:ff 2023-05-15T16:40:48.159 INFO:teuthology.orchestra.run.smithi171.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2023-05-15T16:40:48.159 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2023-05-15T16:40:48.159 INFO:teuthology.orchestra.run.smithi171.stdout:7: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-05-15T16:40:48.159 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 5e:1f:84:6d:79:ae brd ff:ff:ff:ff:ff:ff 2023-05-15T16:40:48.159 INFO:teuthology.orchestra.run.smithi171.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-05-15T16:40:48.159 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2023-05-15T16:40:48.159 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::5c1f:84ff:fe6d:79ae/64 scope link 2023-05-15T16:40:48.159 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2023-05-15T16:40:48.160 INFO:teuthology.orchestra.run.smithi171.stdout:8: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-05-15T16:40:48.160 INFO:teuthology.orchestra.run.smithi171.stdout: link/ether 0e:5c:f6:1f:82:2f brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-05-15T16:40:48.160 INFO:teuthology.orchestra.run.smithi171.stdout: inet6 fe80::c5c:f6ff:fe1f:822f/64 scope link 2023-05-15T16:40:48.160 INFO:teuthology.orchestra.run.smithi171.stdout: valid_lft forever preferred_lft forever 2023-05-15T16:40:48.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:48.161 DEBUG:teuthology.orchestra.run.smithi171:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-05-15T16:40:48.216 INFO:teuthology.orchestra.run.smithi171.stdout:1 2023-05-15T16:40:48.218 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:48.219 DEBUG:teuthology.orchestra.run.smithi171:> route 2023-05-15T16:40:48.275 INFO:teuthology.orchestra.run.smithi171.stdout:Kernel IP routing table 2023-05-15T16:40:48.276 INFO:teuthology.orchestra.run.smithi171.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-05-15T16:40:48.276 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 0 0 0 enp3s0f1 2023-05-15T16:40:48.276 INFO:teuthology.orchestra.run.smithi171.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-05-15T16:40:48.276 INFO:teuthology.orchestra.run.smithi171.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2023-05-15T16:40:48.277 INFO:teuthology.orchestra.run.smithi171.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-05-15T16:40:48.277 INFO:teuthology.orchestra.run.smithi171.stdout:ns1.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-15T16:40:48.277 INFO:teuthology.orchestra.run.smithi171.stdout:ns2.front.sepia 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-15T16:40:48.278 INFO:teuthology.orchestra.run.smithi171.stdout:_gateway 0.0.0.0 255.255.255.255 UH 100 0 0 enp3s0f1 2023-05-15T16:40:48.278 INFO:teuthology.orchestra.run.smithi171.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-05-15T16:40:48.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:48.279 DEBUG:teuthology.orchestra.run.smithi171:> (cd / && exec bash -c ' 2023-05-15T16:40:48.280 DEBUG:teuthology.orchestra.run.smithi171:> set -e 2023-05-15T16:40:48.281 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-05-15T16:40:48.282 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-05-15T16:40:48.282 DEBUG:teuthology.orchestra.run.smithi171:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-05-15T16:40:48.283 DEBUG:teuthology.orchestra.run.smithi171:> ') 2023-05-15T16:40:48.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:48.369 DEBUG:teuthology.orchestra.run.smithi171:> ip netns list 2023-05-15T16:40:48.377 INFO:teuthology.orchestra.run.smithi171.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-05-15T16:40:48.377 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-05-15T16:40:48.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:48.378 DEBUG:teuthology.orchestra.run.smithi171:> sudo ip link set brx.0 up 2023-05-15T16:40:48.441 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-15T16:40:48.441 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-05-15T16:40:48.489 INFO:teuthology.orchestra.run.smithi171.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-05-15T16:40:48.489 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-05-15T16:40:48.490 DEBUG:teuthology.orchestra.run.smithi171:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-05-15T16:40:48.537 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-05-15T16:40:48.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:48.538 DEBUG:teuthology.orchestra.run.smithi171:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-05-15T16:40:48.625 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-05-15T16:40:48.625 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-05-15T16:40:48.626 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2023-05-15T16:40:48.639 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-05-15T16:40:48.639 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-05-15T16:40:48.639 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2023-05-15T16:40:48.639 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.62:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-05-15T16:40:48.640 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-15T16:40:48.652 INFO:teuthology.orchestra.run.smithi171.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-05-15T16:40:48.652 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-05-15T16:40:48.652 INFO:teuthology.orchestra.run.smithi171.stdout:invalid new device string format 2023-05-15T16:40:48.653 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.62:3300,172.21.15.161:3300,172.21.15.161:3301" 2023-05-15T16:40:48.653 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: switching to using v1 address with old syntax 2023-05-15T16:40:48.653 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: resolved to: "172.21.15.62:6789,172.21.15.161:6789,172.21.15.161:6790" 2023-05-15T16:40:48.653 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.62:6789,172.21.15.161:6789,172.21.15.161:6790:/ 2023-05-15T16:40:48.653 INFO:teuthology.orchestra.run.smithi171.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=fed834dd-24d2-40f4-8361-7c8c5a9484de" will pass to kernel 2023-05-15T16:40:48.656 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-05-15T16:40:48.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:48.657 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-05-15T16:40:48.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:48.717 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-05-15T16:40:48.782 INFO:teuthology.orchestra.run.smithi171.stdout:client4828 2023-05-15T16:40:48.783 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2023-05-15T16:40:48.783 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/proc/self/mounts of=/dev/stdout 2023-05-15T16:40:48.837 DEBUG:teuthology.orchestra.run.smithi171:> mktemp -d --suffix=xfstests-dev 2023-05-15T16:40:48.886 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.KbTuA66fZfxfstests-dev 2023-05-15T16:40:48.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:48.887 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.KbTuA66fZfxfstests-dev) 2023-05-15T16:40:48.950 INFO:teuthology.orchestra.run.smithi171.stderr:Cloning into '/tmp/tmp.KbTuA66fZfxfstests-dev'... 2023-05-15T16:40:49.840 DEBUG:teuthology.orchestra.run.smithi171:> mktemp -d --suffix=xfsprogs-dev 2023-05-15T16:40:49.888 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.BkW72pdIBZxfsprogs-dev 2023-05-15T16:40:49.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:49.889 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfsprogs-dev.git --depth 1 /tmp/tmp.BkW72pdIBZxfsprogs-dev) 2023-05-15T16:40:49.950 INFO:teuthology.orchestra.run.smithi171.stderr:Cloning into '/tmp/tmp.BkW72pdIBZxfsprogs-dev'... 2023-05-15T16:40:50.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:50.508 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-05-15T16:40:50.570 DEBUG:teuthology.orchestra.run.smithi171:> mktemp -d --suffix=test 2023-05-15T16:40:50.620 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.PREJpBJ9rrtest 2023-05-15T16:40:50.621 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-05-15T16:40:50.621 DEBUG:teuthology.orchestra.run.smithi171:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-05-15T16:40:50.677 DEBUG:teuthology.orchestra.run.smithi171:> mktemp -d --suffix=scratch 2023-05-15T16:40:50.728 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.GAK2y7SAKoscratch 2023-05-15T16:40:50.728 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "ubuntu" and "22.04". 2023-05-15T16:40:50.729 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-get install -y xfslibs-dev uuid-dev libtool-bin e2fsprogs automake gcc libuuid1 quota attr libattr1-dev make libacl1-dev libaio-dev xfsprogs libgdbm-dev gawk fio dbench uuid-runtime python2 sqlite3 libinih-dev liburcu-dev libblkid-dev gettext libedit-dev libattr1-dev libdevmapper-dev libicu-dev pkg-config 2023-05-15T16:40:50.840 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2023-05-15T16:40:50.994 INFO:teuthology.orchestra.run.smithi171.stdout:Building dependency tree... 2023-05-15T16:40:50.994 INFO:teuthology.orchestra.run.smithi171.stdout:Reading state information... 2023-05-15T16:40:51.131 INFO:teuthology.orchestra.run.smithi171.stdout:attr is already the newest version (1:2.5.1-1build1). 2023-05-15T16:40:51.131 INFO:teuthology.orchestra.run.smithi171.stdout:automake is already the newest version (1:1.16.5-1.3). 2023-05-15T16:40:51.132 INFO:teuthology.orchestra.run.smithi171.stdout:gawk is already the newest version (1:5.1.0-1build3). 2023-05-15T16:40:51.132 INFO:teuthology.orchestra.run.smithi171.stdout:gcc is already the newest version (4:11.2.0-1ubuntu1). 2023-05-15T16:40:51.132 INFO:teuthology.orchestra.run.smithi171.stdout:gcc set to manually installed. 2023-05-15T16:40:51.132 INFO:teuthology.orchestra.run.smithi171.stdout:gettext is already the newest version (0.21-4ubuntu4). 2023-05-15T16:40:51.132 INFO:teuthology.orchestra.run.smithi171.stdout:libacl1-dev is already the newest version (2.3.1-1). 2023-05-15T16:40:51.132 INFO:teuthology.orchestra.run.smithi171.stdout:libaio-dev is already the newest version (0.3.112-13build1). 2023-05-15T16:40:51.133 INFO:teuthology.orchestra.run.smithi171.stdout:libattr1-dev is already the newest version (1:2.5.1-1build1). 2023-05-15T16:40:51.133 INFO:teuthology.orchestra.run.smithi171.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2023-05-15T16:40:51.133 INFO:teuthology.orchestra.run.smithi171.stdout:libuuid1 is already the newest version (2.37.2-4ubuntu3). 2023-05-15T16:40:51.133 INFO:teuthology.orchestra.run.smithi171.stdout:make is already the newest version (4.3-4.1build1). 2023-05-15T16:40:51.133 INFO:teuthology.orchestra.run.smithi171.stdout:make set to manually installed. 2023-05-15T16:40:51.133 INFO:teuthology.orchestra.run.smithi171.stdout:quota is already the newest version (4.06-1build2). 2023-05-15T16:40:51.133 INFO:teuthology.orchestra.run.smithi171.stdout:uuid-dev is already the newest version (2.37.2-4ubuntu3). 2023-05-15T16:40:51.134 INFO:teuthology.orchestra.run.smithi171.stdout:uuid-runtime is already the newest version (2.37.2-4ubuntu3). 2023-05-15T16:40:51.134 INFO:teuthology.orchestra.run.smithi171.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2023-05-15T16:40:51.134 INFO:teuthology.orchestra.run.smithi171.stdout:xfsprogs is already the newest version (5.13.0-1ubuntu2). 2023-05-15T16:40:51.134 INFO:teuthology.orchestra.run.smithi171.stdout:dbench is already the newest version (4.0-2build1). 2023-05-15T16:40:51.134 INFO:teuthology.orchestra.run.smithi171.stdout:python2 is already the newest version (2.7.18-3). 2023-05-15T16:40:51.134 INFO:teuthology.orchestra.run.smithi171.stdout:python2 set to manually installed. 2023-05-15T16:40:51.135 INFO:teuthology.orchestra.run.smithi171.stdout:e2fsprogs is already the newest version (1.46.5-2ubuntu1.1). 2023-05-15T16:40:51.135 INFO:teuthology.orchestra.run.smithi171.stdout:The following packages were automatically installed and are no longer required: 2023-05-15T16:40:51.135 INFO:teuthology.orchestra.run.smithi171.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libiscsi7 libpmemobj1 2023-05-15T16:40:51.135 INFO:teuthology.orchestra.run.smithi171.stdout: libpython2-dev libpython2.7 libpython2.7-dev linux-image-5.4.0-135-generic 2023-05-15T16:40:51.136 INFO:teuthology.orchestra.run.smithi171.stdout: linux-modules-5.4.0-135-generic python2-dev python2.7-dev 2023-05-15T16:40:51.136 INFO:teuthology.orchestra.run.smithi171.stdout:Use 'sudo apt autoremove' to remove them. 2023-05-15T16:40:51.136 INFO:teuthology.orchestra.run.smithi171.stdout:The following additional packages will be installed: 2023-05-15T16:40:51.136 INFO:teuthology.orchestra.run.smithi171.stdout: icu-devtools libbsd-dev libinireader0 libmd-dev libnss-systemd 2023-05-15T16:40:51.137 INFO:teuthology.orchestra.run.smithi171.stdout: libpam-systemd libpcre2-32-0 libpcre2-dev libpcre2-posix3 libpmemblk1 2023-05-15T16:40:51.137 INFO:teuthology.orchestra.run.smithi171.stdout: libselinux1-dev libsepol-dev libsystemd0 libudev-dev libudev1 systemd 2023-05-15T16:40:51.137 INFO:teuthology.orchestra.run.smithi171.stdout: systemd-sysv udev 2023-05-15T16:40:51.137 INFO:teuthology.orchestra.run.smithi171.stdout:Suggested packages: 2023-05-15T16:40:51.137 INFO:teuthology.orchestra.run.smithi171.stdout: gnuplot gfio python-scipy icu-doc sqlite3-doc systemd-container 2023-05-15T16:40:51.137 INFO:teuthology.orchestra.run.smithi171.stdout: libtss2-esys-3.0.2-0 libtss2-mu0 libtss2-rc0 2023-05-15T16:40:51.175 INFO:teuthology.orchestra.run.smithi171.stdout:The following NEW packages will be installed: 2023-05-15T16:40:51.175 INFO:teuthology.orchestra.run.smithi171.stdout: fio icu-devtools libblkid-dev libbsd-dev libdevmapper-dev libedit-dev 2023-05-15T16:40:51.175 INFO:teuthology.orchestra.run.smithi171.stdout: libgdbm-dev libicu-dev libinih-dev libinireader0 libmd-dev libpcre2-32-0 2023-05-15T16:40:51.176 INFO:teuthology.orchestra.run.smithi171.stdout: libpcre2-dev libpcre2-posix3 libpmemblk1 libselinux1-dev libsepol-dev 2023-05-15T16:40:51.176 INFO:teuthology.orchestra.run.smithi171.stdout: libudev-dev liburcu-dev pkg-config sqlite3 2023-05-15T16:40:51.177 INFO:teuthology.orchestra.run.smithi171.stdout:The following packages will be upgraded: 2023-05-15T16:40:51.182 INFO:teuthology.orchestra.run.smithi171.stdout: libnss-systemd libpam-systemd libsystemd0 libudev1 systemd systemd-sysv udev 2023-05-15T16:40:51.360 INFO:teuthology.orchestra.run.smithi171.stdout:7 upgraded, 21 newly installed, 0 to remove and 137 not upgraded. 2023-05-15T16:40:51.361 INFO:teuthology.orchestra.run.smithi171.stdout:Need to get 25.9 MB of archives. 2023-05-15T16:40:51.361 INFO:teuthology.orchestra.run.smithi171.stdout:After this operation, 67.5 MB of additional disk space will be used. 2023-05-15T16:40:51.361 INFO:teuthology.orchestra.run.smithi171.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libsystemd0 amd64 249.11-0ubuntu3.9 [318 kB] 2023-05-15T16:40:51.845 INFO:teuthology.orchestra.run.smithi171.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 systemd-sysv amd64 249.11-0ubuntu3.9 [10.5 kB] 2023-05-15T16:40:51.846 INFO:teuthology.orchestra.run.smithi171.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnss-systemd amd64 249.11-0ubuntu3.9 [133 kB] 2023-05-15T16:40:51.871 INFO:teuthology.orchestra.run.smithi171.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpam-systemd amd64 249.11-0ubuntu3.9 [203 kB] 2023-05-15T16:40:51.936 INFO:teuthology.orchestra.run.smithi171.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 systemd amd64 249.11-0ubuntu3.9 [4,581 kB] 2023-05-15T16:40:52.269 INFO:teuthology.orchestra.run.smithi171.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 udev amd64 249.11-0ubuntu3.9 [1,557 kB] 2023-05-15T16:40:52.314 INFO:teuthology.orchestra.run.smithi171.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libudev1 amd64 249.11-0ubuntu3.9 [77.1 kB] 2023-05-15T16:40:52.315 INFO:teuthology.orchestra.run.smithi171.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libpmemblk1 amd64 1.11.1-3build1 [65.6 kB] 2023-05-15T16:40:52.316 INFO:teuthology.orchestra.run.smithi171.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 fio amd64 3.28-1 [4,047 kB] 2023-05-15T16:40:52.420 INFO:teuthology.orchestra.run.smithi171.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 icu-devtools amd64 70.1-2 [197 kB] 2023-05-15T16:40:52.441 INFO:teuthology.orchestra.run.smithi171.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 libmd-dev amd64 1.0.4-1build1 [40.0 kB] 2023-05-15T16:40:52.607 INFO:teuthology.orchestra.run.smithi171.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libbsd-dev amd64 0.11.5-1 [168 kB] 2023-05-15T16:40:53.026 INFO:teuthology.orchestra.run.smithi171.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libudev-dev amd64 249.11-0ubuntu3.9 [20.7 kB] 2023-05-15T16:40:53.036 INFO:teuthology.orchestra.run.smithi171.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libsepol-dev amd64 3.3-1build1 [378 kB] 2023-05-15T16:40:53.185 INFO:teuthology.orchestra.run.smithi171.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-32-0 amd64 10.39-3ubuntu0.1 [194 kB] 2023-05-15T16:40:53.219 INFO:teuthology.orchestra.run.smithi171.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-posix3 amd64 10.39-3ubuntu0.1 [6,130 B] 2023-05-15T16:40:53.220 INFO:teuthology.orchestra.run.smithi171.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-dev amd64 10.39-3ubuntu0.1 [730 kB] 2023-05-15T16:40:53.311 INFO:teuthology.orchestra.run.smithi171.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 libselinux1-dev amd64 3.3-1build2 [158 kB] 2023-05-15T16:40:53.323 INFO:teuthology.orchestra.run.smithi171.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 libdevmapper-dev amd64 2:1.02.175-2.1ubuntu4 [36.6 kB] 2023-05-15T16:40:53.325 INFO:teuthology.orchestra.run.smithi171.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libedit-dev amd64 3.1-20210910-1build1 [118 kB] 2023-05-15T16:40:53.334 INFO:teuthology.orchestra.run.smithi171.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 libgdbm-dev amd64 1.23-1 [117 kB] 2023-05-15T16:40:53.341 INFO:teuthology.orchestra.run.smithi171.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 libicu-dev amd64 70.1-2 [11.6 MB] 2023-05-15T16:40:53.931 INFO:teuthology.orchestra.run.smithi171.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libinireader0 amd64 53-1ubuntu3 [9,636 B] 2023-05-15T16:40:54.015 INFO:teuthology.orchestra.run.smithi171.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 libinih-dev amd64 53-1ubuntu3 [20.6 kB] 2023-05-15T16:40:54.054 INFO:teuthology.orchestra.run.smithi171.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2023-05-15T16:40:54.179 INFO:teuthology.orchestra.run.smithi171.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 sqlite3 amd64 3.37.2-2ubuntu0.1 [768 kB] 2023-05-15T16:40:54.510 INFO:teuthology.orchestra.run.smithi171.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 libblkid-dev amd64 2.37.2-4ubuntu3 [185 kB] 2023-05-15T16:40:54.537 INFO:teuthology.orchestra.run.smithi171.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 liburcu-dev amd64 0.13.1-1 [125 kB] 2023-05-15T16:40:54.815 INFO:teuthology.orchestra.run.smithi171.stderr:debconf: unable to initialize frontend: Dialog 2023-05-15T16:40:54.817 INFO:teuthology.orchestra.run.smithi171.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-05-15T16:40:54.817 INFO:teuthology.orchestra.run.smithi171.stderr:debconf: falling back to frontend: Readline 2023-05-15T16:40:54.831 INFO:teuthology.orchestra.run.smithi171.stderr:debconf: unable to initialize frontend: Readline 2023-05-15T16:40:54.832 INFO:teuthology.orchestra.run.smithi171.stderr:debconf: (This frontend requires a controlling tty.) 2023-05-15T16:40:54.832 INFO:teuthology.orchestra.run.smithi171.stderr:debconf: falling back to frontend: Teletype 2023-05-15T16:40:54.837 INFO:teuthology.orchestra.run.smithi171.stderr:dpkg-preconfigure: unable to re-open stdin: 2023-05-15T16:40:54.877 INFO:teuthology.orchestra.run.smithi171.stdout:Fetched 25.9 MB in 3s (7,682 kB/s) 2023-05-15T16:40:55.119 INFO:teuthology.orchestra.run.smithi171.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142706 files and directories currently installed.) 2023-05-15T16:40:55.123 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../libsystemd0_249.11-0ubuntu3.9_amd64.deb ... 2023-05-15T16:40:55.306 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libsystemd0:amd64 (249.11-0ubuntu3.9) over (249.11-0ubuntu3.6) ... 2023-05-15T16:40:55.636 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:40:55.639 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:40:55.641 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:40:55.642 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libsystemd0:amd64 (249.11-0ubuntu3.9) ... 2023-05-15T16:40:56.012 INFO:teuthology.orchestra.run.smithi171.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142706 files and directories currently installed.) 2023-05-15T16:40:56.016 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../0-systemd-sysv_249.11-0ubuntu3.9_amd64.deb ... 2023-05-15T16:40:56.114 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking systemd-sysv (249.11-0ubuntu3.9) over (249.11-0ubuntu3.6) ... 2023-05-15T16:40:56.818 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../1-libnss-systemd_249.11-0ubuntu3.9_amd64.deb ... 2023-05-15T16:40:56.930 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libnss-systemd:amd64 (249.11-0ubuntu3.9) over (249.11-0ubuntu3.6) ... 2023-05-15T16:40:57.291 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../2-libpam-systemd_249.11-0ubuntu3.9_amd64.deb ... 2023-05-15T16:40:57.420 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libpam-systemd:amd64 (249.11-0ubuntu3.9) over (249.11-0ubuntu3.6) ... 2023-05-15T16:40:57.823 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../3-systemd_249.11-0ubuntu3.9_amd64.deb ... 2023-05-15T16:40:58.007 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking systemd (249.11-0ubuntu3.9) over (249.11-0ubuntu3.6) ... 2023-05-15T16:40:59.018 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../4-udev_249.11-0ubuntu3.9_amd64.deb ... 2023-05-15T16:40:59.206 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking udev (249.11-0ubuntu3.9) over (249.11-0ubuntu3.6) ... 2023-05-15T16:40:59.814 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../5-libudev1_249.11-0ubuntu3.9_amd64.deb ... 2023-05-15T16:40:59.960 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libudev1:amd64 (249.11-0ubuntu3.9) over (249.11-0ubuntu3.6) ... 2023-05-15T16:41:00.292 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libudev1:amd64 (249.11-0ubuntu3.9) ... 2023-05-15T16:41:00.672 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libpmemblk1:amd64. 2023-05-15T16:41:00.753 INFO:teuthology.orchestra.run.smithi171.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 142706 files and directories currently installed.) 2023-05-15T16:41:00.758 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../00-libpmemblk1_1.11.1-3build1_amd64.deb ... 2023-05-15T16:41:00.795 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libpmemblk1:amd64 (1.11.1-3build1) ... 2023-05-15T16:41:01.291 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package fio. 2023-05-15T16:41:01.305 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../01-fio_3.28-1_amd64.deb ... 2023-05-15T16:41:01.349 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking fio (3.28-1) ... 2023-05-15T16:41:01.746 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package icu-devtools. 2023-05-15T16:41:01.760 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../02-icu-devtools_70.1-2_amd64.deb ... 2023-05-15T16:41:01.788 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking icu-devtools (70.1-2) ... 2023-05-15T16:41:02.043 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libmd-dev:amd64. 2023-05-15T16:41:02.056 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../03-libmd-dev_1.0.4-1build1_amd64.deb ... 2023-05-15T16:41:02.093 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libmd-dev:amd64 (1.0.4-1build1) ... 2023-05-15T16:41:02.358 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libbsd-dev:amd64. 2023-05-15T16:41:02.371 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../04-libbsd-dev_0.11.5-1_amd64.deb ... 2023-05-15T16:41:02.408 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libbsd-dev:amd64 (0.11.5-1) ... 2023-05-15T16:41:02.724 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libudev-dev:amd64. 2023-05-15T16:41:02.737 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../05-libudev-dev_249.11-0ubuntu3.9_amd64.deb ... 2023-05-15T16:41:02.777 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libudev-dev:amd64 (249.11-0ubuntu3.9) ... 2023-05-15T16:41:03.039 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libsepol-dev:amd64. 2023-05-15T16:41:03.051 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../06-libsepol-dev_3.3-1build1_amd64.deb ... 2023-05-15T16:41:03.089 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libsepol-dev:amd64 (3.3-1build1) ... 2023-05-15T16:41:03.451 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libpcre2-32-0:amd64. 2023-05-15T16:41:03.464 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../07-libpcre2-32-0_10.39-3ubuntu0.1_amd64.deb ... 2023-05-15T16:41:03.501 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libpcre2-32-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-15T16:41:03.788 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libpcre2-posix3:amd64. 2023-05-15T16:41:03.801 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../08-libpcre2-posix3_10.39-3ubuntu0.1_amd64.deb ... 2023-05-15T16:41:03.830 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libpcre2-posix3:amd64 (10.39-3ubuntu0.1) ... 2023-05-15T16:41:04.074 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libpcre2-dev:amd64. 2023-05-15T16:41:04.087 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../09-libpcre2-dev_10.39-3ubuntu0.1_amd64.deb ... 2023-05-15T16:41:04.124 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libpcre2-dev:amd64 (10.39-3ubuntu0.1) ... 2023-05-15T16:41:04.473 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libselinux1-dev:amd64. 2023-05-15T16:41:04.486 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../10-libselinux1-dev_3.3-1build2_amd64.deb ... 2023-05-15T16:41:04.523 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libselinux1-dev:amd64 (3.3-1build2) ... 2023-05-15T16:41:04.858 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libdevmapper-dev:amd64. 2023-05-15T16:41:04.871 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../11-libdevmapper-dev_2%3a1.02.175-2.1ubuntu4_amd64.deb ... 2023-05-15T16:41:04.908 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libdevmapper-dev:amd64 (2:1.02.175-2.1ubuntu4) ... 2023-05-15T16:41:05.136 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libedit-dev:amd64. 2023-05-15T16:41:05.149 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../12-libedit-dev_3.1-20210910-1build1_amd64.deb ... 2023-05-15T16:41:05.178 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libedit-dev:amd64 (3.1-20210910-1build1) ... 2023-05-15T16:41:05.450 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libgdbm-dev:amd64. 2023-05-15T16:41:05.463 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../13-libgdbm-dev_1.23-1_amd64.deb ... 2023-05-15T16:41:05.506 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libgdbm-dev:amd64 (1.23-1) ... 2023-05-15T16:41:05.787 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libicu-dev:amd64. 2023-05-15T16:41:05.801 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../14-libicu-dev_70.1-2_amd64.deb ... 2023-05-15T16:41:05.829 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libicu-dev:amd64 (70.1-2) ... 2023-05-15T16:41:06.609 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libinireader0:amd64. 2023-05-15T16:41:06.623 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../15-libinireader0_53-1ubuntu3_amd64.deb ... 2023-05-15T16:41:06.668 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libinireader0:amd64 (53-1ubuntu3) ... 2023-05-15T16:41:06.887 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libinih-dev:amd64. 2023-05-15T16:41:06.901 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../16-libinih-dev_53-1ubuntu3_amd64.deb ... 2023-05-15T16:41:06.946 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libinih-dev:amd64 (53-1ubuntu3) ... 2023-05-15T16:41:07.257 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package pkg-config. 2023-05-15T16:41:07.272 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../17-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2023-05-15T16:41:07.325 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2023-05-15T16:41:07.586 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package sqlite3. 2023-05-15T16:41:07.601 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../18-sqlite3_3.37.2-2ubuntu0.1_amd64.deb ... 2023-05-15T16:41:07.645 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking sqlite3 (3.37.2-2ubuntu0.1) ... 2023-05-15T16:41:07.889 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libblkid-dev:amd64. 2023-05-15T16:41:07.903 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../19-libblkid-dev_2.37.2-4ubuntu3_amd64.deb ... 2023-05-15T16:41:07.948 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libblkid-dev:amd64 (2.37.2-4ubuntu3) ... 2023-05-15T16:41:08.209 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package liburcu-dev:amd64. 2023-05-15T16:41:08.224 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../20-liburcu-dev_0.13.1-1_amd64.deb ... 2023-05-15T16:41:08.268 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking liburcu-dev:amd64 (0.13.1-1) ... 2023-05-15T16:41:08.616 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up liburcu-dev:amd64 (0.13.1-1) ... 2023-05-15T16:41:08.726 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libblkid-dev:amd64 (2.37.2-4ubuntu3) ... 2023-05-15T16:41:08.858 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libinireader0:amd64 (53-1ubuntu3) ... 2023-05-15T16:41:08.986 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up systemd (249.11-0ubuntu3.9) ... 2023-05-15T16:41:10.578 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libpcre2-32-0:amd64 (10.39-3ubuntu0.1) ... 2023-05-15T16:41:10.704 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up udev (249.11-0ubuntu3.9) ... 2023-05-15T16:41:12.266 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up icu-devtools (70.1-2) ... 2023-05-15T16:41:12.367 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2023-05-15T16:41:12.603 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libudev-dev:amd64 (249.11-0ubuntu3.9) ... 2023-05-15T16:41:12.729 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libsepol-dev:amd64 (3.3-1build1) ... 2023-05-15T16:41:12.855 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libpmemblk1:amd64 (1.11.1-3build1) ... 2023-05-15T16:41:13.007 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libinih-dev:amd64 (53-1ubuntu3) ... 2023-05-15T16:41:13.141 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libpcre2-posix3:amd64 (10.39-3ubuntu0.1) ... 2023-05-15T16:41:13.242 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libmd-dev:amd64 (1.0.4-1build1) ... 2023-05-15T16:41:13.352 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libgdbm-dev:amd64 (1.23-1) ... 2023-05-15T16:41:13.480 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libicu-dev:amd64 (70.1-2) ... 2023-05-15T16:41:13.604 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libbsd-dev:amd64 (0.11.5-1) ... 2023-05-15T16:41:13.731 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up sqlite3 (3.37.2-2ubuntu0.1) ... 2023-05-15T16:41:13.857 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up systemd-sysv (249.11-0ubuntu3.9) ... 2023-05-15T16:41:13.983 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libpcre2-dev:amd64 (10.39-3ubuntu0.1) ... 2023-05-15T16:41:14.084 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libselinux1-dev:amd64 (3.3-1build2) ... 2023-05-15T16:41:14.185 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libnss-systemd:amd64 (249.11-0ubuntu3.9) ... 2023-05-15T16:41:14.312 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up fio (3.28-1) ... 2023-05-15T16:41:14.922 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libedit-dev:amd64 (3.1-20210910-1build1) ... 2023-05-15T16:41:15.048 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libdevmapper-dev:amd64 (2:1.02.175-2.1ubuntu4) ... 2023-05-15T16:41:15.183 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libpam-systemd:amd64 (249.11-0ubuntu3.9) ... 2023-05-15T16:41:15.389 INFO:teuthology.orchestra.run.smithi171.stdout:debconf: unable to initialize frontend: Dialog 2023-05-15T16:41:15.389 INFO:teuthology.orchestra.run.smithi171.stdout:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2023-05-15T16:41:15.389 INFO:teuthology.orchestra.run.smithi171.stdout:debconf: falling back to frontend: Readline 2023-05-15T16:41:15.678 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for initramfs-tools (0.140ubuntu13.1) ... 2023-05-15T16:41:15.774 INFO:teuthology.orchestra.run.smithi171.stdout:update-initramfs: Generating /boot/initrd.img-6.3.0-g7312ab6f53ec 2023-05-15T16:41:25.700 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:41:25.704 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:41:25.708 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:41:29.640 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2023-05-15T16:41:29.784 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for man-db (2.10.2-1) ... 2023-05-15T16:41:31.197 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2023-05-15T16:41:31.290 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for install-info (6.8-4build1) ... 2023-05-15T16:41:31.820 DEBUG:teuthology.orchestra.run.smithi171:> sudo useradd -m fsgqa 2023-05-15T16:41:31.838 INFO:teuthology.orchestra.run.smithi171.stderr:useradd: user 'fsgqa' already exists 2023-05-15T16:41:31.839 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-05-15T16:41:31.840 DEBUG:teuthology.orchestra.run.smithi171:> sudo groupadd fsgqa 2023-05-15T16:41:31.897 INFO:teuthology.orchestra.run.smithi171.stderr:groupadd: group 'fsgqa' already exists 2023-05-15T16:41:31.899 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-05-15T16:41:31.900 DEBUG:teuthology.orchestra.run.smithi171:> sudo useradd fsgqa2 2023-05-15T16:41:32.330 DEBUG:teuthology.orchestra.run.smithi171:> sudo useradd 123456-fsgqa 2023-05-15T16:41:32.726 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-05-15T16:41:32.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.855+0000 7fcfc21bd640 1 Processor -- start 2023-05-15T16:41:32.861 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.859+0000 7fcfc21bd640 1 -- start start 2023-05-15T16:41:32.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.859+0000 7fcfc21bd640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fcfbc0bd010 0x7fcfbc0ba940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:41:32.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.859+0000 7fcfc21bd640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7fcfbc0bbba0 0x7fcfbc06b100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:41:32.862 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.859+0000 7fcfc21bd640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfbc0bb710 con 0x7fcfbc143dc0 2023-05-15T16:41:32.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.859+0000 7fcfc21bd640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfbc0bae80 con 0x7fcfbc0bbba0 2023-05-15T16:41:32.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.859+0000 7fcfc21bd640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfbc0bc820 con 0x7fcfbc0bd010 2023-05-15T16:41:32.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.859+0000 7fcfbbfff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fcfbc143dc0 0x7fcfbc14d2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36250/0 (socket says 172.21.15.62:36250) 2023-05-15T16:41:32.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.859+0000 7fcfbbfff640 1 -- 172.21.15.62:0/3414474672 learned_addr learned my addr 172.21.15.62:0/3414474672 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:41:32.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.859+0000 7fcfbaffd640 1 --2- 172.21.15.62:0/3414474672 >> v2:172.21.15.62:3300/0 conn(0x7fcfbc0bbba0 0x7fcfbc06b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:41:32.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.859+0000 7fcfbb7fe640 1 --2- 172.21.15.62:0/3414474672 >> v2:172.21.15.161:3300/0 conn(0x7fcfbc0bd010 0x7fcfbc0ba940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:41:32.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.859+0000 7fcfba7fc640 1 -- 172.21.15.62:0/3414474672 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 701192199 0 0) 0x7fcfbc0bb710 con 0x7fcfbc143dc0 2023-05-15T16:41:32.863 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.859+0000 7fcfba7fc640 1 -- 172.21.15.62:0/3414474672 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfa4003530 con 0x7fcfbc143dc0 2023-05-15T16:41:32.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.859+0000 7fcfbaffd640 1 -- 172.21.15.62:0/3414474672 >> v2:172.21.15.161:3300/0 conn(0x7fcfbc0bd010 msgr2=0x7fcfbc0ba940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:41:32.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.859+0000 7fcfbaffd640 1 --2- 172.21.15.62:0/3414474672 >> v2:172.21.15.161:3300/0 conn(0x7fcfbc0bd010 0x7fcfbc0ba940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:41:32.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.859+0000 7fcfbaffd640 1 -- 172.21.15.62:0/3414474672 >> v1:172.21.15.62:6789/0 conn(0x7fcfbc143dc0 legacy=0x7fcfbc14d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:41:32.864 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.859+0000 7fcfbaffd640 1 -- 172.21.15.62:0/3414474672 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfbc06b640 con 0x7fcfbc0bbba0 2023-05-15T16:41:32.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.859+0000 7fcfbaffd640 1 --2- 172.21.15.62:0/3414474672 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfbc0bbba0 0x7fcfbc06b100 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0bfd50 tx=0x7fcfb001c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4a393e8abfc254f server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:41:32.866 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.859+0000 7fcfba7fc640 1 -- 172.21.15.62:0/3414474672 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb00ab600 con 0x7fcfbc0bbba0 2023-05-15T16:41:32.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.859+0000 7fcfba7fc640 1 -- 172.21.15.62:0/3414474672 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb00a7050 con 0x7fcfbc0bbba0 2023-05-15T16:41:32.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.859+0000 7fcfba7fc640 1 -- 172.21.15.62:0/3414474672 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb00ab980 con 0x7fcfbc0bbba0 2023-05-15T16:41:32.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfc21bd640 1 -- 172.21.15.62:0/3414474672 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfbc0bbba0 msgr2=0x7fcfbc06b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:41:32.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfc21bd640 1 --2- 172.21.15.62:0/3414474672 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfbc0bbba0 0x7fcfbc06b100 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc0bfd50 tx=0x7fcfb001c3a0 comp rx=0 tx=0).stop 2023-05-15T16:41:32.867 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfc21bd640 1 -- 172.21.15.62:0/3414474672 shutdown_connections 2023-05-15T16:41:32.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfc21bd640 1 --2- 172.21.15.62:0/3414474672 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfbc0bbba0 0x7fcfbc06b100 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:41:32.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfc21bd640 1 --2- 172.21.15.62:0/3414474672 >> v2:172.21.15.161:3300/0 conn(0x7fcfbc0bd010 0x7fcfbc0ba940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:41:32.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfc21bd640 1 -- 172.21.15.62:0/3414474672 >> 172.21.15.62:0/3414474672 conn(0x7fcfbc0bffc0 msgr2=0x7fcfbc0c03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:41:32.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfc21bd640 1 -- 172.21.15.62:0/3414474672 shutdown_connections 2023-05-15T16:41:32.868 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfc21bd640 1 -- 172.21.15.62:0/3414474672 wait complete. 2023-05-15T16:41:32.869 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfc21bd640 1 Processor -- start 2023-05-15T16:41:32.870 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfc21bd640 1 -- start start 2023-05-15T16:41:32.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfc21bd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfbc0bbba0 0x7fcfbc14a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:41:32.872 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfc21bd640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfbc0bd010 0x7fcfbc148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:41:32.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfc21bd640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfbc143dc0 0x7fcfbc149450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:41:32.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfc21bd640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc14ab80 con 0x7fcfbc143dc0 2023-05-15T16:41:32.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfc21bd640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc0b9490 con 0x7fcfbc0bd010 2023-05-15T16:41:32.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfc21bd640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfbc0b9d30 con 0x7fcfbc0bbba0 2023-05-15T16:41:32.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfbbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfbc143dc0 0x7fcfbc149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:41:32.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfbbfff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfbc143dc0 0x7fcfbc149450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49110/0 (socket says 172.21.15.62:49110) 2023-05-15T16:41:32.873 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfbbfff640 1 -- 172.21.15.62:0/480508213 learned_addr learned my addr 172.21.15.62:0/480508213 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:41:32.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfbaffd640 1 --2- 172.21.15.62:0/480508213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfbc0bd010 0x7fcfbc148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:41:32.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfbb7fe640 1 --2- 172.21.15.62:0/480508213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfbc0bbba0 0x7fcfbc14a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:41:32.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfbbfff640 1 -- 172.21.15.62:0/480508213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfbc0bbba0 msgr2=0x7fcfbc14a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:41:32.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfbbfff640 1 --2- 172.21.15.62:0/480508213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfbc0bbba0 0x7fcfbc14a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:41:32.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfbbfff640 1 -- 172.21.15.62:0/480508213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfbc0bd010 msgr2=0x7fcfbc148f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:41:32.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfbbfff640 1 --2- 172.21.15.62:0/480508213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfbc0bd010 0x7fcfbc148f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:41:32.874 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfbbfff640 1 -- 172.21.15.62:0/480508213 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb0009420 con 0x7fcfbc143dc0 2023-05-15T16:41:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfbaffd640 1 --2- 172.21.15.62:0/480508213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfbc0bd010 0x7fcfbc148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-15T16:41:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfbbfff640 1 --2- 172.21.15.62:0/480508213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfbc143dc0 0x7fcfbc149450 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcfb400c3f0 tx=0x7fcfb400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:41:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfa3fff640 1 -- 172.21.15.62:0/480508213 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4005cf0 con 0x7fcfbc143dc0 2023-05-15T16:41:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfa3fff640 1 -- 172.21.15.62:0/480508213 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb4005e50 con 0x7fcfbc143dc0 2023-05-15T16:41:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfc21bd640 1 -- 172.21.15.62:0/480508213 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfbc069b30 con 0x7fcfbc143dc0 2023-05-15T16:41:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfa3fff640 1 -- 172.21.15.62:0/480508213 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4007310 con 0x7fcfbc143dc0 2023-05-15T16:41:32.875 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.863+0000 7fcfc21bd640 1 -- 172.21.15.62:0/480508213 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfbc0bd3e0 con 0x7fcfbc143dc0 2023-05-15T16:41:32.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.867+0000 7fcfc21bd640 1 -- 172.21.15.62:0/480508213 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfbc069cc0 con 0x7fcfbc143dc0 2023-05-15T16:41:32.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.867+0000 7fcfa3fff640 1 -- 172.21.15.62:0/480508213 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fcfb4007470 con 0x7fcfbc143dc0 2023-05-15T16:41:32.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.867+0000 7fcfa3fff640 1 --2- 172.21.15.62:0/480508213 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcfa8065380 0x7fcfa8067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:41:32.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.867+0000 7fcfa3fff640 1 -- 172.21.15.62:0/480508213 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7fcfb4081df0 con 0x7fcfbc143dc0 2023-05-15T16:41:32.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.867+0000 7fcfbb7fe640 1 --2- 172.21.15.62:0/480508213 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcfa8065380 0x7fcfa8067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:41:32.876 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.867+0000 7fcfbb7fe640 1 --2- 172.21.15.62:0/480508213 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcfa8065380 0x7fcfa8067830 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcfac003fd0 tx=0x7fcfac0039a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:41:32.877 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:32.871+0000 7fcfa3fff640 1 -- 172.21.15.62:0/480508213 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fcfb404fbe0 con 0x7fcfbc143dc0 2023-05-15T16:41:33.078 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.075+0000 7fcfc21bd640 1 -- 172.21.15.62:0/480508213 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fcfbc067960 con 0x7fcfbc143dc0 2023-05-15T16:41:33.079 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.075+0000 7fcfa3fff640 1 -- 172.21.15.62:0/480508213 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7fcfb4017510 con 0x7fcfbc143dc0 2023-05-15T16:41:33.080 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:41:33.080 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":1,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","modified":"2023-05-15T16:38:57.083297Z","created":"2023-05-15T16:38:57.083297Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:3300","nonce":0},{"type":"v1","addr":"172.21.15.161:6789","nonce":0}]},"addr":"172.21.15.161:6789/0","public_addr":"172.21.15.161:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:3301","nonce":0},{"type":"v1","addr":"172.21.15.161:6790","nonce":0}]},"addr":"172.21.15.161:6790/0","public_addr":"172.21.15.161:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-05-15T16:41:33.081 INFO:teuthology.orchestra.run.smithi062.stderr:dumped monmap epoch 1 2023-05-15T16:41:33.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.079+0000 7fcfc21bd640 1 -- 172.21.15.62:0/480508213 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcfa8065380 msgr2=0x7fcfa8067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:41:33.081 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.079+0000 7fcfc21bd640 1 --2- 172.21.15.62:0/480508213 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcfa8065380 0x7fcfa8067830 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcfac003fd0 tx=0x7fcfac0039a0 comp rx=0 tx=0).stop 2023-05-15T16:41:33.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.079+0000 7fcfc21bd640 1 -- 172.21.15.62:0/480508213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfbc143dc0 msgr2=0x7fcfbc149450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:41:33.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.079+0000 7fcfc21bd640 1 --2- 172.21.15.62:0/480508213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfbc143dc0 0x7fcfbc149450 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fcfb400c3f0 tx=0x7fcfb400c8b0 comp rx=0 tx=0).stop 2023-05-15T16:41:33.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.079+0000 7fcfc21bd640 1 -- 172.21.15.62:0/480508213 shutdown_connections 2023-05-15T16:41:33.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.079+0000 7fcfc21bd640 1 --2- 172.21.15.62:0/480508213 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fcfa8065380 0x7fcfa8067830 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:41:33.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.079+0000 7fcfc21bd640 1 --2- 172.21.15.62:0/480508213 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fcfbc143dc0 0x7fcfbc149450 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:41:33.082 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.079+0000 7fcfc21bd640 1 --2- 172.21.15.62:0/480508213 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fcfbc0bd010 0x7fcfbc148f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:41:33.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.079+0000 7fcfc21bd640 1 --2- 172.21.15.62:0/480508213 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fcfbc0bbba0 0x7fcfbc14a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:41:33.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.079+0000 7fcfc21bd640 1 -- 172.21.15.62:0/480508213 >> 172.21.15.62:0/480508213 conn(0x7fcfbc0bffc0 msgr2=0x7fcfbc0a3070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:41:33.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.079+0000 7fcfc21bd640 1 -- 172.21.15.62:0/480508213 shutdown_connections 2023-05-15T16:41:33.083 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.079+0000 7fcfc21bd640 1 -- 172.21.15.62:0/480508213 wait complete. 2023-05-15T16:41:33.097 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-05-15T16:41:33.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.215+0000 7f662e11b640 1 Processor -- start 2023-05-15T16:41:33.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.215+0000 7f662e11b640 1 -- start start 2023-05-15T16:41:33.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.215+0000 7f662e11b640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6628069a10 0x7f66280b3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:41:33.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.215+0000 7f662e11b640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f66280b39b0 0x7f66281545a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:41:33.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.215+0000 7f662e11b640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66280718d0 con 0x7f66280b7570 2023-05-15T16:41:33.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.215+0000 7f662e11b640 1 -- --> v2:172.21.15.62:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66280b2a00 con 0x7f6628069a10 2023-05-15T16:41:33.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.215+0000 7f662e11b640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66280b2c70 con 0x7f66280b39b0 2023-05-15T16:41:33.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.219+0000 7f66277fe640 1 --2- >> v2:172.21.15.62:3300/0 conn(0x7f6628069a10 0x7f66280b3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:41:33.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.219+0000 7f661ffff640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7f66280b7570 0x7f6628146fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36264/0 (socket says 172.21.15.62:36264) 2023-05-15T16:41:33.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.219+0000 7f661ffff640 1 -- 172.21.15.62:0/2107294633 learned_addr learned my addr 172.21.15.62:0/2107294633 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:41:33.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.219+0000 7f6627fff640 1 --2- 172.21.15.62:0/2107294633 >> v2:172.21.15.161:3300/0 conn(0x7f66280b39b0 0x7f66281545a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:41:33.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.219+0000 7f66277fe640 1 -- 172.21.15.62:0/2107294633 >> v2:172.21.15.161:3300/0 conn(0x7f66280b39b0 msgr2=0x7f66281545a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:41:33.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.219+0000 7f66277fe640 1 --2- 172.21.15.62:0/2107294633 >> v2:172.21.15.161:3300/0 conn(0x7f66280b39b0 0x7f66281545a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:41:33.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.219+0000 7f66277fe640 1 -- 172.21.15.62:0/2107294633 >> v1:172.21.15.62:6789/0 conn(0x7f66280b7570 legacy=0x7f6628146fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:41:33.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.219+0000 7f66277fe640 1 -- 172.21.15.62:0/2107294633 --> v2:172.21.15.62:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66280b87b0 con 0x7f6628069a10 2023-05-15T16:41:33.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.219+0000 7f6627fff640 1 --2- 172.21.15.62:0/2107294633 >> v2:172.21.15.161:3300/0 conn(0x7f66280b39b0 0x7f66281545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:41:33.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.219+0000 7f66277fe640 1 --2- 172.21.15.62:0/2107294633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6628069a10 0x7f66280b3470 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f66280baa80 tx=0x7f661801c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f90e867c6d086718 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:41:33.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.219+0000 7f6626ffd640 1 -- 172.21.15.62:0/2107294633 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66180ab600 con 0x7f6628069a10 2023-05-15T16:41:33.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.219+0000 7f6626ffd640 1 -- 172.21.15.62:0/2107294633 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66180a7050 con 0x7f6628069a10 2023-05-15T16:41:33.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.219+0000 7f6626ffd640 1 -- 172.21.15.62:0/2107294633 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66180ab980 con 0x7f6628069a10 2023-05-15T16:41:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.219+0000 7f662e11b640 1 -- 172.21.15.62:0/2107294633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6628069a10 msgr2=0x7f66280b3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:41:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.219+0000 7f662e11b640 1 --2- 172.21.15.62:0/2107294633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6628069a10 0x7f66280b3470 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f66280baa80 tx=0x7f661801c460 comp rx=0 tx=0).stop 2023-05-15T16:41:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.219+0000 7f662e11b640 1 -- 172.21.15.62:0/2107294633 shutdown_connections 2023-05-15T16:41:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.219+0000 7f662e11b640 1 --2- 172.21.15.62:0/2107294633 >> v2:172.21.15.161:3300/0 conn(0x7f66280b39b0 0x7f66281545a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:41:33.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.219+0000 7f662e11b640 1 --2- 172.21.15.62:0/2107294633 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f6628069a10 0x7f66280b3470 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:41:33.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.219+0000 7f662e11b640 1 -- 172.21.15.62:0/2107294633 >> 172.21.15.62:0/2107294633 conn(0x7f662806cf80 msgr2=0x7f662806d350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:41:33.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.219+0000 7f662e11b640 1 -- 172.21.15.62:0/2107294633 shutdown_connections 2023-05-15T16:41:33.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.219+0000 7f662e11b640 1 -- 172.21.15.62:0/2107294633 wait complete. 2023-05-15T16:41:33.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f662e11b640 1 Processor -- start 2023-05-15T16:41:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f662e11b640 1 -- start start 2023-05-15T16:41:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f662e11b640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6628069a10 0x7f662809d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:41:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f662e11b640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66280b39b0 0x7f66281e3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:41:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f662e11b640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66280b7570 0x7f66281e3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:41:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f662e11b640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662809d540 con 0x7f66280b7570 2023-05-15T16:41:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f662e11b640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662809e8f0 con 0x7f6628069a10 2023-05-15T16:41:33.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f662e11b640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66280b6d40 con 0x7f66280b39b0 2023-05-15T16:41:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f6627fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66280b7570 0x7f66281e3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:41:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f6627fff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66280b7570 0x7f66281e3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:49142/0 (socket says 172.21.15.62:49142) 2023-05-15T16:41:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f6627fff640 1 -- 172.21.15.62:0/1704564012 learned_addr learned my addr 172.21.15.62:0/1704564012 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:41:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f66277fe640 1 --2- 172.21.15.62:0/1704564012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6628069a10 0x7f662809d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:41:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f661ffff640 1 --2- 172.21.15.62:0/1704564012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66280b39b0 0x7f66281e3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:41:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f6627fff640 1 -- 172.21.15.62:0/1704564012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66280b39b0 msgr2=0x7f66281e3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:41:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f6627fff640 1 --2- 172.21.15.62:0/1704564012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66280b39b0 0x7f66281e3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:41:33.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f6627fff640 1 -- 172.21.15.62:0/1704564012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6628069a10 msgr2=0x7f662809d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:41:33.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f6627fff640 1 --2- 172.21.15.62:0/1704564012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6628069a10 0x7f662809d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:41:33.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f6627fff640 1 -- 172.21.15.62:0/1704564012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6618009420 con 0x7f66280b7570 2023-05-15T16:41:33.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f6627fff640 1 --2- 172.21.15.62:0/1704564012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66280b7570 0x7f66281e3fd0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f662000cef0 tx=0x7f662000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:41:33.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f6624ff9640 1 -- 172.21.15.62:0/1704564012 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662000d840 con 0x7f66280b7570 2023-05-15T16:41:33.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f6624ff9640 1 -- 172.21.15.62:0/1704564012 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f662000d9c0 con 0x7f66280b7570 2023-05-15T16:41:33.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f662e11b640 1 -- 172.21.15.62:0/1704564012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66280b1a40 con 0x7f66280b7570 2023-05-15T16:41:33.230 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f6624ff9640 1 -- 172.21.15.62:0/1704564012 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f662000dd70 con 0x7f66280b7570 2023-05-15T16:41:33.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f662e11b640 1 -- 172.21.15.62:0/1704564012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6628069de0 con 0x7f66280b7570 2023-05-15T16:41:33.231 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.223+0000 7f662e11b640 1 -- 172.21.15.62:0/1704564012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66281476b0 con 0x7f66280b7570 2023-05-15T16:41:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.227+0000 7f6624ff9640 1 -- 172.21.15.62:0/1704564012 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f662001e3b0 con 0x7f66280b7570 2023-05-15T16:41:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.227+0000 7f6624ff9640 1 --2- 172.21.15.62:0/1704564012 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6608065380 0x7f6608067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:41:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.227+0000 7f6624ff9640 1 -- 172.21.15.62:0/1704564012 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 6062+0+0 (secure 0 0 0) 0x7f6620083670 con 0x7f66280b7570 2023-05-15T16:41:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.227+0000 7f66277fe640 1 --2- 172.21.15.62:0/1704564012 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6608065380 0x7f6608067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:41:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.227+0000 7f66277fe640 1 --2- 172.21.15.62:0/1704564012 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6608065380 0x7f6608067830 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f66180ad000 tx=0x7f6618008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:41:33.232 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.231+0000 7f6624ff9640 1 -- 172.21.15.62:0/1704564012 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f66200514c0 con 0x7f66280b7570 2023-05-15T16:41:33.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.439+0000 7f662e11b640 1 -- 172.21.15.62:0/1704564012 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f662804dbe0 con 0x7f66280b7570 2023-05-15T16:41:33.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.439+0000 7f6624ff9640 1 -- 172.21.15.62:0/1704564012 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7f6620054ae0 con 0x7f66280b7570 2023-05-15T16:41:33.445 INFO:teuthology.orchestra.run.smithi062.stdout:[client.admin] 2023-05-15T16:41:33.445 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAhYGJk1aNnFBAAZ/I0oN2lXWsDFvNv3rKzbQ== 2023-05-15T16:41:33.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.443+0000 7f662e11b640 1 -- 172.21.15.62:0/1704564012 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6608065380 msgr2=0x7f6608067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:41:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.443+0000 7f662e11b640 1 --2- 172.21.15.62:0/1704564012 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6608065380 0x7f6608067830 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f66180ad000 tx=0x7f6618008040 comp rx=0 tx=0).stop 2023-05-15T16:41:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.443+0000 7f662e11b640 1 -- 172.21.15.62:0/1704564012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66280b7570 msgr2=0x7f66281e3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:41:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.443+0000 7f662e11b640 1 --2- 172.21.15.62:0/1704564012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66280b7570 0x7f66281e3fd0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f662000cef0 tx=0x7f662000a710 comp rx=0 tx=0).stop 2023-05-15T16:41:33.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.443+0000 7f662e11b640 1 -- 172.21.15.62:0/1704564012 shutdown_connections 2023-05-15T16:41:33.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.443+0000 7f662e11b640 1 --2- 172.21.15.62:0/1704564012 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f6608065380 0x7f6608067830 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:41:33.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.443+0000 7f662e11b640 1 --2- 172.21.15.62:0/1704564012 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f66280b7570 0x7f66281e3fd0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:41:33.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.443+0000 7f662e11b640 1 --2- 172.21.15.62:0/1704564012 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f66280b39b0 0x7f66281e3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:41:33.448 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.443+0000 7f662e11b640 1 --2- 172.21.15.62:0/1704564012 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f6628069a10 0x7f662809d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:41:33.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.443+0000 7f662e11b640 1 -- 172.21.15.62:0/1704564012 >> 172.21.15.62:0/1704564012 conn(0x7f662806cf80 msgr2=0x7f66280baad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:41:33.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.443+0000 7f662e11b640 1 -- 172.21.15.62:0/1704564012 shutdown_connections 2023-05-15T16:41:33.449 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:41:33.443+0000 7f662e11b640 1 -- 172.21.15.62:0/1704564012 wait complete. 2023-05-15T16:41:33.464 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2023-05-15T16:41:33.465 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/tmp/tmp.KbTuA66fZfxfstests-dev/local.config 2023-05-15T16:41:33.483 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.62:6789:/test export TEST_DIR=/tmp/tmp.PREJpBJ9rrtest export SCRATCH_DEV=172.21.15.62:6789:/scratch export SCRATCH_MNT=/tmp/tmp.GAK2y7SAKoscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQAhYGJk1aNnFBAAZ/I0oN2lXWsDFvNv3rKzbQ==" 2023-05-15T16:41:33.483 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2023-05-15T16:41:33.484 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/tmp/tmp.KbTuA66fZfxfstests-dev/ceph.exclude 2023-05-15T16:41:33.546 DEBUG:teuthology.orchestra.run.smithi171:> (cd /tmp/tmp.KbTuA66fZfxfstests-dev && exec sudo make) 2023-05-15T16:41:33.615 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize -cfi 2023-05-15T16:41:33.927 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: putting auxiliary files in '.'. 2023-05-15T16:41:33.927 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: copying file './config.guess' 2023-05-15T16:41:33.935 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: copying file './config.sub' 2023-05-15T16:41:33.953 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: copying file './install-sh' 2023-05-15T16:41:33.963 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: copying file './ltmain.sh' 2023-05-15T16:41:34.002 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-05-15T16:41:34.002 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-05-15T16:41:34.019 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-05-15T16:41:34.029 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-05-15T16:41:34.039 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-05-15T16:41:34.048 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-05-15T16:41:34.057 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-05-15T16:41:34.059 INFO:teuthology.orchestra.run.smithi171.stdout:cp include/install-sh . 2023-05-15T16:41:34.060 INFO:teuthology.orchestra.run.smithi171.stdout:aclocal -I m4 2023-05-15T16:41:35.143 INFO:teuthology.orchestra.run.smithi171.stdout:autoheader 2023-05-15T16:41:35.493 INFO:teuthology.orchestra.run.smithi171.stdout:autoconf 2023-05-15T16:41:35.885 INFO:teuthology.orchestra.run.smithi171.stdout:./configure \ 2023-05-15T16:41:35.886 INFO:teuthology.orchestra.run.smithi171.stdout: --libexecdir=/usr/lib \ 2023-05-15T16:41:35.886 INFO:teuthology.orchestra.run.smithi171.stdout: --exec_prefix=/var/lib 2023-05-15T16:41:36.383 INFO:teuthology.orchestra.run.smithi171.stdout:checking build system type... x86_64-pc-linux-gnu 2023-05-15T16:41:36.383 INFO:teuthology.orchestra.run.smithi171.stdout:checking host system type... x86_64-pc-linux-gnu 2023-05-15T16:41:36.428 INFO:teuthology.orchestra.run.smithi171.stdout:checking how to print strings... printf 2023-05-15T16:41:36.429 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gcc... gcc 2023-05-15T16:41:36.680 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether the C compiler works... yes 2023-05-15T16:41:36.680 INFO:teuthology.orchestra.run.smithi171.stdout:checking for C compiler default output file name... a.out 2023-05-15T16:41:36.719 INFO:teuthology.orchestra.run.smithi171.stdout:checking for suffix of executables... 2023-05-15T16:41:36.877 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether we are cross compiling... no 2023-05-15T16:41:36.902 INFO:teuthology.orchestra.run.smithi171.stdout:checking for suffix of object files... o 2023-05-15T16:41:36.923 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether the compiler supports GNU C... yes 2023-05-15T16:41:36.945 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether gcc accepts -g... yes 2023-05-15T16:41:37.046 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gcc option to enable C11 features... none needed 2023-05-15T16:41:37.052 INFO:teuthology.orchestra.run.smithi171.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-05-15T16:41:37.057 INFO:teuthology.orchestra.run.smithi171.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-05-15T16:41:37.060 INFO:teuthology.orchestra.run.smithi171.stdout:checking for egrep... /usr/bin/grep -E 2023-05-15T16:41:37.062 INFO:teuthology.orchestra.run.smithi171.stdout:checking for fgrep... /usr/bin/grep -F 2023-05-15T16:41:37.069 INFO:teuthology.orchestra.run.smithi171.stdout:checking for ld used by gcc... /usr/bin/ld 2023-05-15T16:41:37.072 INFO:teuthology.orchestra.run.smithi171.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-05-15T16:41:37.083 INFO:teuthology.orchestra.run.smithi171.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-05-15T16:41:37.112 INFO:teuthology.orchestra.run.smithi171.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-05-15T16:41:37.112 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether ln -s works... yes 2023-05-15T16:41:37.121 INFO:teuthology.orchestra.run.smithi171.stdout:checking the maximum length of command line arguments... 1572864 2023-05-15T16:41:37.126 INFO:teuthology.orchestra.run.smithi171.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-05-15T16:41:37.127 INFO:teuthology.orchestra.run.smithi171.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-05-15T16:41:37.127 INFO:teuthology.orchestra.run.smithi171.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-05-15T16:41:37.127 INFO:teuthology.orchestra.run.smithi171.stdout:checking for objdump... objdump 2023-05-15T16:41:37.127 INFO:teuthology.orchestra.run.smithi171.stdout:checking how to recognize dependent libraries... pass_all 2023-05-15T16:41:37.128 INFO:teuthology.orchestra.run.smithi171.stdout:checking for dlltool... no 2023-05-15T16:41:37.129 INFO:teuthology.orchestra.run.smithi171.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-05-15T16:41:37.129 INFO:teuthology.orchestra.run.smithi171.stdout:checking for ar... ar 2023-05-15T16:41:37.166 INFO:teuthology.orchestra.run.smithi171.stdout:checking for archiver @FILE support... @ 2023-05-15T16:41:37.167 INFO:teuthology.orchestra.run.smithi171.stdout:checking for strip... strip 2023-05-15T16:41:37.167 INFO:teuthology.orchestra.run.smithi171.stdout:checking for ranlib... ranlib 2023-05-15T16:41:37.168 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gawk... gawk 2023-05-15T16:41:37.248 INFO:teuthology.orchestra.run.smithi171.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-05-15T16:41:37.251 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sysroot... no 2023-05-15T16:41:37.258 INFO:teuthology.orchestra.run.smithi171.stdout:checking for a working dd... /usr/bin/dd 2023-05-15T16:41:37.264 INFO:teuthology.orchestra.run.smithi171.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-05-15T16:41:37.282 INFO:teuthology.orchestra.run.smithi171.stdout:checking for mt... mt 2023-05-15T16:41:37.299 INFO:teuthology.orchestra.run.smithi171.stdout:checking if mt is a manifest tool... no 2023-05-15T16:41:37.333 INFO:teuthology.orchestra.run.smithi171.stdout:checking for stdio.h... yes 2023-05-15T16:41:37.373 INFO:teuthology.orchestra.run.smithi171.stdout:checking for stdlib.h... yes 2023-05-15T16:41:37.408 INFO:teuthology.orchestra.run.smithi171.stdout:checking for string.h... yes 2023-05-15T16:41:37.449 INFO:teuthology.orchestra.run.smithi171.stdout:checking for inttypes.h... yes 2023-05-15T16:41:37.480 INFO:teuthology.orchestra.run.smithi171.stdout:checking for stdint.h... yes 2023-05-15T16:41:37.511 INFO:teuthology.orchestra.run.smithi171.stdout:checking for strings.h... yes 2023-05-15T16:41:37.544 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/stat.h... yes 2023-05-15T16:41:37.575 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/types.h... yes 2023-05-15T16:41:37.626 INFO:teuthology.orchestra.run.smithi171.stdout:checking for unistd.h... yes 2023-05-15T16:41:37.663 INFO:teuthology.orchestra.run.smithi171.stdout:checking for dlfcn.h... yes 2023-05-15T16:41:37.668 INFO:teuthology.orchestra.run.smithi171.stdout:checking for objdir... .libs 2023-05-15T16:41:37.775 INFO:teuthology.orchestra.run.smithi171.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-05-15T16:41:37.775 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-05-15T16:41:37.800 INFO:teuthology.orchestra.run.smithi171.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-05-15T16:41:38.051 INFO:teuthology.orchestra.run.smithi171.stdout:checking if gcc static flag -static works... yes 2023-05-15T16:41:38.089 INFO:teuthology.orchestra.run.smithi171.stdout:checking if gcc supports -c -o file.o... yes 2023-05-15T16:41:38.089 INFO:teuthology.orchestra.run.smithi171.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-05-15T16:41:38.102 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-05-15T16:41:38.135 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether -lc should be explicitly linked in... no 2023-05-15T16:41:38.228 INFO:teuthology.orchestra.run.smithi171.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-05-15T16:41:38.228 INFO:teuthology.orchestra.run.smithi171.stdout:checking how to hardcode library paths into programs... immediate 2023-05-15T16:41:38.239 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether stripping libraries is possible... yes 2023-05-15T16:41:38.240 INFO:teuthology.orchestra.run.smithi171.stdout:checking if libtool supports shared libraries... yes 2023-05-15T16:41:38.240 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether to build shared libraries... yes 2023-05-15T16:41:38.240 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether to build static libraries... yes 2023-05-15T16:41:38.253 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gcc... (cached) gcc 2023-05-15T16:41:38.291 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-05-15T16:41:38.292 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether gcc accepts -g... (cached) yes 2023-05-15T16:41:38.292 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-05-15T16:41:38.292 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gmake... /usr/bin/gmake 2023-05-15T16:41:38.293 INFO:teuthology.orchestra.run.smithi171.stderr:./configure: line 12753: test: $(SHELL): binary operator expected 2023-05-15T16:41:38.294 INFO:teuthology.orchestra.run.smithi171.stdout:checking for tar... /bin/tar 2023-05-15T16:41:38.294 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gzip... /bin/gzip 2023-05-15T16:41:38.306 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether gcc -MM is supported... yes 2023-05-15T16:41:38.308 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sort... /bin/sort 2023-05-15T16:41:38.308 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether ln -s works... yes 2023-05-15T16:41:38.308 INFO:teuthology.orchestra.run.smithi171.stdout:checking for rpm... no 2023-05-15T16:41:38.345 INFO:teuthology.orchestra.run.smithi171.stdout:checking for assert.h... yes 2023-05-15T16:41:38.384 INFO:teuthology.orchestra.run.smithi171.stdout:checking for bstring.h... no 2023-05-15T16:41:38.420 INFO:teuthology.orchestra.run.smithi171.stdout:checking for libgen.h... yes 2023-05-15T16:41:38.500 INFO:teuthology.orchestra.run.smithi171.stdout:checking for dirent.h... yes 2023-05-15T16:41:38.579 INFO:teuthology.orchestra.run.smithi171.stdout:checking for errno.h... yes 2023-05-15T16:41:38.616 INFO:teuthology.orchestra.run.smithi171.stdout:checking for malloc.h... yes 2023-05-15T16:41:38.654 INFO:teuthology.orchestra.run.smithi171.stdout:checking for uuid.h... no 2023-05-15T16:41:38.705 INFO:teuthology.orchestra.run.smithi171.stdout:checking for uuid/uuid.h... yes 2023-05-15T16:41:38.745 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/uuid.h... no 2023-05-15T16:41:38.784 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/file.h... yes 2023-05-15T16:41:38.821 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/fcntl.h... yes 2023-05-15T16:41:38.860 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/syssgi.h... no 2023-05-15T16:41:38.916 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/param.h... yes 2023-05-15T16:41:38.916 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/stat.h... (cached) yes 2023-05-15T16:41:38.952 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/statvfs.h... yes 2023-05-15T16:41:38.987 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/time.h... yes 2023-05-15T16:41:39.031 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/ioctl.h... yes 2023-05-15T16:41:39.071 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/wait.h... yes 2023-05-15T16:41:39.071 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/types.h... (cached) yes 2023-05-15T16:41:39.071 INFO:teuthology.orchestra.run.smithi171.stdout:checking for strings.h... (cached) yes 2023-05-15T16:41:39.107 INFO:teuthology.orchestra.run.smithi171.stdout:checking for err.h... yes 2023-05-15T16:41:39.143 INFO:teuthology.orchestra.run.smithi171.stdout:checking for linux/falloc.h... yes 2023-05-15T16:41:39.182 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/fs/xfs_fsops.h... no 2023-05-15T16:41:39.221 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/fs/xfs_itable.h... no 2023-05-15T16:41:39.261 INFO:teuthology.orchestra.run.smithi171.stdout:checking for xfs/platform_defs.h... no 2023-05-15T16:41:39.300 INFO:teuthology.orchestra.run.smithi171.stdout:checking for btrfs/ioctl.h... no 2023-05-15T16:41:39.339 INFO:teuthology.orchestra.run.smithi171.stdout:checking for cifs/ioctl.h... no 2023-05-15T16:41:39.377 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/mman.h... yes 2023-05-15T16:41:39.398 INFO:teuthology.orchestra.run.smithi171.stdout:checking for xfs/xfs_log_format.h... no 2023-05-15T16:41:39.453 INFO:teuthology.orchestra.run.smithi171.stdout:checking for uuid_compare... no 2023-05-15T16:41:39.498 INFO:teuthology.orchestra.run.smithi171.stdout:checking for uuid_compare in -luuid... yes 2023-05-15T16:41:39.606 INFO:teuthology.orchestra.run.smithi171.stdout:checking for xfs/xfs.h... yes 2023-05-15T16:41:39.628 INFO:teuthology.orchestra.run.smithi171.stdout:checking for xfs/libxfs.h... no 2023-05-15T16:41:39.673 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2023-05-15T16:41:39.702 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether xlog_assign_lsn is declared... no 2023-05-15T16:41:39.747 INFO:teuthology.orchestra.run.smithi171.stdout:checking for xfs/xqm.h... yes 2023-05-15T16:41:39.817 INFO:teuthology.orchestra.run.smithi171.stdout:checking xfsctl from xfs/xfs.h... ok 2023-05-15T16:41:39.855 INFO:teuthology.orchestra.run.smithi171.stdout:checking for xfs/handle.h... yes 2023-05-15T16:41:39.915 INFO:teuthology.orchestra.run.smithi171.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-05-15T16:41:39.954 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/acl.h... yes 2023-05-15T16:41:39.996 INFO:teuthology.orchestra.run.smithi171.stdout:checking for acl/libacl.h... yes 2023-05-15T16:41:40.041 INFO:teuthology.orchestra.run.smithi171.stdout:checking for acl_init in -lacl... yes 2023-05-15T16:41:40.080 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gdbm-ndbm.h... no 2023-05-15T16:41:40.119 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gdbm/ndbm.h... no 2023-05-15T16:41:40.159 INFO:teuthology.orchestra.run.smithi171.stdout:checking for ndbm.h... no 2023-05-15T16:41:40.198 INFO:teuthology.orchestra.run.smithi171.stdout:checking for libaio.h... yes 2023-05-15T16:41:40.236 INFO:teuthology.orchestra.run.smithi171.stdout:checking for liburing.h... no 2023-05-15T16:41:40.275 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/capability.h... no 2023-05-15T16:41:40.313 INFO:teuthology.orchestra.run.smithi171.stdout:checking for linux/fiemap.h... yes 2023-05-15T16:41:40.360 INFO:teuthology.orchestra.run.smithi171.stdout:checking for fallocate... yes 2023-05-15T16:41:40.411 INFO:teuthology.orchestra.run.smithi171.stdout:checking for open_by_handle_at... yes 2023-05-15T16:41:40.450 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/prctl.h... yes 2023-05-15T16:41:40.487 INFO:teuthology.orchestra.run.smithi171.stdout:checking for linux/fs.h... yes 2023-05-15T16:41:40.526 INFO:teuthology.orchestra.run.smithi171.stdout:checking for btrfsutil.h... no 2023-05-15T16:41:40.580 INFO:teuthology.orchestra.run.smithi171.stdout:checking for copy_file_range... yes 2023-05-15T16:41:40.634 INFO:teuthology.orchestra.run.smithi171.stdout:checking for SEEK_DATA... yes 2023-05-15T16:41:40.707 INFO:teuthology.orchestra.run.smithi171.stdout:checking for BMV_OF_SHARED... yes 2023-05-15T16:41:40.759 INFO:teuthology.orchestra.run.smithi171.stdout:checking for nftw... yes 2023-05-15T16:41:40.810 INFO:teuthology.orchestra.run.smithi171.stdout:checking for RLIMIT_NOFILE... yes 2023-05-15T16:41:40.844 INFO:teuthology.orchestra.run.smithi171.stdout:checking for FIEXCHANGE_RANGE... no 2023-05-15T16:41:40.896 INFO:teuthology.orchestra.run.smithi171.stdout:checking for renameat2... yes 2023-05-15T16:41:40.943 INFO:teuthology.orchestra.run.smithi171.stdout:checking for reallocarray... yes 2023-05-15T16:41:40.990 INFO:teuthology.orchestra.run.smithi171.stdout:checking for struct mount_attr... yes 2023-05-15T16:41:41.048 INFO:teuthology.orchestra.run.smithi171.stdout:checking for struct btrfs_qgroup_limit... yes 2023-05-15T16:41:41.097 INFO:teuthology.orchestra.run.smithi171.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-05-15T16:41:41.145 INFO:teuthology.orchestra.run.smithi171.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-05-15T16:41:41.194 INFO:teuthology.orchestra.run.smithi171.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-05-15T16:41:41.243 INFO:teuthology.orchestra.run.smithi171.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-05-15T16:41:41.293 INFO:teuthology.orchestra.run.smithi171.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-05-15T16:41:41.341 INFO:teuthology.orchestra.run.smithi171.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-05-15T16:41:41.378 INFO:teuthology.orchestra.run.smithi171.stdout:checking for linux/btrfs.h... yes 2023-05-15T16:41:41.417 INFO:teuthology.orchestra.run.smithi171.stdout:checking for linux/btrfs_tree.h... yes 2023-05-15T16:41:41.443 INFO:teuthology.orchestra.run.smithi171.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-05-15T16:41:41.468 INFO:teuthology.orchestra.run.smithi171.stdout:configure: creating ./config.status 2023-05-15T16:41:42.191 INFO:teuthology.orchestra.run.smithi171.stdout:config.status: creating include/builddefs 2023-05-15T16:41:42.216 INFO:teuthology.orchestra.run.smithi171.stdout:config.status: creating include/config.h 2023-05-15T16:41:42.235 INFO:teuthology.orchestra.run.smithi171.stdout:config.status: executing libtool commands 2023-05-15T16:41:42.299 INFO:teuthology.orchestra.run.smithi171.stdout:Building include 2023-05-15T16:41:42.304 INFO:teuthology.orchestra.run.smithi171.stdout:Building lib 2023-05-15T16:41:42.309 INFO:teuthology.orchestra.run.smithi171.stdout: [LTDEP] 2023-05-15T16:41:42.500 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] dataascii.lo 2023-05-15T16:41:42.637 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] databin.lo 2023-05-15T16:41:42.817 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] datapid.lo 2023-05-15T16:41:42.946 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] file_lock.lo 2023-05-15T16:41:43.127 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] forker.lo 2023-05-15T16:41:43.288 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] pattern.lo 2023-05-15T16:41:43.423 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] open_flags.lo 2023-05-15T16:41:43.590 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] random_range.lo 2023-05-15T16:41:43.839 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] string_to_tokens.lo 2023-05-15T16:41:43.958 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] str_to_bytes.lo 2023-05-15T16:41:44.117 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] tlibio.lo 2023-05-15T16:41:44.392 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] write_log.lo 2023-05-15T16:41:44.472 INFO:teuthology.orchestra.run.smithi171.stderr:write_log.c: In function 'wlog_record_write': 2023-05-15T16:41:44.472 INFO:teuthology.orchestra.run.smithi171.stderr:write_log.c:205:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:41:44.473 INFO:teuthology.orchestra.run.smithi171.stderr: 205 | write(wfile->w_afd, wbuf, reclen); 2023-05-15T16:41:44.473 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:41:44.473 INFO:teuthology.orchestra.run.smithi171.stderr:write_log.c:209:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:41:44.473 INFO:teuthology.orchestra.run.smithi171.stderr: 209 | write(wfile->w_rfd, wbuf, reclen); 2023-05-15T16:41:44.474 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:41:44.660 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] random.lo 2023-05-15T16:41:44.780 INFO:teuthology.orchestra.run.smithi171.stdout: [LD] 2023-05-15T16:41:44.879 INFO:teuthology.orchestra.run.smithi171.stdout:Building ltp 2023-05-15T16:41:44.884 INFO:teuthology.orchestra.run.smithi171.stdout: [DEP] 2023-05-15T16:41:45.071 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] doio 2023-05-15T16:41:45.775 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fsstress 2023-05-15T16:41:47.255 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fsx 2023-05-15T16:41:48.034 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] growfiles 2023-05-15T16:41:48.588 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] iogen 2023-05-15T16:41:48.740 INFO:teuthology.orchestra.run.smithi171.stderr:iogen.c: In function 'main': 2023-05-15T16:41:48.740 INFO:teuthology.orchestra.run.smithi171.stderr:iogen.c:280:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:41:48.740 INFO:teuthology.orchestra.run.smithi171.stderr: 280 | write(outfd, (char *)&req, sizeof(req)); 2023-05-15T16:41:48.740 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:41:48.743 INFO:teuthology.orchestra.run.smithi171.stderr:iogen.c: In function 'parse_cmdline': 2023-05-15T16:41:48.743 INFO:teuthology.orchestra.run.smithi171.stderr:iogen.c:1535:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:41:48.744 INFO:teuthology.orchestra.run.smithi171.stderr: 1535 | getcwd(fptr->f_path, 2023-05-15T16:41:48.744 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:41:48.744 INFO:teuthology.orchestra.run.smithi171.stderr: 1536 | sizeof(fptr->f_path)-1); 2023-05-15T16:41:48.744 INFO:teuthology.orchestra.run.smithi171.stderr: | ~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:41:49.026 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] aio-stress 2023-05-15T16:41:49.175 INFO:teuthology.orchestra.run.smithi171.stderr:aio-stress.c: In function 'setup_shared_mem': 2023-05-15T16:41:49.176 INFO:teuthology.orchestra.run.smithi171.stderr:aio-stress.c:1013:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:41:49.176 INFO:teuthology.orchestra.run.smithi171.stderr: 1013 | ftruncate(fd, total_ram); 2023-05-15T16:41:49.176 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:41:49.486 INFO:teuthology.orchestra.run.smithi171.stdout:Building src 2023-05-15T16:41:49.494 INFO:teuthology.orchestra.run.smithi171.stdout: [DEP] 2023-05-15T16:41:51.783 INFO:teuthology.orchestra.run.smithi171.stdout: [DEP] 2023-05-15T16:41:51.828 INFO:teuthology.orchestra.run.smithi171.stdout: [DEP] 2023-05-15T16:41:51.842 INFO:teuthology.orchestra.run.smithi171.stdout: [DEP] 2023-05-15T16:41:52.161 INFO:teuthology.orchestra.run.smithi171.stdout: [DEP] 2023-05-15T16:41:52.194 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] dirstress 2023-05-15T16:41:52.470 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fill 2023-05-15T16:41:52.647 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fill2 2023-05-15T16:41:52.907 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] getpagesize 2023-05-15T16:41:53.066 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] holes 2023-05-15T16:41:53.295 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] lstat64 2023-05-15T16:41:53.506 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] nametest 2023-05-15T16:41:53.655 INFO:teuthology.orchestra.run.smithi171.stderr:nametest.c: In function 'main': 2023-05-15T16:41:53.656 INFO:teuthology.orchestra.run.smithi171.stderr:nametest.c:236:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:41:53.656 INFO:teuthology.orchestra.run.smithi171.stderr: 236 | write(1, "\n", 1); 2023-05-15T16:41:53.656 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-15T16:41:53.657 INFO:teuthology.orchestra.run.smithi171.stderr:nametest.c:238:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:41:53.657 INFO:teuthology.orchestra.run.smithi171.stderr: 238 | write(1, ".", 1); 2023-05-15T16:41:53.657 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-15T16:41:53.657 INFO:teuthology.orchestra.run.smithi171.stderr:nametest.c:288:33: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:41:53.657 INFO:teuthology.orchestra.run.smithi171.stderr: 288 | write(1, ".", 1); 2023-05-15T16:41:53.658 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-15T16:41:53.779 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] permname 2023-05-15T16:41:54.009 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] randholes 2023-05-15T16:41:54.290 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] runas 2023-05-15T16:41:54.495 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] truncfile 2023-05-15T16:41:54.704 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] usemem 2023-05-15T16:41:54.882 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] mmapcat 2023-05-15T16:41:55.013 INFO:teuthology.orchestra.run.smithi171.stderr:mmapcat.c: In function 'main': 2023-05-15T16:41:55.014 INFO:teuthology.orchestra.run.smithi171.stderr:mmapcat.c:29:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:41:55.014 INFO:teuthology.orchestra.run.smithi171.stderr: 29 | write(1,ptr2,ptr - ptr2); 2023-05-15T16:41:55.014 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:41:55.054 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] append_reader 2023-05-15T16:41:55.233 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] append_writer 2023-05-15T16:41:55.412 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] dirperf 2023-05-15T16:41:55.662 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] metaperf 2023-05-15T16:41:55.780 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:41:55.784 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:41:55.787 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:41:55.806 INFO:teuthology.orchestra.run.smithi171.stderr:metaperf.c: In function 'crfiles': 2023-05-15T16:41:55.807 INFO:teuthology.orchestra.run.smithi171.stderr:metaperf.c:166:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:41:55.807 INFO:teuthology.orchestra.run.smithi171.stderr: 166 | write(fd, buf, fsize); 2023-05-15T16:41:55.808 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:41:55.809 INFO:teuthology.orchestra.run.smithi171.stderr:metaperf.c: In function 't_linkun': 2023-05-15T16:41:55.809 INFO:teuthology.orchestra.run.smithi171.stderr:metaperf.c:454:25: warning: ignoring return value of 'link' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:41:55.810 INFO:teuthology.orchestra.run.smithi171.stderr: 454 | link("a", *fnp); 2023-05-15T16:41:55.810 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~ 2023-05-15T16:41:55.810 INFO:teuthology.orchestra.run.smithi171.stderr:metaperf.c: In function 't_chown': 2023-05-15T16:41:55.810 INFO:teuthology.orchestra.run.smithi171.stderr:metaperf.c:404:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:41:55.811 INFO:teuthology.orchestra.run.smithi171.stderr: 404 | chown(*fnp, 2, -1); 2023-05-15T16:41:55.811 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-05-15T16:41:55.811 INFO:teuthology.orchestra.run.smithi171.stderr:metaperf.c:406:33: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:41:55.812 INFO:teuthology.orchestra.run.smithi171.stderr: 406 | chown(*fnp, 1, -1); 2023-05-15T16:41:55.812 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-05-15T16:41:55.812 INFO:teuthology.orchestra.run.smithi171.stderr:metaperf.c: In function 'i_chown': 2023-05-15T16:41:55.812 INFO:teuthology.orchestra.run.smithi171.stderr:metaperf.c:291:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:41:55.813 INFO:teuthology.orchestra.run.smithi171.stderr: 291 | chown(*fnp, 1, -1); 2023-05-15T16:41:55.813 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-05-15T16:41:55.813 INFO:teuthology.orchestra.run.smithi171.stderr:metaperf.c: In function 'main': 2023-05-15T16:41:55.814 INFO:teuthology.orchestra.run.smithi171.stderr:metaperf.c:152:9: warning: ignoring return value of 'chdir' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:41:55.814 INFO:teuthology.orchestra.run.smithi171.stderr: 152 | chdir(".."); 2023-05-15T16:41:55.814 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~ 2023-05-15T16:41:55.978 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] devzero 2023-05-15T16:41:56.184 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] feature 2023-05-15T16:41:56.430 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] alloc 2023-05-15T16:41:56.580 INFO:teuthology.orchestra.run.smithi171.stderr:alloc.c: In function 'main': 2023-05-15T16:41:56.581 INFO:teuthology.orchestra.run.smithi171.stderr:alloc.c:247:17: warning: ignoring return value of 'mkstemp' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:41:56.581 INFO:teuthology.orchestra.run.smithi171.stderr: 247 | mkstemp(tmpfile); 2023-05-15T16:41:56.581 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-15T16:41:56.674 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fault 2023-05-15T16:41:56.865 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fstest 2023-05-15T16:41:57.133 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_access_root 2023-05-15T16:41:57.266 INFO:teuthology.orchestra.run.smithi171.stderr:t_access_root.c: In function 'main': 2023-05-15T16:41:57.267 INFO:teuthology.orchestra.run.smithi171.stderr:t_access_root.c:55:5: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:41:57.267 INFO:teuthology.orchestra.run.smithi171.stderr: 55 | system(cmd); 2023-05-15T16:41:57.267 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~ 2023-05-15T16:41:57.314 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] godown 2023-05-15T16:41:57.513 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] resvtest 2023-05-15T16:41:57.730 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] writemod 2023-05-15T16:41:57.902 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] writev_on_pagefault 2023-05-15T16:41:58.088 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] makeextents 2023-05-15T16:41:58.296 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] itrash 2023-05-15T16:41:58.475 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] rename 2023-05-15T16:41:58.635 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] multi_open_unlink 2023-05-15T16:41:58.830 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] unwritten_sync 2023-05-15T16:41:59.041 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] genhashnames 2023-05-15T16:41:59.254 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_holes 2023-05-15T16:41:59.427 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_mmap_writev 2023-05-15T16:41:59.603 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_truncate_cmtime 2023-05-15T16:41:59.788 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] dirhash_collide 2023-05-15T16:41:59.997 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_rename_overwrite 2023-05-15T16:42:00.161 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] holetest 2023-05-15T16:42:00.303 INFO:teuthology.orchestra.run.smithi171.stderr:holetest.c: In function 'pt_write_marker': 2023-05-15T16:42:00.303 INFO:teuthology.orchestra.run.smithi171.stderr:holetest.c:140:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:00.303 INFO:teuthology.orchestra.run.smithi171.stderr: 140 | pwrite(fd, &tid, sizeof(tid), i * page_size + pgoff); 2023-05-15T16:42:00.304 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:00.416 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_truncate_self 2023-05-15T16:42:00.581 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] af_unix 2023-05-15T16:42:00.770 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_mmap_stale_pmd 2023-05-15T16:42:00.906 INFO:teuthology.orchestra.run.smithi171.stderr:t_mmap_stale_pmd.c: In function 'main': 2023-05-15T16:42:00.906 INFO:teuthology.orchestra.run.smithi171.stderr:t_mmap_stale_pmd.c:42:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:00.907 INFO:teuthology.orchestra.run.smithi171.stderr: 42 | ftruncate(fd, 0); 2023-05-15T16:42:00.907 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-15T16:42:00.907 INFO:teuthology.orchestra.run.smithi171.stderr:t_mmap_stale_pmd.c:43:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:00.907 INFO:teuthology.orchestra.run.smithi171.stderr: 43 | ftruncate(fd, MiB(4)); 2023-05-15T16:42:00.907 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:00.907 INFO:teuthology.orchestra.run.smithi171.stderr:t_mmap_stale_pmd.c:55:9: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:00.907 INFO:teuthology.orchestra.run.smithi171.stderr: 55 | pwrite(fd, buffer, strlen(buffer), MiB(2)); 2023-05-15T16:42:00.908 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:00.950 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_mmap_cow_race 2023-05-15T16:42:01.090 INFO:teuthology.orchestra.run.smithi171.stderr:t_mmap_cow_race.c: In function 'main': 2023-05-15T16:42:01.091 INFO:teuthology.orchestra.run.smithi171.stderr:t_mmap_cow_race.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:01.091 INFO:teuthology.orchestra.run.smithi171.stderr: 61 | ftruncate(fd, 0); 2023-05-15T16:42:01.091 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-15T16:42:01.091 INFO:teuthology.orchestra.run.smithi171.stderr:t_mmap_cow_race.c:62:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:01.091 INFO:teuthology.orchestra.run.smithi171.stderr: 62 | ftruncate(fd, MiB(2)); 2023-05-15T16:42:01.091 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:01.144 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_mmap_fallocate 2023-05-15T16:42:01.320 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fsync-err 2023-05-15T16:42:01.535 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_mmap_write_ro 2023-05-15T16:42:01.716 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_ext4_dax_journal_corruption 2023-05-15T16:42:01.853 INFO:teuthology.orchestra.run.smithi171.stderr:t_ext4_dax_journal_corruption.c: In function 'main': 2023-05-15T16:42:01.853 INFO:teuthology.orchestra.run.smithi171.stderr:t_ext4_dax_journal_corruption.c:61:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:01.854 INFO:teuthology.orchestra.run.smithi171.stderr: 61 | ftruncate(fd, 0); 2023-05-15T16:42:01.854 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-15T16:42:01.904 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_ext4_dax_inline_corruption 2023-05-15T16:42:02.088 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_ofd_locks 2023-05-15T16:42:02.318 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_mmap_collision 2023-05-15T16:42:02.547 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] mmap-write-concurrent 2023-05-15T16:42:02.745 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_get_file_time 2023-05-15T16:42:02.916 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_create_short_dirs 2023-05-15T16:42:03.112 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_create_long_dirs 2023-05-15T16:42:03.303 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_enospc 2023-05-15T16:42:03.529 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_mmap_writev_overlap 2023-05-15T16:42:03.727 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] checkpoint_journal 2023-05-15T16:42:03.910 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] mmap-rw-fault 2023-05-15T16:42:04.116 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] allocstale 2023-05-15T16:42:04.314 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_mmap_cow_memory_failure 2023-05-15T16:42:04.514 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fake-dump-rootino 2023-05-15T16:42:04.690 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] dio-buf-fault 2023-05-15T16:42:04.871 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfsctl 2023-05-15T16:42:05.091 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] bstat 2023-05-15T16:42:05.450 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_mtab 2023-05-15T16:42:05.591 INFO:teuthology.orchestra.run.smithi171.stderr:t_mtab.c: In function 'update_mtab': 2023-05-15T16:42:05.592 INFO:teuthology.orchestra.run.smithi171.stderr:t_mtab.c:256:17: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:05.592 INFO:teuthology.orchestra.run.smithi171.stderr: 256 | chown (mounted_temp, sbuf.st_uid, sbuf.st_gid); 2023-05-15T16:42:05.592 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:05.669 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] getdevicesize 2023-05-15T16:42:05.839 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] preallo_rw_pattern_reader 2023-05-15T16:42:05.986 INFO:teuthology.orchestra.run.smithi171.stderr:In file included from preallo_rw_pattern_reader.c:2: 2023-05-15T16:42:05.986 INFO:teuthology.orchestra.run.smithi171.stderr:iopat.c: In function 'main': 2023-05-15T16:42:05.986 INFO:teuthology.orchestra.run.smithi171.stderr:iopat.c:38:4: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:05.986 INFO:teuthology.orchestra.run.smithi171.stderr: 38 | read(fd, &x, 1048576); 2023-05-15T16:42:05.987 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:06.027 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] preallo_rw_pattern_writer 2023-05-15T16:42:06.172 INFO:teuthology.orchestra.run.smithi171.stderr:In file included from preallo_rw_pattern_writer.c:2: 2023-05-15T16:42:06.173 INFO:teuthology.orchestra.run.smithi171.stderr:iopat.c: In function 'main': 2023-05-15T16:42:06.173 INFO:teuthology.orchestra.run.smithi171.stderr:iopat.c:34:4: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:06.173 INFO:teuthology.orchestra.run.smithi171.stderr: 34 | write(fd, &x, 1048576); 2023-05-15T16:42:06.173 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:06.213 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] ftrunc 2023-05-15T16:42:06.388 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] trunc 2023-05-15T16:42:06.582 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fs_perms 2023-05-15T16:42:06.721 INFO:teuthology.orchestra.run.smithi171.stderr:fs_perms.c: In function 'main': 2023-05-15T16:42:06.721 INFO:teuthology.orchestra.run.smithi171.stderr:fs_perms.c:54:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:06.721 INFO:teuthology.orchestra.run.smithi171.stderr: 54 | system("rm -f test.file"); 2023-05-15T16:42:06.721 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:06.721 INFO:teuthology.orchestra.run.smithi171.stderr:fs_perms.c: In function 'testsetup': 2023-05-15T16:42:06.722 INFO:teuthology.orchestra.run.smithi171.stderr:fs_perms.c:67:4: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:06.722 INFO:teuthology.orchestra.run.smithi171.stderr: 67 | system("cp testx.file test.file"); 2023-05-15T16:42:06.722 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:06.722 INFO:teuthology.orchestra.run.smithi171.stderr:fs_perms.c:69:4: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:06.722 INFO:teuthology.orchestra.run.smithi171.stderr: 69 | chown("test.file",cuserId,cgroupId); 2023-05-15T16:42:06.722 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:06.722 INFO:teuthology.orchestra.run.smithi171.stderr:fs_perms.c: In function 'testfperm': 2023-05-15T16:42:06.723 INFO:teuthology.orchestra.run.smithi171.stderr:fs_perms.c:123:5: warning: ignoring return value of 'seteuid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:06.723 INFO:teuthology.orchestra.run.smithi171.stderr: 123 | seteuid(0); 2023-05-15T16:42:06.723 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~ 2023-05-15T16:42:06.723 INFO:teuthology.orchestra.run.smithi171.stderr:fs_perms.c:124:5: warning: ignoring return value of 'setegid' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:06.723 INFO:teuthology.orchestra.run.smithi171.stderr: 124 | setegid(0); 2023-05-15T16:42:06.723 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~ 2023-05-15T16:42:06.773 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] testx 2023-05-15T16:42:06.925 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] looptest 2023-05-15T16:42:07.148 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] locktest 2023-05-15T16:42:07.487 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] unwritten_mmap 2023-05-15T16:42:07.679 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] bulkstat_unlink_test 2023-05-15T16:42:07.825 INFO:teuthology.orchestra.run.smithi171.stderr:bulkstat_unlink_test.c: In function 'main': 2023-05-15T16:42:07.825 INFO:teuthology.orchestra.run.smithi171.stderr:bulkstat_unlink_test.c:106:25: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:07.826 INFO:teuthology.orchestra.run.smithi171.stderr: 106 | write(fd[i], fname, sizeof(fname)); 2023-05-15T16:42:07.826 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:07.826 INFO:teuthology.orchestra.run.smithi171.stderr:bulkstat_unlink_test.c:178:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:07.826 INFO:teuthology.orchestra.run.smithi171.stderr: 178 | system(fname); 2023-05-15T16:42:07.826 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~ 2023-05-15T16:42:07.910 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] deduperace 2023-05-15T16:42:08.136 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] bulkstat_unlink_test_modified 2023-05-15T16:42:08.282 INFO:teuthology.orchestra.run.smithi171.stderr:bulkstat_unlink_test_modified.c: In function 'main': 2023-05-15T16:42:08.282 INFO:teuthology.orchestra.run.smithi171.stderr:bulkstat_unlink_test_modified.c:83:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.282 INFO:teuthology.orchestra.run.smithi171.stderr: 83 | write(fd, fname, sizeof(fname)); 2023-05-15T16:42:08.282 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.283 INFO:teuthology.orchestra.run.smithi171.stderr:bulkstat_unlink_test_modified.c:139:13: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.283 INFO:teuthology.orchestra.run.smithi171.stderr: 139 | write(fd, fname, sizeof(fname)); 2023-05-15T16:42:08.283 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.283 INFO:teuthology.orchestra.run.smithi171.stderr:bulkstat_unlink_test_modified.c:185:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.283 INFO:teuthology.orchestra.run.smithi171.stderr: 185 | system(fname); 2023-05-15T16:42:08.283 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~ 2023-05-15T16:42:08.362 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_dir_offset 2023-05-15T16:42:08.537 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_futimens 2023-05-15T16:42:08.702 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_immutable 2023-05-15T16:42:08.861 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c: In function 'create_test_area': 2023-05-15T16:42:08.862 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:2061:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.862 INFO:teuthology.orchestra.run.smithi171.stderr: 2061 | asprintf(&path, "%s/immutable.d", dir); 2023-05-15T16:42:08.862 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.862 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:2096:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.862 INFO:teuthology.orchestra.run.smithi171.stderr: 2096 | asprintf(&path, "%s/append-only.d", dir); 2023-05-15T16:42:08.863 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.863 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c: In function 'remove_test_area': 2023-05-15T16:42:08.864 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:2152:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.864 INFO:teuthology.orchestra.run.smithi171.stderr: 2152 | asprintf(&path, "%s/immutable.d", dir); 2023-05-15T16:42:08.864 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.864 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:2163:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.864 INFO:teuthology.orchestra.run.smithi171.stderr: 2163 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-05-15T16:42:08.864 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.865 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:2175:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.865 INFO:teuthology.orchestra.run.smithi171.stderr: 2175 | asprintf(&path, "%s/append-only.d", dir); 2023-05-15T16:42:08.865 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.865 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:2186:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.865 INFO:teuthology.orchestra.run.smithi171.stderr: 2186 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-05-15T16:42:08.865 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.865 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:2197:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.866 INFO:teuthology.orchestra.run.smithi171.stderr: 2197 | asprintf(&path, "%s/append-only.f", dir); 2023-05-15T16:42:08.866 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.866 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:2209:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.866 INFO:teuthology.orchestra.run.smithi171.stderr: 2209 | asprintf(&path, "%s/immutable.f", dir); 2023-05-15T16:42:08.866 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.866 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c: In function 'check_test_area': 2023-05-15T16:42:08.866 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1788:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.866 INFO:teuthology.orchestra.run.smithi171.stderr: 1788 | asprintf(&path, "%s/", dir); 2023-05-15T16:42:08.867 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.868 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1800:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.869 INFO:teuthology.orchestra.run.smithi171.stderr: 1800 | asprintf(&path, "%s/immutable.f", dir); 2023-05-15T16:42:08.869 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.869 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1812:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.869 INFO:teuthology.orchestra.run.smithi171.stderr: 1812 | asprintf(&path, "%s/append-only.f", dir); 2023-05-15T16:42:08.869 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.869 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1824:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.869 INFO:teuthology.orchestra.run.smithi171.stderr: 1824 | asprintf(&path, "%s/immutable.d", dir); 2023-05-15T16:42:08.870 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.870 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1837:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.870 INFO:teuthology.orchestra.run.smithi171.stderr: 1837 | asprintf(&path, "%s/append-only.d", dir); 2023-05-15T16:42:08.870 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.870 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1850:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.870 INFO:teuthology.orchestra.run.smithi171.stderr: 1850 | asprintf(&path, "%s/immutable.d/file", dir); 2023-05-15T16:42:08.870 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.871 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1862:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.871 INFO:teuthology.orchestra.run.smithi171.stderr: 1862 | asprintf(&path, "%s/append-only.d/file", dir); 2023-05-15T16:42:08.871 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.871 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1874:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.871 INFO:teuthology.orchestra.run.smithi171.stderr: 1874 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-05-15T16:42:08.871 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.871 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1887:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.871 INFO:teuthology.orchestra.run.smithi171.stderr: 1887 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-05-15T16:42:08.872 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.872 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c: In function 'test_immutable': 2023-05-15T16:42:08.872 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:151:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.872 INFO:teuthology.orchestra.run.smithi171.stderr: 151 | asprintf(&path, "%s/immutable.f", dir); 2023-05-15T16:42:08.872 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.872 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:381:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.872 INFO:teuthology.orchestra.run.smithi171.stderr: 381 | asprintf(&linkpath, "%s/immutable.f.hardlink", dir); 2023-05-15T16:42:08.873 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.873 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:408:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.873 INFO:teuthology.orchestra.run.smithi171.stderr: 408 | chown(path, 0, 0); 2023-05-15T16:42:08.873 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.873 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:485:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.873 INFO:teuthology.orchestra.run.smithi171.stderr: 485 | asprintf(&linkpath, "%s/immutable.f.newname", dir); 2023-05-15T16:42:08.873 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.873 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:532:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.874 INFO:teuthology.orchestra.run.smithi171.stderr: 532 | asprintf(&path, "%s/immutable.d/file", dir); 2023-05-15T16:42:08.874 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.874 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:553:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.874 INFO:teuthology.orchestra.run.smithi171.stderr: 553 | chown(path, 0, 0); 2023-05-15T16:42:08.874 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.874 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:556:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.874 INFO:teuthology.orchestra.run.smithi171.stderr: 556 | asprintf(&linkpath, "%s/immutable.d/file.link", dir); 2023-05-15T16:42:08.875 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.875 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:575:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.875 INFO:teuthology.orchestra.run.smithi171.stderr: 575 | asprintf(&linkpath, "%s/immutable.d/file.newname", dir); 2023-05-15T16:42:08.875 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.875 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:595:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.875 INFO:teuthology.orchestra.run.smithi171.stderr: 595 | asprintf(&path, "%s/immutable.d/newfile", dir); 2023-05-15T16:42:08.875 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.875 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:619:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.876 INFO:teuthology.orchestra.run.smithi171.stderr: 619 | asprintf(&path, "%s/immutable.d/newdir", dir); 2023-05-15T16:42:08.876 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.876 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:631:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.876 INFO:teuthology.orchestra.run.smithi171.stderr: 631 | asprintf(&path, "%s/immutable.d/dir/newfile-%d", dir, getuid()); 2023-05-15T16:42:08.876 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.876 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:653:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.876 INFO:teuthology.orchestra.run.smithi171.stderr: 653 | chown(path, 0, 0); 2023-05-15T16:42:08.877 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.877 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:657:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.877 INFO:teuthology.orchestra.run.smithi171.stderr: 657 | asprintf(&path, "%s/immutable.d/dir", dir); 2023-05-15T16:42:08.877 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.877 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:668:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.877 INFO:teuthology.orchestra.run.smithi171.stderr: 668 | asprintf(&path, "%s/immutable.d", dir); 2023-05-15T16:42:08.877 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.877 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:705:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.878 INFO:teuthology.orchestra.run.smithi171.stderr: 705 | chown(path, 0, 0); 2023-05-15T16:42:08.878 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.878 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:782:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.878 INFO:teuthology.orchestra.run.smithi171.stderr: 782 | asprintf(&path, "%s/empty-immutable.d", dir); 2023-05-15T16:42:08.878 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.880 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c: In function 'test_append': 2023-05-15T16:42:08.880 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:822:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.880 INFO:teuthology.orchestra.run.smithi171.stderr: 822 | asprintf(&path, "%s/append-only.f", dir); 2023-05-15T16:42:08.880 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.880 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1024:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.881 INFO:teuthology.orchestra.run.smithi171.stderr: 1024 | asprintf(&linkpath, "%s/append-only.f.hardlink", dir); 2023-05-15T16:42:08.881 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.881 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1051:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.881 INFO:teuthology.orchestra.run.smithi171.stderr: 1051 | chown(path, 0, 0); 2023-05-15T16:42:08.881 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.881 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1126:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.881 INFO:teuthology.orchestra.run.smithi171.stderr: 1126 | asprintf(&linkpath, "%s/append-only.f.newname", dir); 2023-05-15T16:42:08.882 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.882 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1495:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.882 INFO:teuthology.orchestra.run.smithi171.stderr: 1495 | asprintf(&path, "%s/append-only.d/file", dir); 2023-05-15T16:42:08.882 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.882 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1516:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.882 INFO:teuthology.orchestra.run.smithi171.stderr: 1516 | chown(path, 0, 0); 2023-05-15T16:42:08.882 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.882 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1519:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.883 INFO:teuthology.orchestra.run.smithi171.stderr: 1519 | asprintf(&linkpath, "%s/append-only.d/file.link-%d", dir, getuid()); 2023-05-15T16:42:08.883 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.883 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1529:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.883 INFO:teuthology.orchestra.run.smithi171.stderr: 1529 | asprintf(&linkpath, "%s/append-only.d/file.symlink-%d", dir, getuid()); 2023-05-15T16:42:08.883 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.883 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1539:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.883 INFO:teuthology.orchestra.run.smithi171.stderr: 1539 | asprintf(&linkpath, "%s/append-only.d/file.newname", dir); 2023-05-15T16:42:08.884 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.884 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1559:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.884 INFO:teuthology.orchestra.run.smithi171.stderr: 1559 | asprintf(&path, "%s/append-only.d/newfile-%d", dir, getuid()); 2023-05-15T16:42:08.884 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.884 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1573:11: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.884 INFO:teuthology.orchestra.run.smithi171.stderr: 1573 | asprintf(&path, "%s/append-only.d/newdev-%d", dir, getuid()); 2023-05-15T16:42:08.884 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.885 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1586:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.885 INFO:teuthology.orchestra.run.smithi171.stderr: 1586 | asprintf(&path, "%s/append-only.d/newdir-%d", dir, getuid()); 2023-05-15T16:42:08.885 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.885 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1596:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.885 INFO:teuthology.orchestra.run.smithi171.stderr: 1596 | asprintf(&path, "%s/append-only.d/newdir-%d/newfile-%d", dir, getuid(), getuid()); 2023-05-15T16:42:08.885 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.885 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1618:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.885 INFO:teuthology.orchestra.run.smithi171.stderr: 1618 | chown(path, 0, 0); 2023-05-15T16:42:08.886 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.886 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1622:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.886 INFO:teuthology.orchestra.run.smithi171.stderr: 1622 | asprintf(&path, "%s/append-only.d/dir/newfile-%d", dir, getuid()); 2023-05-15T16:42:08.886 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.886 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1644:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.886 INFO:teuthology.orchestra.run.smithi171.stderr: 1644 | chown(path, 0, 0); 2023-05-15T16:42:08.886 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.886 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1648:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.887 INFO:teuthology.orchestra.run.smithi171.stderr: 1648 | asprintf(&path, "%s/append-only.d/dir", dir); 2023-05-15T16:42:08.887 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.887 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1659:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.887 INFO:teuthology.orchestra.run.smithi171.stderr: 1659 | asprintf(&path, "%s/append-only.d", dir); 2023-05-15T16:42:08.887 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.887 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1692:16: warning: ignoring return value of 'chown' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.887 INFO:teuthology.orchestra.run.smithi171.stderr: 1692 | chown(path, 0, 0); 2023-05-15T16:42:08.888 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~ 2023-05-15T16:42:08.888 INFO:teuthology.orchestra.run.smithi171.stderr:t_immutable.c:1769:6: warning: ignoring return value of 'asprintf' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:08.888 INFO:teuthology.orchestra.run.smithi171.stderr: 1769 | asprintf(&path, "%s/empty-append-only.d", dir); 2023-05-15T16:42:08.888 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:09.419 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] stale_handle 2023-05-15T16:42:09.565 INFO:teuthology.orchestra.run.smithi171.stderr:stale_handle.c: In function 'main': 2023-05-15T16:42:09.565 INFO:teuthology.orchestra.run.smithi171.stderr:stale_handle.c:102:9: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:09.565 INFO:teuthology.orchestra.run.smithi171.stderr: 102 | system("echo 3 > /proc/sys/vm/drop_caches"); 2023-05-15T16:42:09.565 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:09.619 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] pwrite_mmap_blocked 2023-05-15T16:42:09.800 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_dir_offset2 2023-05-15T16:42:10.021 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] seek_sanity_test 2023-05-15T16:42:10.176 INFO:teuthology.orchestra.run.smithi171.stderr:seek_sanity_test.c: In function 'test18': 2023-05-15T16:42:10.176 INFO:teuthology.orchestra.run.smithi171.stderr:seek_sanity_test.c:460:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:10.176 INFO:teuthology.orchestra.run.smithi171.stderr: 460 | ftruncate(fd, 0); 2023-05-15T16:42:10.177 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-15T16:42:10.178 INFO:teuthology.orchestra.run.smithi171.stderr:seek_sanity_test.c: In function 'test_basic_support': 2023-05-15T16:42:10.178 INFO:teuthology.orchestra.run.smithi171.stderr:seek_sanity_test.c:1207:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:10.178 INFO:teuthology.orchestra.run.smithi171.stderr: 1207 | ftruncate(fd, 0); 2023-05-15T16:42:10.178 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-15T16:42:10.179 INFO:teuthology.orchestra.run.smithi171.stderr:seek_sanity_test.c:1256:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:10.179 INFO:teuthology.orchestra.run.smithi171.stderr: 1256 | ftruncate(fd, 0); 2023-05-15T16:42:10.179 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-15T16:42:10.180 INFO:teuthology.orchestra.run.smithi171.stderr:seek_sanity_test.c: In function 'get_io_sizes': 2023-05-15T16:42:10.180 INFO:teuthology.orchestra.run.smithi171.stderr:seek_sanity_test.c:88:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:10.180 INFO:teuthology.orchestra.run.smithi171.stderr: 88 | ftruncate(fd, 0); 2023-05-15T16:42:10.180 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-15T16:42:10.181 INFO:teuthology.orchestra.run.smithi171.stderr:seek_sanity_test.c:89:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:10.181 INFO:teuthology.orchestra.run.smithi171.stderr: 89 | pwrite(fd, "a", 1, offset); 2023-05-15T16:42:10.181 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:10.181 INFO:teuthology.orchestra.run.smithi171.stderr:seek_sanity_test.c:98:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:10.181 INFO:teuthology.orchestra.run.smithi171.stderr: 98 | ftruncate(fd, 0); 2023-05-15T16:42:10.181 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~ 2023-05-15T16:42:10.182 INFO:teuthology.orchestra.run.smithi171.stderr:seek_sanity_test.c:99:17: warning: ignoring return value of 'pwrite' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:10.182 INFO:teuthology.orchestra.run.smithi171.stderr: 99 | pwrite(fd, "a", 1, offset); 2023-05-15T16:42:10.182 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:10.488 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] seek_copy_test 2023-05-15T16:42:10.692 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_readdir_1 2023-05-15T16:42:10.827 INFO:teuthology.orchestra.run.smithi171.stderr:t_readdir_1.c: In function 'main': 2023-05-15T16:42:10.828 INFO:teuthology.orchestra.run.smithi171.stderr:t_readdir_1.c:30:25: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:10.828 INFO:teuthology.orchestra.run.smithi171.stderr: 30 | read(fd, buf, 100); 2023-05-15T16:42:10.828 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:10.867 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_readdir_2 2023-05-15T16:42:11.044 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fsync-tester 2023-05-15T16:42:11.181 INFO:teuthology.orchestra.run.smithi171.stderr:fsync-tester.c: In function 'main': 2023-05-15T16:42:11.182 INFO:teuthology.orchestra.run.smithi171.stderr:fsync-tester.c:391:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:11.182 INFO:teuthology.orchestra.run.smithi171.stderr: 391 | read(fd, &seed, sizeof(seed)); 2023-05-15T16:42:11.182 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:11.182 INFO:teuthology.orchestra.run.smithi171.stderr:fsync-tester.c:541:17: warning: ignoring return value of 'system' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:11.182 INFO:teuthology.orchestra.run.smithi171.stderr: 541 | system("reboot -fn"); 2023-05-15T16:42:11.183 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:11.183 INFO:teuthology.orchestra.run.smithi171.stderr:fsync-tester.c: In function 'drop_all_caches': 2023-05-15T16:42:11.183 INFO:teuthology.orchestra.run.smithi171.stderr:fsync-tester.c:90:9: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:11.183 INFO:teuthology.orchestra.run.smithi171.stderr: 90 | write(fd, value, sizeof(value)-1); 2023-05-15T16:42:11.183 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:11.328 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] nsexec 2023-05-15T16:42:11.537 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] cloner 2023-05-15T16:42:11.741 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] renameat2 2023-05-15T16:42:11.937 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_getcwd 2023-05-15T16:42:12.073 INFO:teuthology.orchestra.run.smithi171.stderr:t_getcwd.c: In function 'test_getcwd': 2023-05-15T16:42:12.074 INFO:teuthology.orchestra.run.smithi171.stderr:t_getcwd.c:21:17: warning: ignoring return value of 'getcwd' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:12.074 INFO:teuthology.orchestra.run.smithi171.stderr: 21 | getcwd(cur_cwd, BUF_SIZE); 2023-05-15T16:42:12.074 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:12.126 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] e4compact 2023-05-15T16:42:12.358 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] test-nextquota 2023-05-15T16:42:12.562 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] punch-alternating 2023-05-15T16:42:12.764 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] attr-list-by-handle-cursor-test 2023-05-15T16:42:12.961 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] listxattr 2023-05-15T16:42:13.131 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] dio-interleaved 2023-05-15T16:42:13.322 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_dir_type 2023-05-15T16:42:13.505 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] dio-invalidate-cache 2023-05-15T16:42:13.643 INFO:teuthology.orchestra.run.smithi171.stderr:dio-invalidate-cache.c: In function 'main': 2023-05-15T16:42:13.643 INFO:teuthology.orchestra.run.smithi171.stderr:dio-invalidate-cache.c:286:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:13.643 INFO:teuthology.orchestra.run.smithi171.stderr: 286 | write(fd, buf, blksz * nr_child); 2023-05-15T16:42:13.643 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:13.739 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] stat_test 2023-05-15T16:42:14.065 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_encrypted_d_revalidate 2023-05-15T16:42:14.261 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] attr_replace_test 2023-05-15T16:42:14.452 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] swapon 2023-05-15T16:42:14.645 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] mkswap 2023-05-15T16:42:14.823 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_attr_corruption 2023-05-15T16:42:15.001 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_open_tmpfiles 2023-05-15T16:42:15.209 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fscrypt-crypt-util 2023-05-15T16:42:15.874 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] bulkstat_null_ocount 2023-05-15T16:42:16.061 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] splice-test 2023-05-15T16:42:16.271 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] chprojid_fail 2023-05-15T16:42:16.465 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] detached_mounts_propagation 2023-05-15T16:42:16.681 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] ext4_resize 2023-05-15T16:42:16.858 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_readdir_3 2023-05-15T16:42:17.082 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] splice2pipe 2023-05-15T16:42:17.217 INFO:teuthology.orchestra.run.smithi171.stderr:splice2pipe.c: In function 'prepare_pipe': 2023-05-15T16:42:17.218 INFO:teuthology.orchestra.run.smithi171.stderr:splice2pipe.c:56:17: warning: ignoring return value of 'write' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:17.218 INFO:teuthology.orchestra.run.smithi171.stderr: 56 | write(p[1], buffer, n); 2023-05-15T16:42:17.218 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:17.218 INFO:teuthology.orchestra.run.smithi171.stderr:splice2pipe.c:64:17: warning: ignoring return value of 'read' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:17.218 INFO:teuthology.orchestra.run.smithi171.stderr: 64 | read(p[0], buffer, n); 2023-05-15T16:42:17.218 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:17.273 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] uuid_ioctl 2023-05-15T16:42:17.459 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fiemap-tester 2023-05-15T16:42:17.764 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_stripealign 2023-05-15T16:42:17.947 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] open_by_handle 2023-05-15T16:42:18.224 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] t_mmap_dio 2023-05-15T16:42:18.415 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfsfind 2023-05-15T16:42:18.641 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fssum 2023-05-15T16:42:19.112 INFO:teuthology.orchestra.run.smithi171.stdout:Building log-writes 2023-05-15T16:42:19.120 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] replay-log 2023-05-15T16:42:19.480 INFO:teuthology.orchestra.run.smithi171.stdout:Building perf 2023-05-15T16:42:19.486 INFO:teuthology.orchestra.run.smithi171.stdout:Building aio-dio-regress 2023-05-15T16:42:19.495 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] aiocp 2023-05-15T16:42:19.761 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] aio-dio-append-write-fallocate-race 2023-05-15T16:42:19.967 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] aio-dio-append-write-read-race 2023-05-15T16:42:20.180 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] aio-dio-cow-race 2023-05-15T16:42:20.370 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] aio-dio-cycle-write 2023-05-15T16:42:20.507 INFO:teuthology.orchestra.run.smithi171.stderr:aio-dio-cycle-write.c: In function 'init_test': 2023-05-15T16:42:20.508 INFO:teuthology.orchestra.run.smithi171.stderr:aio-dio-cycle-write.c:83:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:20.508 INFO:teuthology.orchestra.run.smithi171.stderr: 83 | ftruncate(fd, buf_size); 2023-05-15T16:42:20.508 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:20.596 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] aio-dio-eof-race 2023-05-15T16:42:20.816 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] aio-dio-extend-stat 2023-05-15T16:42:21.018 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] aio-dio-fcntl-race 2023-05-15T16:42:21.217 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] aio-dio-hole-filling-race 2023-05-15T16:42:21.403 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] aio-dio-invalidate-failure 2023-05-15T16:42:21.598 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] aio-dio-invalidate-readahead 2023-05-15T16:42:21.800 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] aiodio_sparse2 2023-05-15T16:42:21.936 INFO:teuthology.orchestra.run.smithi171.stderr:aiodio_sparse2.c: In function 'aiodio_sparse': 2023-05-15T16:42:21.936 INFO:teuthology.orchestra.run.smithi171.stderr:aiodio_sparse2.c:111:17: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:21.937 INFO:teuthology.orchestra.run.smithi171.stderr: 111 | ftruncate(fd, filesize); 2023-05-15T16:42:21.937 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:21.937 INFO:teuthology.orchestra.run.smithi171.stderr:aiodio_sparse2.c: In function 'dirty_freeblocks': 2023-05-15T16:42:21.937 INFO:teuthology.orchestra.run.smithi171.stderr:aiodio_sparse2.c:274:9: warning: ignoring return value of 'ftruncate' declared with attribute 'warn_unused_result' [-Wunused-result] 2023-05-15T16:42:21.937 INFO:teuthology.orchestra.run.smithi171.stderr: 274 | ftruncate(fd, size); 2023-05-15T16:42:21.938 INFO:teuthology.orchestra.run.smithi171.stderr: | ^~~~~~~~~~~~~~~~~~~ 2023-05-15T16:42:22.056 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] aio-dio-subblock-eof-read 2023-05-15T16:42:22.236 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] aio-dio-write-verify 2023-05-15T16:42:22.467 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-05-15T16:42:22.635 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-05-15T16:42:22.803 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] aio-last-ref-held-by-io 2023-05-15T16:42:23.015 INFO:teuthology.orchestra.run.smithi171.stdout:Building vfs 2023-05-15T16:42:23.023 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] vfstest 2023-05-15T16:42:25.337 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] mount-idmapped 2023-05-15T16:42:25.767 INFO:teuthology.orchestra.run.smithi171.stdout:Building m4 2023-05-15T16:42:25.773 INFO:teuthology.orchestra.run.smithi171.stdout:Building common 2023-05-15T16:42:25.779 INFO:teuthology.orchestra.run.smithi171.stdout:Building tests 2023-05-15T16:42:25.787 INFO:teuthology.orchestra.run.smithi171.stdout:Building btrfs 2023-05-15T16:42:25.796 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/btrfs/group.list 2023-05-15T16:42:25.837 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:42:25.840 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:42:25.843 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:42:25.913 INFO:teuthology.orchestra.run.smithi171.stdout:Building ceph 2023-05-15T16:42:25.921 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/ceph/group.list 2023-05-15T16:42:25.950 INFO:teuthology.orchestra.run.smithi171.stdout:Building cifs 2023-05-15T16:42:25.958 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/cifs/group.list 2023-05-15T16:42:25.983 INFO:teuthology.orchestra.run.smithi171.stdout:Building ext4 2023-05-15T16:42:25.991 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/ext4/group.list 2023-05-15T16:42:26.067 INFO:teuthology.orchestra.run.smithi171.stdout:Building f2fs 2023-05-15T16:42:26.075 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/f2fs/group.list 2023-05-15T16:42:26.109 INFO:teuthology.orchestra.run.smithi171.stdout:Building generic 2023-05-15T16:42:26.120 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/generic/group.list 2023-05-15T16:42:26.317 INFO:teuthology.orchestra.run.smithi171.stdout:Building nfs 2023-05-15T16:42:26.325 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/nfs/group.list 2023-05-15T16:42:26.353 INFO:teuthology.orchestra.run.smithi171.stdout:Building ocfs2 2023-05-15T16:42:26.361 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/ocfs2/group.list 2023-05-15T16:42:26.388 INFO:teuthology.orchestra.run.smithi171.stdout:Building overlay 2023-05-15T16:42:26.397 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/overlay/group.list 2023-05-15T16:42:26.474 INFO:teuthology.orchestra.run.smithi171.stdout:Building perf 2023-05-15T16:42:26.481 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/perf/group.list 2023-05-15T16:42:26.504 INFO:teuthology.orchestra.run.smithi171.stdout:Building selftest 2023-05-15T16:42:26.512 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/selftest/group.list 2023-05-15T16:42:26.537 INFO:teuthology.orchestra.run.smithi171.stdout:Building shared 2023-05-15T16:42:26.545 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/shared/group.list 2023-05-15T16:42:26.580 INFO:teuthology.orchestra.run.smithi171.stdout:Building tmpfs 2023-05-15T16:42:26.588 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/tmpfs/group.list 2023-05-15T16:42:26.614 INFO:teuthology.orchestra.run.smithi171.stdout:Building udf 2023-05-15T16:42:26.623 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/udf/group.list 2023-05-15T16:42:26.645 INFO:teuthology.orchestra.run.smithi171.stdout:Building xfs 2023-05-15T16:42:26.655 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/xfs/group.list 2023-05-15T16:42:26.857 DEBUG:teuthology.orchestra.run.smithi171:> (cd /tmp/tmp.KbTuA66fZfxfstests-dev && exec sudo make install) 2023-05-15T16:42:26.942 INFO:teuthology.orchestra.run.smithi171.stdout:Building include 2023-05-15T16:42:26.948 INFO:teuthology.orchestra.run.smithi171.stdout:Building lib 2023-05-15T16:42:26.954 INFO:teuthology.orchestra.run.smithi171.stdout:Building ltp 2023-05-15T16:42:26.961 INFO:teuthology.orchestra.run.smithi171.stdout:Building src 2023-05-15T16:42:27.012 INFO:teuthology.orchestra.run.smithi171.stdout:Building log-writes 2023-05-15T16:42:27.018 INFO:teuthology.orchestra.run.smithi171.stdout:Building perf 2023-05-15T16:42:27.024 INFO:teuthology.orchestra.run.smithi171.stdout:Building aio-dio-regress 2023-05-15T16:42:27.030 INFO:teuthology.orchestra.run.smithi171.stdout:Building vfs 2023-05-15T16:42:27.036 INFO:teuthology.orchestra.run.smithi171.stdout:Building m4 2023-05-15T16:42:27.042 INFO:teuthology.orchestra.run.smithi171.stdout:Building common 2023-05-15T16:42:27.048 INFO:teuthology.orchestra.run.smithi171.stdout:Building tests 2023-05-15T16:42:27.056 INFO:teuthology.orchestra.run.smithi171.stdout:Building btrfs 2023-05-15T16:42:27.065 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/btrfs/group.list 2023-05-15T16:42:27.179 INFO:teuthology.orchestra.run.smithi171.stdout:Building ceph 2023-05-15T16:42:27.187 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/ceph/group.list 2023-05-15T16:42:27.216 INFO:teuthology.orchestra.run.smithi171.stdout:Building cifs 2023-05-15T16:42:27.224 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/cifs/group.list 2023-05-15T16:42:27.249 INFO:teuthology.orchestra.run.smithi171.stdout:Building ext4 2023-05-15T16:42:27.257 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/ext4/group.list 2023-05-15T16:42:27.332 INFO:teuthology.orchestra.run.smithi171.stdout:Building f2fs 2023-05-15T16:42:27.340 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/f2fs/group.list 2023-05-15T16:42:27.374 INFO:teuthology.orchestra.run.smithi171.stdout:Building generic 2023-05-15T16:42:27.385 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/generic/group.list 2023-05-15T16:42:27.575 INFO:teuthology.orchestra.run.smithi171.stdout:Building nfs 2023-05-15T16:42:27.583 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/nfs/group.list 2023-05-15T16:42:27.612 INFO:teuthology.orchestra.run.smithi171.stdout:Building ocfs2 2023-05-15T16:42:27.620 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/ocfs2/group.list 2023-05-15T16:42:27.647 INFO:teuthology.orchestra.run.smithi171.stdout:Building overlay 2023-05-15T16:42:27.656 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/overlay/group.list 2023-05-15T16:42:27.732 INFO:teuthology.orchestra.run.smithi171.stdout:Building perf 2023-05-15T16:42:27.740 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/perf/group.list 2023-05-15T16:42:27.763 INFO:teuthology.orchestra.run.smithi171.stdout:Building selftest 2023-05-15T16:42:27.771 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/selftest/group.list 2023-05-15T16:42:27.797 INFO:teuthology.orchestra.run.smithi171.stdout:Building shared 2023-05-15T16:42:27.805 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/shared/group.list 2023-05-15T16:42:27.839 INFO:teuthology.orchestra.run.smithi171.stdout:Building tmpfs 2023-05-15T16:42:27.847 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/tmpfs/group.list 2023-05-15T16:42:27.874 INFO:teuthology.orchestra.run.smithi171.stdout:Building udf 2023-05-15T16:42:27.882 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/udf/group.list 2023-05-15T16:42:27.905 INFO:teuthology.orchestra.run.smithi171.stdout:Building xfs 2023-05-15T16:42:27.915 INFO:teuthology.orchestra.run.smithi171.stdout: [GROUP] /tmp/tmp.KbTuA66fZfxfstests-dev/tests/xfs/group.list 2023-05-15T16:42:28.108 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-05-15T16:42:28.112 INFO:teuthology.orchestra.run.smithi171.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-15T16:42:28.112 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-05-15T16:42:28.116 INFO:teuthology.orchestra.run.smithi171.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-15T16:42:28.116 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-05-15T16:42:28.120 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-05-15T16:42:28.138 INFO:teuthology.orchestra.run.smithi171.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-05-15T16:42:28.280 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-05-15T16:42:28.298 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-05-15T16:42:28.326 INFO:teuthology.orchestra.run.smithi171.stdout:Building log-writes 2023-05-15T16:42:28.332 INFO:teuthology.orchestra.run.smithi171.stdout:Building perf 2023-05-15T16:42:28.338 INFO:teuthology.orchestra.run.smithi171.stdout:Building aio-dio-regress 2023-05-15T16:42:28.344 INFO:teuthology.orchestra.run.smithi171.stdout:Building vfs 2023-05-15T16:42:28.349 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake -C log-writes install 2023-05-15T16:42:28.352 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-05-15T16:42:28.370 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-05-15T16:42:28.388 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake -C perf install 2023-05-15T16:42:28.393 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-05-15T16:42:28.410 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-05-15T16:42:28.453 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-05-15T16:42:28.457 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-05-15T16:42:28.475 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-05-15T16:42:28.574 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake -C vfs install 2023-05-15T16:42:28.577 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-05-15T16:42:28.595 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-05-15T16:42:28.619 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-05-15T16:42:28.637 INFO:teuthology.orchestra.run.smithi171.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle t_mmap_dio xfsfind fssum /var/lib/xfstests/src 2023-05-15T16:42:31.103 INFO:teuthology.orchestra.run.smithi171.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py /var/lib/xfstests/src 2023-05-15T16:42:31.280 INFO:teuthology.orchestra.run.smithi171.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-05-15T16:42:31.322 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-05-15T16:42:31.325 INFO:teuthology.orchestra.run.smithi171.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-15T16:42:31.326 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-05-15T16:42:31.329 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-05-15T16:42:31.347 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-05-15T16:42:31.592 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-05-15T16:42:31.595 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KbTuA66fZfxfstests-dev/tests/btrfs/ install 2023-05-15T16:42:31.600 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-05-15T16:42:31.618 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 290 291 299 /var/lib/xfstests/tests/btrfs 2023-05-15T16:42:33.085 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-05-15T16:42:33.104 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 290.out 291.out 299.out /var/lib/xfstests/tests/btrfs 2023-05-15T16:42:34.563 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KbTuA66fZfxfstests-dev/tests/ceph/ install 2023-05-15T16:42:34.567 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-05-15T16:42:34.585 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-05-15T16:42:34.623 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-05-15T16:42:34.641 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-05-15T16:42:34.679 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KbTuA66fZfxfstests-dev/tests/cifs/ install 2023-05-15T16:42:34.683 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-05-15T16:42:34.700 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-05-15T16:42:34.718 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-05-15T16:42:34.737 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-05-15T16:42:34.755 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KbTuA66fZfxfstests-dev/tests/ext4/ install 2023-05-15T16:42:34.759 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-05-15T16:42:34.776 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-05-15T16:42:35.128 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-05-15T16:42:35.146 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-05-15T16:42:35.515 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KbTuA66fZfxfstests-dev/tests/f2fs/ install 2023-05-15T16:42:35.518 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-05-15T16:42:35.536 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-05-15T16:42:35.559 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-05-15T16:42:35.577 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-05-15T16:42:35.600 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KbTuA66fZfxfstests-dev/tests/generic/ install 2023-05-15T16:42:35.607 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-05-15T16:42:35.625 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 /var/lib/xfstests/tests/generic 2023-05-15T16:42:39.298 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-05-15T16:42:39.316 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out /var/lib/xfstests/tests/generic 2023-05-15T16:42:43.019 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KbTuA66fZfxfstests-dev/tests/nfs/ install 2023-05-15T16:42:43.023 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-05-15T16:42:43.041 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-05-15T16:42:43.059 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-05-15T16:42:43.077 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-05-15T16:42:43.095 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KbTuA66fZfxfstests-dev/tests/ocfs2/ install 2023-05-15T16:42:43.098 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-05-15T16:42:43.116 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-05-15T16:42:43.134 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-05-15T16:42:43.152 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-05-15T16:42:43.170 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KbTuA66fZfxfstests-dev/tests/overlay/ install 2023-05-15T16:42:43.175 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-05-15T16:42:43.192 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-05-15T16:42:43.684 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-05-15T16:42:43.702 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-05-15T16:42:44.201 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KbTuA66fZfxfstests-dev/tests/perf/ install 2023-05-15T16:42:44.205 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-05-15T16:42:44.223 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-05-15T16:42:44.241 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-05-15T16:42:44.258 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-05-15T16:42:44.276 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KbTuA66fZfxfstests-dev/tests/selftest/ install 2023-05-15T16:42:44.280 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-05-15T16:42:44.298 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-05-15T16:42:44.341 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-05-15T16:42:44.359 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-05-15T16:42:44.402 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KbTuA66fZfxfstests-dev/tests/shared/ install 2023-05-15T16:42:44.406 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-05-15T16:42:44.424 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-05-15T16:42:44.451 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-05-15T16:42:44.469 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-05-15T16:42:44.497 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KbTuA66fZfxfstests-dev/tests/tmpfs/ install 2023-05-15T16:42:44.501 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-05-15T16:42:44.519 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-05-15T16:42:44.536 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-05-15T16:42:44.554 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-05-15T16:42:44.572 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KbTuA66fZfxfstests-dev/tests/udf/ install 2023-05-15T16:42:44.576 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-05-15T16:42:44.594 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-05-15T16:42:44.612 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-05-15T16:42:44.630 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-05-15T16:42:44.648 INFO:teuthology.orchestra.run.smithi171.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.KbTuA66fZfxfstests-dev/tests/xfs/ install 2023-05-15T16:42:44.655 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-05-15T16:42:44.673 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-05-15T16:42:48.134 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-05-15T16:42:48.152 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-05-15T16:42:51.658 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-05-15T16:42:51.676 INFO:teuthology.orchestra.run.smithi171.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-05-15T16:42:51.693 INFO:teuthology.orchestra.run.smithi171.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-05-15T16:42:51.711 INFO:teuthology.orchestra.run.smithi171.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-05-15T16:42:51.732 DEBUG:teuthology.orchestra.run.smithi171:> (cd /tmp/tmp.BkW72pdIBZxfsprogs-dev && exec sudo make) 2023-05-15T16:42:51.799 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize -c -i -f 2023-05-15T16:42:51.993 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: putting auxiliary files in AC_CONFIG_AUX_DIR, '.'. 2023-05-15T16:42:51.994 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: copying file './config.guess' 2023-05-15T16:42:52.002 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: copying file './config.sub' 2023-05-15T16:42:52.010 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: copying file './install-sh' 2023-05-15T16:42:52.019 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: copying file './ltmain.sh' 2023-05-15T16:42:52.056 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-05-15T16:42:52.056 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-05-15T16:42:52.066 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-05-15T16:42:52.075 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-05-15T16:42:52.084 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-05-15T16:42:52.093 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-05-15T16:42:52.103 INFO:teuthology.orchestra.run.smithi171.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-05-15T16:42:52.105 INFO:teuthology.orchestra.run.smithi171.stdout:cp include/install-sh . 2023-05-15T16:42:52.106 INFO:teuthology.orchestra.run.smithi171.stdout:aclocal -I m4 2023-05-15T16:42:53.107 INFO:teuthology.orchestra.run.smithi171.stdout:autoconf 2023-05-15T16:42:53.534 INFO:teuthology.orchestra.run.smithi171.stdout:./configure $LOCAL_CONFIGURE_OPTIONS 2023-05-15T16:42:53.669 INFO:teuthology.orchestra.run.smithi171.stdout:checking for a BSD-compatible install... /usr/bin/install -c 2023-05-15T16:42:53.734 INFO:teuthology.orchestra.run.smithi171.stdout:checking build system type... x86_64-pc-linux-gnu 2023-05-15T16:42:53.735 INFO:teuthology.orchestra.run.smithi171.stdout:checking host system type... x86_64-pc-linux-gnu 2023-05-15T16:42:53.764 INFO:teuthology.orchestra.run.smithi171.stdout:checking how to print strings... printf 2023-05-15T16:42:53.764 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gcc... gcc 2023-05-15T16:42:53.844 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether the C compiler works... yes 2023-05-15T16:42:53.844 INFO:teuthology.orchestra.run.smithi171.stdout:checking for C compiler default output file name... a.out 2023-05-15T16:42:53.883 INFO:teuthology.orchestra.run.smithi171.stdout:checking for suffix of executables... 2023-05-15T16:42:53.928 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether we are cross compiling... no 2023-05-15T16:42:53.954 INFO:teuthology.orchestra.run.smithi171.stdout:checking for suffix of object files... o 2023-05-15T16:42:53.975 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether the compiler supports GNU C... yes 2023-05-15T16:42:53.997 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether gcc accepts -g... yes 2023-05-15T16:42:54.047 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gcc option to enable C11 features... none needed 2023-05-15T16:42:54.052 INFO:teuthology.orchestra.run.smithi171.stdout:checking for a sed that does not truncate output... /usr/bin/sed 2023-05-15T16:42:54.057 INFO:teuthology.orchestra.run.smithi171.stdout:checking for grep that handles long lines and -e... /usr/bin/grep 2023-05-15T16:42:54.059 INFO:teuthology.orchestra.run.smithi171.stdout:checking for egrep... /usr/bin/grep -E 2023-05-15T16:42:54.062 INFO:teuthology.orchestra.run.smithi171.stdout:checking for fgrep... /usr/bin/grep -F 2023-05-15T16:42:54.068 INFO:teuthology.orchestra.run.smithi171.stdout:checking for ld used by gcc... /usr/bin/ld 2023-05-15T16:42:54.072 INFO:teuthology.orchestra.run.smithi171.stdout:checking if the linker (/usr/bin/ld) is GNU ld... yes 2023-05-15T16:42:54.076 INFO:teuthology.orchestra.run.smithi171.stdout:checking for BSD- or MS-compatible name lister (nm)... /usr/bin/nm -B 2023-05-15T16:42:54.103 INFO:teuthology.orchestra.run.smithi171.stdout:checking the name lister (/usr/bin/nm -B) interface... BSD nm 2023-05-15T16:42:54.103 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether ln -s works... yes 2023-05-15T16:42:54.110 INFO:teuthology.orchestra.run.smithi171.stdout:checking the maximum length of command line arguments... 1572864 2023-05-15T16:42:54.117 INFO:teuthology.orchestra.run.smithi171.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-05-15T16:42:54.117 INFO:teuthology.orchestra.run.smithi171.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-05-15T16:42:54.118 INFO:teuthology.orchestra.run.smithi171.stdout:checking for /usr/bin/ld option to reload object files... -r 2023-05-15T16:42:54.118 INFO:teuthology.orchestra.run.smithi171.stdout:checking for objdump... objdump 2023-05-15T16:42:54.118 INFO:teuthology.orchestra.run.smithi171.stdout:checking how to recognize dependent libraries... pass_all 2023-05-15T16:42:54.119 INFO:teuthology.orchestra.run.smithi171.stdout:checking for dlltool... no 2023-05-15T16:42:54.119 INFO:teuthology.orchestra.run.smithi171.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-05-15T16:42:54.119 INFO:teuthology.orchestra.run.smithi171.stdout:checking for ar... ar 2023-05-15T16:42:54.149 INFO:teuthology.orchestra.run.smithi171.stdout:checking for archiver @FILE support... @ 2023-05-15T16:42:54.149 INFO:teuthology.orchestra.run.smithi171.stdout:checking for strip... strip 2023-05-15T16:42:54.150 INFO:teuthology.orchestra.run.smithi171.stdout:checking for ranlib... ranlib 2023-05-15T16:42:54.150 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gawk... gawk 2023-05-15T16:42:54.232 INFO:teuthology.orchestra.run.smithi171.stdout:checking command to parse /usr/bin/nm -B output from gcc object... ok 2023-05-15T16:42:54.235 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sysroot... no 2023-05-15T16:42:54.241 INFO:teuthology.orchestra.run.smithi171.stdout:checking for a working dd... /usr/bin/dd 2023-05-15T16:42:54.248 INFO:teuthology.orchestra.run.smithi171.stdout:checking how to truncate binary pipes... /usr/bin/dd bs=4096 count=1 2023-05-15T16:42:54.266 INFO:teuthology.orchestra.run.smithi171.stdout:checking for mt... mt 2023-05-15T16:42:54.272 INFO:teuthology.orchestra.run.smithi171.stdout:checking if mt is a manifest tool... no 2023-05-15T16:42:54.297 INFO:teuthology.orchestra.run.smithi171.stdout:checking for stdio.h... yes 2023-05-15T16:42:54.325 INFO:teuthology.orchestra.run.smithi171.stdout:checking for stdlib.h... yes 2023-05-15T16:42:54.356 INFO:teuthology.orchestra.run.smithi171.stdout:checking for string.h... yes 2023-05-15T16:42:54.386 INFO:teuthology.orchestra.run.smithi171.stdout:checking for inttypes.h... yes 2023-05-15T16:42:54.418 INFO:teuthology.orchestra.run.smithi171.stdout:checking for stdint.h... yes 2023-05-15T16:42:54.448 INFO:teuthology.orchestra.run.smithi171.stdout:checking for strings.h... yes 2023-05-15T16:42:54.480 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/stat.h... yes 2023-05-15T16:42:54.511 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/types.h... yes 2023-05-15T16:42:54.546 INFO:teuthology.orchestra.run.smithi171.stdout:checking for unistd.h... yes 2023-05-15T16:42:54.581 INFO:teuthology.orchestra.run.smithi171.stdout:checking for dlfcn.h... yes 2023-05-15T16:42:54.587 INFO:teuthology.orchestra.run.smithi171.stdout:checking for objdir... .libs 2023-05-15T16:42:54.680 INFO:teuthology.orchestra.run.smithi171.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-05-15T16:42:54.680 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-05-15T16:42:54.705 INFO:teuthology.orchestra.run.smithi171.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-05-15T16:42:54.804 INFO:teuthology.orchestra.run.smithi171.stdout:checking if gcc static flag -static works... yes 2023-05-15T16:42:54.842 INFO:teuthology.orchestra.run.smithi171.stdout:checking if gcc supports -c -o file.o... yes 2023-05-15T16:42:54.842 INFO:teuthology.orchestra.run.smithi171.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-05-15T16:42:54.854 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether the gcc linker (/usr/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-05-15T16:42:54.888 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether -lc should be explicitly linked in... no 2023-05-15T16:42:54.965 INFO:teuthology.orchestra.run.smithi171.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-05-15T16:42:54.965 INFO:teuthology.orchestra.run.smithi171.stdout:checking how to hardcode library paths into programs... immediate 2023-05-15T16:42:54.967 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether stripping libraries is possible... yes 2023-05-15T16:42:54.967 INFO:teuthology.orchestra.run.smithi171.stdout:checking if libtool supports shared libraries... yes 2023-05-15T16:42:54.967 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether to build shared libraries... yes 2023-05-15T16:42:54.967 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether to build static libraries... yes 2023-05-15T16:42:54.968 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gcc... (cached) gcc 2023-05-15T16:42:55.006 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-05-15T16:42:55.006 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether gcc accepts -g... (cached) yes 2023-05-15T16:42:55.006 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-05-15T16:42:55.019 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gcc... (cached) gcc 2023-05-15T16:42:55.057 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-05-15T16:42:55.057 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether gcc accepts -g... (cached) yes 2023-05-15T16:42:55.058 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-05-15T16:42:55.065 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gcc... (cached) gcc 2023-05-15T16:42:55.103 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether the compiler supports GNU C... (cached) yes 2023-05-15T16:42:55.103 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether gcc accepts -g... (cached) yes 2023-05-15T16:42:55.103 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gcc option to enable C11 features... (cached) none needed 2023-05-15T16:42:55.104 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gmake... /usr/bin/gmake 2023-05-15T16:42:55.104 INFO:teuthology.orchestra.run.smithi171.stdout:checking for tar... /usr/bin/tar 2023-05-15T16:42:55.105 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gzip... /usr/bin/gzip 2023-05-15T16:42:55.117 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether gcc -MM is supported... yes 2023-05-15T16:42:55.117 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sort... /bin/sort 2023-05-15T16:42:55.118 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether ln -s works... yes 2023-05-15T16:42:55.119 INFO:teuthology.orchestra.run.smithi171.stdout:checking for msgfmt... /usr/bin/msgfmt 2023-05-15T16:42:55.119 INFO:teuthology.orchestra.run.smithi171.stdout:checking for msgmerge... /usr/bin/msgmerge 2023-05-15T16:42:55.120 INFO:teuthology.orchestra.run.smithi171.stdout:checking for xgettext... /usr/bin/xgettext 2023-05-15T16:42:55.120 INFO:teuthology.orchestra.run.smithi171.stdout:checking for rpm... no 2023-05-15T16:42:55.169 INFO:teuthology.orchestra.run.smithi171.stdout:checking for ini.h... yes 2023-05-15T16:42:55.214 INFO:teuthology.orchestra.run.smithi171.stdout:checking for ini_parse in -linih... yes 2023-05-15T16:42:55.253 INFO:teuthology.orchestra.run.smithi171.stdout:checking for uuid.h... no 2023-05-15T16:42:55.293 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sys/uuid.h... no 2023-05-15T16:42:55.329 INFO:teuthology.orchestra.run.smithi171.stdout:checking for uuid/uuid.h... yes 2023-05-15T16:42:55.383 INFO:teuthology.orchestra.run.smithi171.stdout:checking for uuid_compare... no 2023-05-15T16:42:55.429 INFO:teuthology.orchestra.run.smithi171.stdout:checking for uuid_compare in -luuid... yes 2023-05-15T16:42:55.467 INFO:teuthology.orchestra.run.smithi171.stdout:checking for pthread.h... yes 2023-05-15T16:42:55.512 INFO:teuthology.orchestra.run.smithi171.stdout:checking for pthread_mutex_init in -lpthread... yes 2023-05-15T16:42:55.555 INFO:teuthology.orchestra.run.smithi171.stdout:checking for urcu.h... yes 2023-05-15T16:42:55.592 INFO:teuthology.orchestra.run.smithi171.stdout:checking for liburcu... yes 2023-05-15T16:42:55.620 INFO:teuthology.orchestra.run.smithi171.stdout:checking for fadvise ... yes 2023-05-15T16:42:55.645 INFO:teuthology.orchestra.run.smithi171.stdout:checking for madvise ... yes 2023-05-15T16:42:55.671 INFO:teuthology.orchestra.run.smithi171.stdout:checking for mincore ... yes 2023-05-15T16:42:55.699 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sendfile ... yes 2023-05-15T16:42:55.728 INFO:teuthology.orchestra.run.smithi171.stdout:checking for getmntent ... yes 2023-05-15T16:42:55.777 INFO:teuthology.orchestra.run.smithi171.stdout:checking for fallocate... yes 2023-05-15T16:42:55.826 INFO:teuthology.orchestra.run.smithi171.stdout:checking for fiemap... yes 2023-05-15T16:42:55.882 INFO:teuthology.orchestra.run.smithi171.stdout:checking for pwritev2... yes 2023-05-15T16:42:55.937 INFO:teuthology.orchestra.run.smithi171.stdout:checking for preadv... yes 2023-05-15T16:42:55.973 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:42:55.976 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:42:55.979 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:42:55.990 INFO:teuthology.orchestra.run.smithi171.stdout:checking for copy_file_range... yes 2023-05-15T16:42:56.039 INFO:teuthology.orchestra.run.smithi171.stdout:checking for sync_file_range... yes 2023-05-15T16:42:56.091 INFO:teuthology.orchestra.run.smithi171.stdout:checking for syncfs... yes 2023-05-15T16:42:56.128 INFO:teuthology.orchestra.run.smithi171.stdout:checking for mntent.h... yes 2023-05-15T16:42:56.173 INFO:teuthology.orchestra.run.smithi171.stdout:checking for gcc options needed to detect all undeclared functions... none needed 2023-05-15T16:42:56.205 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether fls is declared... no 2023-05-15T16:42:56.257 INFO:teuthology.orchestra.run.smithi171.stdout:checking for readdir... yes 2023-05-15T16:42:56.292 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether fsetxattr is declared... yes 2023-05-15T16:42:56.325 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether mremap is declared... yes 2023-05-15T16:42:56.373 INFO:teuthology.orchestra.run.smithi171.stdout:checking for struct fsxattr... yes 2023-05-15T16:42:56.398 INFO:teuthology.orchestra.run.smithi171.stdout:checking for struct fsxattr.fsx_cowextsize... yes 2023-05-15T16:42:56.446 INFO:teuthology.orchestra.run.smithi171.stdout:checking for struct fscrypt_add_key_arg... yes 2023-05-15T16:42:56.471 INFO:teuthology.orchestra.run.smithi171.stdout:checking for struct fscrypt_add_key_arg.key_id... yes 2023-05-15T16:42:56.537 INFO:teuthology.orchestra.run.smithi171.stdout:checking for GETFSMAP... yes 2023-05-15T16:42:56.587 INFO:teuthology.orchestra.run.smithi171.stdout:checking for struct statfs... yes 2023-05-15T16:42:56.613 INFO:teuthology.orchestra.run.smithi171.stdout:checking for struct statfs.f_flags... yes 2023-05-15T16:42:56.637 INFO:teuthology.orchestra.run.smithi171.stdout:checking for MAP_SYNC... yes 2023-05-15T16:42:56.744 INFO:teuthology.orchestra.run.smithi171.stdout:checking for library containing dm_task_create... -ldevmapper 2023-05-15T16:42:56.778 INFO:teuthology.orchestra.run.smithi171.stdout:checking for mallinfo ... yes 2023-05-15T16:42:56.808 INFO:teuthology.orchestra.run.smithi171.stdout:checking for mallinfo2 ... yes 2023-05-15T16:42:56.846 INFO:teuthology.orchestra.run.smithi171.stdout:checking for attr/attributes.h... yes 2023-05-15T16:42:56.873 INFO:teuthology.orchestra.run.smithi171.stdout:checking for struct attrlist_cursor... yes 2023-05-15T16:42:56.874 INFO:teuthology.orchestra.run.smithi171.stdout:checking for pkg-config... /usr/bin/pkg-config 2023-05-15T16:42:56.877 INFO:teuthology.orchestra.run.smithi171.stdout:checking pkg-config is at least version 0.9.0... yes 2023-05-15T16:42:56.887 INFO:teuthology.orchestra.run.smithi171.stdout:checking for icu-i18n... yes 2023-05-15T16:42:56.923 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether openat is declared... yes 2023-05-15T16:42:56.964 INFO:teuthology.orchestra.run.smithi171.stdout:checking whether fstatat is declared... yes 2023-05-15T16:42:57.002 INFO:teuthology.orchestra.run.smithi171.stdout:checking for struct sg_io_hdr ... yes 2023-05-15T16:42:57.031 INFO:teuthology.orchestra.run.smithi171.stdout:checking for struct hd_geometry ... yes 2023-05-15T16:42:57.044 INFO:teuthology.orchestra.run.smithi171.stdout:checking for systemd... yes 2023-05-15T16:42:57.048 INFO:teuthology.orchestra.run.smithi171.stdout:checking for systemd system unit dir... /lib/systemd/system 2023-05-15T16:42:57.048 INFO:teuthology.orchestra.run.smithi171.stdout:checking for system crontab dir... /etc/cron.d 2023-05-15T16:42:57.148 INFO:teuthology.orchestra.run.smithi171.stdout:checking for library containing blkid_probe_all... -lblkid 2023-05-15T16:42:57.198 INFO:teuthology.orchestra.run.smithi171.stdout:checking for blkid_probe_get_topology... yes 2023-05-15T16:42:57.268 INFO:teuthology.orchestra.run.smithi171.stdout:checking size of long... 8 2023-05-15T16:42:57.338 INFO:teuthology.orchestra.run.smithi171.stdout:checking size of char *... 8 2023-05-15T16:42:57.360 INFO:teuthology.orchestra.run.smithi171.stdout:checking for umode_t... no 2023-05-15T16:42:57.421 INFO:teuthology.orchestra.run.smithi171.stdout:checking for atomic64_t support in liburcu... yes 2023-05-15T16:42:57.449 INFO:teuthology.orchestra.run.smithi171.stdout:configure: creating ./config.status 2023-05-15T16:42:58.191 INFO:teuthology.orchestra.run.smithi171.stdout:config.status: creating include/builddefs 2023-05-15T16:42:58.214 INFO:teuthology.orchestra.run.smithi171.stdout:config.status: creating include/platform_defs.h 2023-05-15T16:42:58.233 INFO:teuthology.orchestra.run.smithi171.stdout:config.status: executing libtool commands 2023-05-15T16:42:58.306 INFO:teuthology.orchestra.run.smithi171.stdout: [HEADERS] include 2023-05-15T16:42:58.329 INFO:teuthology.orchestra.run.smithi171.stdout: [HEADERS] libxfs 2023-05-15T16:42:58.361 INFO:teuthology.orchestra.run.smithi171.stdout:Building include 2023-05-15T16:42:58.369 INFO:teuthology.orchestra.run.smithi171.stdout: [LN] disk 2023-05-15T16:42:58.373 INFO:teuthology.orchestra.run.smithi171.stdout:Building libfrog 2023-05-15T16:42:58.379 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] gen_crc32table 2023-05-15T16:42:58.444 INFO:teuthology.orchestra.run.smithi171.stdout: [GENERATE] crc32table.h 2023-05-15T16:42:58.883 INFO:teuthology.orchestra.run.smithi171.stdout: [TEST] CRC32 2023-05-15T16:42:58.983 INFO:teuthology.orchestra.run.smithi171.stdout:CRC_LE_BITS = 64 2023-05-15T16:42:58.983 INFO:teuthology.orchestra.run.smithi171.stdout:crc32c: tests passed, 225944 bytes in 56 usec 2023-05-15T16:42:58.987 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] avl64.lo 2023-05-15T16:42:59.436 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] bitmap.lo 2023-05-15T16:42:59.760 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] bulkstat.lo 2023-05-15T16:43:00.136 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] convert.lo 2023-05-15T16:43:00.485 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] crc32.lo 2023-05-15T16:43:00.703 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fsgeom.lo 2023-05-15T16:43:01.021 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] list_sort.lo 2023-05-15T16:43:01.228 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] linux.lo 2023-05-15T16:43:01.557 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] logging.lo 2023-05-15T16:43:01.710 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] paths.lo 2023-05-15T16:43:02.142 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] projects.lo 2023-05-15T16:43:02.444 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] ptvar.lo 2023-05-15T16:43:02.697 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] radix-tree.lo 2023-05-15T16:43:03.201 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] scrub.lo 2023-05-15T16:43:03.402 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] util.lo 2023-05-15T16:43:03.621 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] workqueue.lo 2023-05-15T16:43:03.895 INFO:teuthology.orchestra.run.smithi171.stdout: [LD] libfrog.la 2023-05-15T16:43:04.006 INFO:teuthology.orchestra.run.smithi171.stdout:Building libxfs 2023-05-15T16:43:05.641 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] cache.lo 2023-05-15T16:43:06.169 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] defer_item.lo 2023-05-15T16:43:06.587 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] init.lo 2023-05-15T16:43:07.289 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] kmem.lo 2023-05-15T16:43:07.588 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] logitem.lo 2023-05-15T16:43:07.879 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] rdwr.lo 2023-05-15T16:43:08.710 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] topology.lo 2023-05-15T16:43:09.088 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] trans.lo 2023-05-15T16:43:09.587 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] util.lo 2023-05-15T16:43:10.096 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_ag.lo 2023-05-15T16:43:10.811 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_ag_resv.lo 2023-05-15T16:43:11.164 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_alloc.lo 2023-05-15T16:43:12.583 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_alloc_btree.lo 2023-05-15T16:43:13.050 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_attr.lo 2023-05-15T16:43:13.644 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_attr_leaf.lo 2023-05-15T16:43:15.022 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_attr_remote.lo 2023-05-15T16:43:15.562 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_bit.lo 2023-05-15T16:43:15.840 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_bmap.lo 2023-05-15T16:43:18.604 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_bmap_btree.lo 2023-05-15T16:43:19.124 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_btree.lo 2023-05-15T16:43:21.247 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_btree_staging.lo 2023-05-15T16:43:21.698 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_da_btree.lo 2023-05-15T16:43:22.974 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_defer.lo 2023-05-15T16:43:23.478 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_dir2.lo 2023-05-15T16:43:23.989 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_dir2_block.lo 2023-05-15T16:43:24.820 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_dir2_data.lo 2023-05-15T16:43:25.581 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_dir2_leaf.lo 2023-05-15T16:43:26.079 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:43:26.083 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:43:26.085 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:43:26.494 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_dir2_node.lo 2023-05-15T16:43:27.534 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_dir2_sf.lo 2023-05-15T16:43:28.307 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_dquot_buf.lo 2023-05-15T16:43:28.692 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_ialloc.lo 2023-05-15T16:43:29.935 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_iext_tree.lo 2023-05-15T16:43:30.652 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_inode_buf.lo 2023-05-15T16:43:31.286 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_inode_fork.lo 2023-05-15T16:43:31.911 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_ialloc_btree.lo 2023-05-15T16:43:32.427 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_log_rlimit.lo 2023-05-15T16:43:32.733 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_refcount.lo 2023-05-15T16:43:33.536 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_refcount_btree.lo 2023-05-15T16:43:33.977 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_rmap.lo 2023-05-15T16:43:35.122 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_rmap_btree.lo 2023-05-15T16:43:35.628 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_rtbitmap.lo 2023-05-15T16:43:36.253 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_sb.lo 2023-05-15T16:43:37.038 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_symlink_remote.lo 2023-05-15T16:43:37.398 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_trans_inode.lo 2023-05-15T16:43:37.708 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_trans_resv.lo 2023-05-15T16:43:38.281 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_types.lo 2023-05-15T16:43:38.628 INFO:teuthology.orchestra.run.smithi171.stdout: [LD] libxfs.la 2023-05-15T16:43:38.843 INFO:teuthology.orchestra.run.smithi171.stdout:Building libxlog 2023-05-15T16:43:38.934 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_log_recover.lo 2023-05-15T16:43:39.743 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] util.lo 2023-05-15T16:43:40.113 INFO:teuthology.orchestra.run.smithi171.stdout: [LD] libxlog.la 2023-05-15T16:43:40.206 INFO:teuthology.orchestra.run.smithi171.stdout:Building libxcmd 2023-05-15T16:43:40.340 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] command.lo 2023-05-15T16:43:40.674 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] input.lo 2023-05-15T16:43:40.982 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] help.lo 2023-05-15T16:43:41.233 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] quit.lo 2023-05-15T16:43:41.453 INFO:teuthology.orchestra.run.smithi171.stdout: [LD] libxcmd.la 2023-05-15T16:43:41.546 INFO:teuthology.orchestra.run.smithi171.stdout:Building libhandle 2023-05-15T16:43:41.624 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] handle.lo 2023-05-15T16:43:41.995 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] jdm.lo 2023-05-15T16:43:42.275 INFO:teuthology.orchestra.run.smithi171.stdout: [LD] libhandle.la 2023-05-15T16:43:42.404 INFO:teuthology.orchestra.run.smithi171.stdout:Building copy 2023-05-15T16:43:42.458 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_copy.o 2023-05-15T16:43:42.897 INFO:teuthology.orchestra.run.smithi171.stdout: [LD] xfs_copy 2023-05-15T16:43:43.070 INFO:teuthology.orchestra.run.smithi171.stdout:Building db 2023-05-15T16:43:45.030 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] addr.o 2023-05-15T16:43:45.147 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] agf.o 2023-05-15T16:43:45.258 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] agfl.o 2023-05-15T16:43:45.362 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] agi.o 2023-05-15T16:43:45.473 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] attr.o 2023-05-15T16:43:45.673 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] attrshort.o 2023-05-15T16:43:45.798 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] bit.o 2023-05-15T16:43:45.931 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] block.o 2023-05-15T16:43:46.077 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] bmap.o 2023-05-15T16:43:46.282 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] btblock.o 2023-05-15T16:43:46.423 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] bmroot.o 2023-05-15T16:43:46.595 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] check.o 2023-05-15T16:43:48.405 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] command.o 2023-05-15T16:43:48.516 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] crc.o 2023-05-15T16:43:48.643 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] debug.o 2023-05-15T16:43:48.744 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] dir2.o 2023-05-15T16:43:49.030 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] dir2sf.o 2023-05-15T16:43:49.182 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] dquot.o 2023-05-15T16:43:49.306 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] echo.o 2023-05-15T16:43:49.399 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] faddr.o 2023-05-15T16:43:49.593 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] field.o 2023-05-15T16:43:49.707 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] flist.o 2023-05-15T16:43:49.941 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fprint.o 2023-05-15T16:43:50.114 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] frag.o 2023-05-15T16:43:50.353 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] freesp.o 2023-05-15T16:43:50.556 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] hash.o 2023-05-15T16:43:50.656 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] help.o 2023-05-15T16:43:50.761 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] init.o 2023-05-15T16:43:50.891 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] inode.o 2023-05-15T16:43:51.176 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] input.o 2023-05-15T16:43:51.320 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] io.o 2023-05-15T16:43:51.536 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] logformat.o 2023-05-15T16:43:51.660 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] malloc.o 2023-05-15T16:43:51.764 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] metadump.o 2023-05-15T16:43:52.607 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] output.o 2023-05-15T16:43:52.721 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] print.o 2023-05-15T16:43:52.878 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] quit.o 2023-05-15T16:43:52.975 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] sb.o 2023-05-15T16:43:53.232 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] sig.o 2023-05-15T16:43:53.334 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] strvec.o 2023-05-15T16:43:53.448 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] text.o 2023-05-15T16:43:53.559 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] type.o 2023-05-15T16:43:53.690 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] write.o 2023-05-15T16:43:53.935 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] attrset.o 2023-05-15T16:43:54.072 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] symlink.o 2023-05-15T16:43:54.180 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fsmap.o 2023-05-15T16:43:54.310 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fuzz.o 2023-05-15T16:43:54.483 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] btdump.o 2023-05-15T16:43:54.668 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] btheight.o 2023-05-15T16:43:54.849 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] convert.o 2023-05-15T16:43:54.998 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] info.o 2023-05-15T16:43:55.123 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] namei.o 2023-05-15T16:43:55.334 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] timelimit.o 2023-05-15T16:43:55.453 INFO:teuthology.orchestra.run.smithi171.stdout: [LD] xfs_db 2023-05-15T16:43:55.683 INFO:teuthology.orchestra.run.smithi171.stdout:Building estimate 2023-05-15T16:43:55.737 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_estimate.o 2023-05-15T16:43:55.883 INFO:teuthology.orchestra.run.smithi171.stdout: [LD] xfs_estimate 2023-05-15T16:43:55.963 INFO:teuthology.orchestra.run.smithi171.stdout:Building fsck 2023-05-15T16:43:55.968 INFO:teuthology.orchestra.run.smithi171.stdout:Building fsr 2023-05-15T16:43:56.024 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_fsr.o 2023-05-15T16:43:56.226 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:43:56.230 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:43:56.233 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:43:56.453 INFO:teuthology.orchestra.run.smithi171.stdout: [LD] xfs_fsr 2023-05-15T16:43:56.568 INFO:teuthology.orchestra.run.smithi171.stdout:Building growfs 2023-05-15T16:43:56.624 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_growfs.o 2023-05-15T16:43:56.807 INFO:teuthology.orchestra.run.smithi171.stdout: [LD] xfs_growfs 2023-05-15T16:43:56.979 INFO:teuthology.orchestra.run.smithi171.stdout:Building io 2023-05-15T16:43:58.343 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] init.o 2023-05-15T16:43:58.456 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] attr.o 2023-05-15T16:43:58.596 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] bmap.o 2023-05-15T16:43:58.772 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] bulkstat.o 2023-05-15T16:43:58.930 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] crc32cselftest.o 2023-05-15T16:43:59.017 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] cowextsize.o 2023-05-15T16:43:59.124 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] encrypt.o 2023-05-15T16:43:59.353 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] file.o 2023-05-15T16:43:59.456 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] freeze.o 2023-05-15T16:43:59.541 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fsuuid.o 2023-05-15T16:43:59.644 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fsync.o 2023-05-15T16:43:59.720 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] getrusage.o 2023-05-15T16:43:59.811 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] imap.o 2023-05-15T16:43:59.894 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] inject.o 2023-05-15T16:43:59.990 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] label.o 2023-05-15T16:44:00.103 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] link.o 2023-05-15T16:44:00.180 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] mmap.o 2023-05-15T16:44:00.388 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] open.o 2023-05-15T16:44:00.664 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] parent.o 2023-05-15T16:44:00.820 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] pread.o 2023-05-15T16:44:00.988 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] prealloc.o 2023-05-15T16:44:01.132 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] pwrite.o 2023-05-15T16:44:01.282 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] reflink.o 2023-05-15T16:44:01.408 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] resblks.o 2023-05-15T16:44:01.492 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] scrub.o 2023-05-15T16:44:01.619 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] seek.o 2023-05-15T16:44:01.724 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] shutdown.o 2023-05-15T16:44:01.804 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] stat.o 2023-05-15T16:44:02.008 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] swapext.o 2023-05-15T16:44:02.094 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] sync.o 2023-05-15T16:44:02.170 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] truncate.o 2023-05-15T16:44:02.248 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] utimes.o 2023-05-15T16:44:02.328 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fadvise.o 2023-05-15T16:44:02.416 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] madvise.o 2023-05-15T16:44:02.504 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] mincore.o 2023-05-15T16:44:02.597 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] sendfile.o 2023-05-15T16:44:02.697 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fiemap.o 2023-05-15T16:44:02.850 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] copy_file_range.o 2023-05-15T16:44:02.948 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] sync_file_range.o 2023-05-15T16:44:03.036 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] readdir.o 2023-05-15T16:44:03.135 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] log_writes.o 2023-05-15T16:44:03.222 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fsmap.o 2023-05-15T16:44:03.456 INFO:teuthology.orchestra.run.smithi171.stdout: [LD] xfs_io 2023-05-15T16:44:03.630 INFO:teuthology.orchestra.run.smithi171.stdout:Building logprint 2023-05-15T16:44:03.903 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] logprint.o 2023-05-15T16:44:04.043 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] log_copy.o 2023-05-15T16:44:04.154 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] log_dump.o 2023-05-15T16:44:04.269 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] log_misc.o 2023-05-15T16:44:04.787 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] log_print_all.o 2023-05-15T16:44:05.039 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] log_print_trans.o 2023-05-15T16:44:05.150 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] log_redo.o 2023-05-15T16:44:05.398 INFO:teuthology.orchestra.run.smithi171.stdout: [LD] xfs_logprint 2023-05-15T16:44:05.576 INFO:teuthology.orchestra.run.smithi171.stdout:Building mkfs 2023-05-15T16:44:05.668 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] proto.o 2023-05-15T16:44:05.948 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_mkfs.o 2023-05-15T16:44:06.666 INFO:teuthology.orchestra.run.smithi171.stdout: [LD] mkfs.xfs 2023-05-15T16:44:06.845 INFO:teuthology.orchestra.run.smithi171.stdout:Building quota 2023-05-15T16:44:07.225 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] init.o 2023-05-15T16:44:07.322 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] util.o 2023-05-15T16:44:07.482 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] edit.o 2023-05-15T16:44:07.682 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] free.o 2023-05-15T16:44:07.825 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] linux.o 2023-05-15T16:44:07.898 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] path.o 2023-05-15T16:44:08.005 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] project.o 2023-05-15T16:44:08.149 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] quot.o 2023-05-15T16:44:08.302 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] quota.o 2023-05-15T16:44:08.474 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] report.o 2023-05-15T16:44:08.703 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] state.o 2023-05-15T16:44:08.883 INFO:teuthology.orchestra.run.smithi171.stdout: [LD] xfs_quota 2023-05-15T16:44:09.005 INFO:teuthology.orchestra.run.smithi171.stdout:Building mdrestore 2023-05-15T16:44:09.059 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_mdrestore.o 2023-05-15T16:44:09.219 INFO:teuthology.orchestra.run.smithi171.stdout: [LD] xfs_mdrestore 2023-05-15T16:44:09.375 INFO:teuthology.orchestra.run.smithi171.stdout:Building repair 2023-05-15T16:44:10.675 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] agheader.o 2023-05-15T16:44:10.884 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] agbtree.o 2023-05-15T16:44:11.108 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] attr_repair.o 2023-05-15T16:44:11.454 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] avl.o 2023-05-15T16:44:11.662 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] bulkload.o 2023-05-15T16:44:11.779 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] bmap.o 2023-05-15T16:44:11.930 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] btree.o 2023-05-15T16:44:12.266 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] da_util.o 2023-05-15T16:44:12.490 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] dino_chunks.o 2023-05-15T16:44:12.860 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] dinode.o 2023-05-15T16:44:13.602 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] dir2.o 2023-05-15T16:44:14.010 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] globals.o 2023-05-15T16:44:14.096 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] incore_bmc.o 2023-05-15T16:44:14.199 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] incore.o 2023-05-15T16:44:14.345 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] incore_ext.o 2023-05-15T16:44:14.562 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] incore_ino.o 2023-05-15T16:44:14.822 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] init.o 2023-05-15T16:44:14.947 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] phase1.o 2023-05-15T16:44:15.072 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] phase2.o 2023-05-15T16:44:15.259 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] phase3.o 2023-05-15T16:44:15.398 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] phase4.o 2023-05-15T16:44:15.575 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] phase5.o 2023-05-15T16:44:15.828 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] phase6.o 2023-05-15T16:44:16.702 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] phase7.o 2023-05-15T16:44:16.830 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] prefetch.o 2023-05-15T16:44:17.162 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] progress.o 2023-05-15T16:44:17.363 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] quotacheck.o 2023-05-15T16:44:17.562 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] rmap.o 2023-05-15T16:44:17.945 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] rt.o 2023-05-15T16:44:18.104 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] sb.o 2023-05-15T16:44:18.327 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] scan.o 2023-05-15T16:44:19.079 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] slab.o 2023-05-15T16:44:19.243 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] threads.o 2023-05-15T16:44:19.353 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] versions.o 2023-05-15T16:44:19.480 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_repair.o 2023-05-15T16:44:19.796 INFO:teuthology.orchestra.run.smithi171.stdout: [LD] xfs_repair 2023-05-15T16:44:20.027 INFO:teuthology.orchestra.run.smithi171.stdout:Building rtcp 2023-05-15T16:44:20.081 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_rtcp.o 2023-05-15T16:44:20.252 INFO:teuthology.orchestra.run.smithi171.stdout: [LD] xfs_rtcp 2023-05-15T16:44:20.346 INFO:teuthology.orchestra.run.smithi171.stdout:Building m4 2023-05-15T16:44:20.353 INFO:teuthology.orchestra.run.smithi171.stdout:Building man 2023-05-15T16:44:20.361 INFO:teuthology.orchestra.run.smithi171.stdout:Building man2 2023-05-15T16:44:20.370 INFO:teuthology.orchestra.run.smithi171.stdout:Building man3 2023-05-15T16:44:20.378 INFO:teuthology.orchestra.run.smithi171.stdout:Building man5 2023-05-15T16:44:20.386 INFO:teuthology.orchestra.run.smithi171.stdout:Building man8 2023-05-15T16:44:20.403 INFO:teuthology.orchestra.run.smithi171.stdout: [SED] mkfs.xfs.8 2023-05-15T16:44:20.409 INFO:teuthology.orchestra.run.smithi171.stdout:Building doc 2023-05-15T16:44:20.417 INFO:teuthology.orchestra.run.smithi171.stdout: [ZIP] CHANGES.gz 2023-05-15T16:44:20.429 INFO:teuthology.orchestra.run.smithi171.stdout:Building debian 2023-05-15T16:44:20.435 INFO:teuthology.orchestra.run.smithi171.stdout:Building spaceman 2023-05-15T16:44:20.712 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] info.o 2023-05-15T16:44:20.815 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] init.o 2023-05-15T16:44:20.932 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] file.o 2023-05-15T16:44:21.051 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] health.o 2023-05-15T16:44:21.208 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] prealloc.o 2023-05-15T16:44:21.320 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] trim.o 2023-05-15T16:44:21.442 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] freesp.o 2023-05-15T16:44:21.616 INFO:teuthology.orchestra.run.smithi171.stdout: [LD] xfs_spaceman 2023-05-15T16:44:21.734 INFO:teuthology.orchestra.run.smithi171.stdout:Building scrub 2023-05-15T16:44:22.446 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] common.o 2023-05-15T16:44:22.591 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] counter.o 2023-05-15T16:44:22.661 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] descr.o 2023-05-15T16:44:22.745 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] disk.o 2023-05-15T16:44:22.869 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] filemap.o 2023-05-15T16:44:22.959 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] fscounters.o 2023-05-15T16:44:23.056 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] inodes.o 2023-05-15T16:44:23.202 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] phase1.o 2023-05-15T16:44:23.310 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] phase2.o 2023-05-15T16:44:23.415 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] phase3.o 2023-05-15T16:44:23.532 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] phase4.o 2023-05-15T16:44:23.629 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] phase5.o 2023-05-15T16:44:23.776 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] phase6.o 2023-05-15T16:44:23.962 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] phase7.o 2023-05-15T16:44:24.080 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] progress.o 2023-05-15T16:44:24.188 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] read_verify.o 2023-05-15T16:44:24.312 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] repair.o 2023-05-15T16:44:24.434 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] scrub.o 2023-05-15T16:44:24.638 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] spacemap.o 2023-05-15T16:44:24.754 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] vfs.o 2023-05-15T16:44:24.874 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] xfs_scrub.o 2023-05-15T16:44:25.069 INFO:teuthology.orchestra.run.smithi171.stdout: [CC] unicrash.o 2023-05-15T16:44:25.242 INFO:teuthology.orchestra.run.smithi171.stdout: [LD] xfs_scrub 2023-05-15T16:44:25.425 INFO:teuthology.orchestra.run.smithi171.stdout: [SED] xfs_scrub_all 2023-05-15T16:44:25.433 INFO:teuthology.orchestra.run.smithi171.stdout: [SED] xfs_scrub@.service 2023-05-15T16:44:25.439 INFO:teuthology.orchestra.run.smithi171.stdout: [SED] xfs_scrub_all.service 2023-05-15T16:44:25.445 INFO:teuthology.orchestra.run.smithi171.stdout: [SED] xfs_scrub_fail@.service 2023-05-15T16:44:25.450 INFO:teuthology.orchestra.run.smithi171.stdout: [SED] xfs_scrub_all.cron 2023-05-15T16:44:25.456 INFO:teuthology.orchestra.run.smithi171.stdout:Building po 2023-05-15T16:44:25.483 INFO:teuthology.orchestra.run.smithi171.stdout: [GETTXT] xfsprogs.pot 2023-05-15T16:44:25.707 INFO:teuthology.orchestra.run.smithi171.stdout: [MSGFMT] de.mo 2023-05-15T16:44:25.762 INFO:teuthology.orchestra.run.smithi171.stderr:2345 translated messages. 2023-05-15T16:44:25.764 INFO:teuthology.orchestra.run.smithi171.stdout: [MSGFMT] pl.mo 2023-05-15T16:44:25.809 INFO:teuthology.orchestra.run.smithi171.stderr:3104 translated messages. 2023-05-15T16:44:25.810 INFO:teuthology.orchestra.run.smithi171.stdout:gmake[2]: Nothing to be done for 'include'. 2023-05-15T16:44:25.813 DEBUG:teuthology.orchestra.run.smithi171:> (cd /tmp/tmp.BkW72pdIBZxfsprogs-dev && exec sudo make install) 2023-05-15T16:44:25.842 INFO:teuthology.orchestra.run.smithi171.stdout:Installing libfrog-install 2023-05-15T16:44:26.251 INFO:teuthology.orchestra.run.smithi171.stdout:Installing libxfs-install 2023-05-15T16:44:26.306 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:44:26.309 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:44:26.312 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:44:27.881 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-05-15T16:44:27.900 INFO:teuthology.orchestra.run.smithi171.stdout:Installing libxlog-install 2023-05-15T16:44:27.988 INFO:teuthology.orchestra.run.smithi171.stdout:Installing libxcmd-install 2023-05-15T16:44:28.118 INFO:teuthology.orchestra.run.smithi171.stdout:Installing libhandle-install 2023-05-15T16:44:28.193 INFO:teuthology.orchestra.run.smithi171.stdout:cd ../libhandle/.libs; ../../install-sh -o root -g root -m 755 -d /lib; ../../install-sh -o root -g root -m 755 -T so_dot_version libhandle.lai /lib; ../../install-sh -o root -g root -T so_dot_current libhandle.lai /lib 2023-05-15T16:44:28.252 INFO:teuthology.orchestra.run.smithi171.stdout:Installing copy-install 2023-05-15T16:44:28.302 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-05-15T16:44:28.320 INFO:teuthology.orchestra.run.smithi171.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_copy /usr/sbin 2023-05-15T16:44:28.371 INFO:teuthology.orchestra.run.smithi171.stdout:Installing db-install 2023-05-15T16:44:30.313 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-05-15T16:44:30.331 INFO:teuthology.orchestra.run.smithi171.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_db /usr/sbin 2023-05-15T16:44:30.383 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 xfs_admin.sh /usr/sbin/xfs_admin 2023-05-15T16:44:30.401 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 xfs_ncheck.sh /usr/sbin/xfs_ncheck 2023-05-15T16:44:30.420 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 xfs_metadump.sh /usr/sbin/xfs_metadump 2023-05-15T16:44:30.439 INFO:teuthology.orchestra.run.smithi171.stdout:Installing estimate-install 2023-05-15T16:44:30.489 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-05-15T16:44:30.506 INFO:teuthology.orchestra.run.smithi171.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_estimate /usr/sbin 2023-05-15T16:44:30.550 INFO:teuthology.orchestra.run.smithi171.stdout:Installing fsck-install 2023-05-15T16:44:30.554 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-05-15T16:44:30.572 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 xfs_fsck.sh /sbin/fsck.xfs 2023-05-15T16:44:30.591 INFO:teuthology.orchestra.run.smithi171.stdout:Installing fsr-install 2023-05-15T16:44:30.642 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-05-15T16:44:30.660 INFO:teuthology.orchestra.run.smithi171.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_fsr /usr/sbin 2023-05-15T16:44:30.704 INFO:teuthology.orchestra.run.smithi171.stdout:Installing growfs-install 2023-05-15T16:44:30.754 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-05-15T16:44:30.772 INFO:teuthology.orchestra.run.smithi171.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_growfs /usr/sbin 2023-05-15T16:44:30.822 INFO:teuthology.orchestra.run.smithi171.stdout:Installing io-install 2023-05-15T16:44:32.181 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-05-15T16:44:32.199 INFO:teuthology.orchestra.run.smithi171.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_io /usr/sbin 2023-05-15T16:44:32.243 INFO:teuthology.orchestra.run.smithi171.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_bmap.sh /usr/sbin/xfs_bmap 2023-05-15T16:44:32.285 INFO:teuthology.orchestra.run.smithi171.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_freeze.sh /usr/sbin/xfs_freeze 2023-05-15T16:44:32.326 INFO:teuthology.orchestra.run.smithi171.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mkfile.sh /usr/sbin/xfs_mkfile 2023-05-15T16:44:32.370 INFO:teuthology.orchestra.run.smithi171.stdout:Installing logprint-install 2023-05-15T16:44:32.638 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-05-15T16:44:32.655 INFO:teuthology.orchestra.run.smithi171.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_logprint /usr/sbin 2023-05-15T16:44:32.706 INFO:teuthology.orchestra.run.smithi171.stdout:Installing mkfs-install 2023-05-15T16:44:32.795 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-05-15T16:44:32.813 INFO:teuthology.orchestra.run.smithi171.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 mkfs.xfs /sbin 2023-05-15T16:44:32.862 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /usr/share/xfsprogs/mkfs 2023-05-15T16:44:32.879 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 644 dax_x86_64.conf lts_4.19.conf lts_5.4.conf lts_5.10.conf lts_5.15.conf lts_6.1.conf /usr/share/xfsprogs/mkfs 2023-05-15T16:44:32.924 INFO:teuthology.orchestra.run.smithi171.stdout:Installing quota-install 2023-05-15T16:44:33.283 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-05-15T16:44:33.301 INFO:teuthology.orchestra.run.smithi171.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_quota /usr/sbin 2023-05-15T16:44:33.345 INFO:teuthology.orchestra.run.smithi171.stdout:Installing mdrestore-install 2023-05-15T16:44:33.395 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-05-15T16:44:33.413 INFO:teuthology.orchestra.run.smithi171.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_mdrestore /usr/sbin 2023-05-15T16:44:33.463 INFO:teuthology.orchestra.run.smithi171.stdout:Installing repair-install 2023-05-15T16:44:34.761 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /sbin 2023-05-15T16:44:34.779 INFO:teuthology.orchestra.run.smithi171.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_repair /sbin 2023-05-15T16:44:34.832 INFO:teuthology.orchestra.run.smithi171.stdout:Installing rtcp-install 2023-05-15T16:44:34.882 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-05-15T16:44:34.900 INFO:teuthology.orchestra.run.smithi171.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_rtcp /usr/sbin 2023-05-15T16:44:34.944 INFO:teuthology.orchestra.run.smithi171.stdout:Installing m4-install 2023-05-15T16:44:34.948 INFO:teuthology.orchestra.run.smithi171.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-15T16:44:34.949 INFO:teuthology.orchestra.run.smithi171.stdout:Installing man-install 2023-05-15T16:44:34.959 INFO:teuthology.orchestra.run.smithi171.stdout:gmake[2]: Nothing to be done for 'install'. 2023-05-15T16:44:34.964 INFO:teuthology.orchestra.run.smithi171.stdout:gmake[2]: Nothing to be done for 'install'. 2023-05-15T16:44:34.972 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man5 2023-05-15T16:44:34.995 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 projects.5 /usr/share/man/man5/projects.5 2023-05-15T16:44:35.016 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 projid.5 /usr/share/man/man5/projid.5 2023-05-15T16:44:35.037 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs.5 /usr/share/man/man5/xfs.5 2023-05-15T16:44:35.064 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 755 -d /usr/share/man/man8 2023-05-15T16:44:35.087 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 fsck.xfs.8 /usr/share/man/man8/fsck.xfs.8 2023-05-15T16:44:35.108 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-05-15T16:44:35.130 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs_admin.8 /usr/share/man/man8/xfs_admin.8 2023-05-15T16:44:35.150 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs_bmap.8 /usr/share/man/man8/xfs_bmap.8 2023-05-15T16:44:35.171 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs_copy.8 /usr/share/man/man8/xfs_copy.8 2023-05-15T16:44:35.193 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs_db.8 /usr/share/man/man8/xfs_db.8 2023-05-15T16:44:35.214 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs_estimate.8 /usr/share/man/man8/xfs_estimate.8 2023-05-15T16:44:35.235 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs_freeze.8 /usr/share/man/man8/xfs_freeze.8 2023-05-15T16:44:35.255 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs_fsr.8 /usr/share/man/man8/xfs_fsr.8 2023-05-15T16:44:35.276 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs_growfs.8 /usr/share/man/man8/xfs_growfs.8 2023-05-15T16:44:35.297 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs_info.8 /usr/share/man/man8/xfs_info.8 2023-05-15T16:44:35.318 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs_io.8 /usr/share/man/man8/xfs_io.8 2023-05-15T16:44:35.339 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs_logprint.8 /usr/share/man/man8/xfs_logprint.8 2023-05-15T16:44:35.360 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs_mdrestore.8 /usr/share/man/man8/xfs_mdrestore.8 2023-05-15T16:44:35.381 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs_metadump.8 /usr/share/man/man8/xfs_metadump.8 2023-05-15T16:44:35.402 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs_mkfile.8 /usr/share/man/man8/xfs_mkfile.8 2023-05-15T16:44:35.422 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs_ncheck.8 /usr/share/man/man8/xfs_ncheck.8 2023-05-15T16:44:35.443 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs_quota.8 /usr/share/man/man8/xfs_quota.8 2023-05-15T16:44:35.464 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs_repair.8 /usr/share/man/man8/xfs_repair.8 2023-05-15T16:44:35.485 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs_rtcp.8 /usr/share/man/man8/xfs_rtcp.8 2023-05-15T16:44:35.506 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs_scrub.8 /usr/share/man/man8/xfs_scrub.8 2023-05-15T16:44:35.527 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs_scrub_all.8 /usr/share/man/man8/xfs_scrub_all.8 2023-05-15T16:44:35.548 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 xfs_spaceman.8 /usr/share/man/man8/xfs_spaceman.8 2023-05-15T16:44:35.569 INFO:teuthology.orchestra.run.smithi171.stdout:../../install-sh -o root -g root -m 644 mkfs.xfs.8 /usr/share/man/man8/mkfs.xfs.8 2023-05-15T16:44:35.588 INFO:teuthology.orchestra.run.smithi171.stdout:Installing doc-install 2023-05-15T16:44:35.592 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-05-15T16:44:35.609 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 644 CHANGES.gz CREDITS /usr/share/doc/xfsprogs 2023-05-15T16:44:35.645 INFO:teuthology.orchestra.run.smithi171.stdout:Installing debian-install 2023-05-15T16:44:35.649 INFO:teuthology.orchestra.run.smithi171.stdout:gmake[1]: Nothing to be done for 'install'. 2023-05-15T16:44:35.650 INFO:teuthology.orchestra.run.smithi171.stdout:Installing spaceman-install 2023-05-15T16:44:35.923 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-05-15T16:44:35.941 INFO:teuthology.orchestra.run.smithi171.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_spaceman /usr/sbin 2023-05-15T16:44:35.984 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 xfs_info.sh /usr/sbin/xfs_info 2023-05-15T16:44:36.003 INFO:teuthology.orchestra.run.smithi171.stdout:Installing scrub-install 2023-05-15T16:44:36.712 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /usr/sbin 2023-05-15T16:44:36.729 INFO:teuthology.orchestra.run.smithi171.stdout:/bin/bash ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 xfs_scrub /usr/sbin 2023-05-15T16:44:36.773 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 xfs_scrub_all /usr/sbin 2023-05-15T16:44:36.791 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /lib/systemd/system 2023-05-15T16:44:36.808 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 644 xfs_scrub@.service xfs_scrub_all.service xfs_scrub_all.timer xfs_scrub_fail@.service /lib/systemd/system 2023-05-15T16:44:36.841 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/xfsprogs 2023-05-15T16:44:36.859 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 xfs_scrub_fail /usr/lib/xfsprogs 2023-05-15T16:44:36.896 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /usr/lib/xfsprogs 2023-05-15T16:44:36.914 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 644 xfs_scrub_all.cron /usr/lib/xfsprogs 2023-05-15T16:44:36.933 INFO:teuthology.orchestra.run.smithi171.stdout:Installing po-install 2023-05-15T16:44:37.018 INFO:teuthology.orchestra.run.smithi171.stdout:Installing include-install 2023-05-15T16:44:37.022 INFO:teuthology.orchestra.run.smithi171.stdout:../install-sh -o root -g root -m 755 -d /usr/include/xfs 2023-05-15T16:44:37.040 INFO:teuthology.orchestra.run.smithi171.stdout:./install-sh -o root -g root -m 755 -d /usr/share/doc/xfsprogs 2023-05-15T16:44:37.057 INFO:teuthology.orchestra.run.smithi171.stdout:./install-sh -o root -g root -m 644 README /usr/share/doc/xfsprogs 2023-05-15T16:44:37.078 INFO:tasks.cephfs.test_fscrypt:client is kernel mounted 2023-05-15T16:44:37.078 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-05-15T16:44:37.215 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.209+0000 7fd856331640 1 Processor -- start 2023-05-15T16:44:37.216 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.209+0000 7fd856331640 1 -- start start 2023-05-15T16:44:37.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd856331640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7fd8500b5330 0x7fd8500b5700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:44:37.219 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd856331640 1 -- --> v1:172.21.15.62:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8500716b0 con 0x7fd850144e90 2023-05-15T16:44:37.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd856331640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8500afa90 con 0x7fd850071a90 2023-05-15T16:44:37.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd856331640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8500b2280 con 0x7fd8500b5330 2023-05-15T16:44:37.220 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd8548ce640 1 --1- >> v1:172.21.15.62:6789/0 conn(0x7fd850144e90 0x7fd850152350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.62:6789/0 says I am v1:172.21.15.62:36434/0 (socket says 172.21.15.62:36434) 2023-05-15T16:44:37.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd8548ce640 1 -- 172.21.15.62:0/594338461 learned_addr learned my addr 172.21.15.62:0/594338461 (peer_addr_for_me v1:172.21.15.62:0/0) 2023-05-15T16:44:37.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84ffff640 1 --2- 172.21.15.62:0/594338461 >> v2:172.21.15.161:3300/0 conn(0x7fd8500b5330 0x7fd8500b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:44:37.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84effd640 1 -- 172.21.15.62:0/594338461 <== mon.0 v1:172.21.15.62:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 911941483 0 0) 0x7fd8500716b0 con 0x7fd850144e90 2023-05-15T16:44:37.221 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84effd640 1 -- 172.21.15.62:0/594338461 --> v1:172.21.15.62:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd83c003530 con 0x7fd850144e90 2023-05-15T16:44:37.222 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84effd640 1 -- 172.21.15.62:0/594338461 <== mon.0 v1:172.21.15.62:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1547717378 0 0) 0x7fd83c003530 con 0x7fd850144e90 2023-05-15T16:44:37.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84effd640 1 -- 172.21.15.62:0/594338461 >> v2:172.21.15.161:3300/0 conn(0x7fd8500b5330 msgr2=0x7fd8500b5700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:44:37.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84effd640 1 --2- 172.21.15.62:0/594338461 >> v2:172.21.15.161:3300/0 conn(0x7fd8500b5330 0x7fd8500b5700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:44:37.223 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84effd640 1 -- 172.21.15.62:0/594338461 >> v1:172.21.15.161:6789/0 conn(0x7fd850071a90 legacy=0x7fd8500b16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:44:37.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84effd640 1 -- 172.21.15.62:0/594338461 --> v1:172.21.15.62:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8500b0f00 con 0x7fd850144e90 2023-05-15T16:44:37.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84effd640 1 -- 172.21.15.62:0/594338461 <== mon.0 v1:172.21.15.62:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 1100828120 0 0) 0x7fd838001680 con 0x7fd850144e90 2023-05-15T16:44:37.224 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84effd640 1 -- 172.21.15.62:0/594338461 >> v1:172.21.15.62:6789/0 conn(0x7fd850144e90 legacy=0x7fd850152350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:44:37.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84effd640 1 --2- 172.21.15.62:0/594338461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd83c003980 0x7fd83c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:44:37.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84effd640 1 --2- 172.21.15.62:0/594338461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd83c0047d0 0x7fd83c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:44:37.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84effd640 1 --2- 172.21.15.62:0/594338461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd83c005180 0x7fd83c00b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:44:37.225 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84effd640 1 -- 172.21.15.62:0/594338461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8500b2280 con 0x7fd83c003980 2023-05-15T16:44:37.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84effd640 1 -- 172.21.15.62:0/594338461 --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c00bfe0 con 0x7fd83c005180 2023-05-15T16:44:37.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84effd640 1 -- 172.21.15.62:0/594338461 --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd83c00c1a0 con 0x7fd83c0047d0 2023-05-15T16:44:37.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84ffff640 1 --2- 172.21.15.62:0/594338461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd83c003980 0x7fd83c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:44:37.226 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84f7fe640 1 --2- 172.21.15.62:0/594338461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd83c0047d0 0x7fd83c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:44:37.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd8548ce640 1 --2- 172.21.15.62:0/594338461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd83c005180 0x7fd83c00b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:44:37.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84ffff640 1 -- 172.21.15.62:0/594338461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd83c0047d0 msgr2=0x7fd83c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:44:37.227 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84ffff640 1 --2- 172.21.15.62:0/594338461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd83c0047d0 0x7fd83c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:44:37.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84ffff640 1 -- 172.21.15.62:0/594338461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd83c005180 msgr2=0x7fd83c00b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:44:37.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84ffff640 1 --2- 172.21.15.62:0/594338461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd83c005180 0x7fd83c00b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:44:37.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84ffff640 1 -- 172.21.15.62:0/594338461 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd83c003530 con 0x7fd83c003980 2023-05-15T16:44:37.228 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd84f7fe640 1 --2- 172.21.15.62:0/594338461 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd83c0047d0 0x7fd83c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:44:37.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd8548ce640 1 --2- 172.21.15.62:0/594338461 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd83c005180 0x7fd83c00b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-05-15T16:44:37.229 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.213+0000 7fd8548ce640 1 -- 172.21.15.62:0/594338461 reap_dead start 2023-05-15T16:44:37.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd84ffff640 1 --2- 172.21.15.62:0/594338461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd83c003980 0x7fd83c003d90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd840009fc0 tx=0x7fd84001cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9d694e7463cf15b server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:44:37.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd84effd640 1 -- 172.21.15.62:0/594338461 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8400a5c70 con 0x7fd83c003980 2023-05-15T16:44:37.234 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd84effd640 1 -- 172.21.15.62:0/594338461 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd838001d80 con 0x7fd83c003980 2023-05-15T16:44:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd84effd640 1 -- 172.21.15.62:0/594338461 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8400ad440 con 0x7fd83c003980 2023-05-15T16:44:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd856331640 1 -- 172.21.15.62:0/594338461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd83c003980 msgr2=0x7fd83c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:44:37.235 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd856331640 1 --2- 172.21.15.62:0/594338461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd83c003980 0x7fd83c003d90 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fd840009fc0 tx=0x7fd84001cc60 comp rx=0 tx=0).stop 2023-05-15T16:44:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd856331640 1 -- 172.21.15.62:0/594338461 shutdown_connections 2023-05-15T16:44:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd856331640 1 --2- 172.21.15.62:0/594338461 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd83c003980 0x7fd83c003d90 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:44:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd856331640 1 -- 172.21.15.62:0/594338461 >> 172.21.15.62:0/594338461 conn(0x7fd8500653f0 msgr2=0x7fd8500697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:44:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd856331640 1 -- 172.21.15.62:0/594338461 shutdown_connections 2023-05-15T16:44:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd856331640 1 -- 172.21.15.62:0/594338461 wait complete. 2023-05-15T16:44:37.236 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd856331640 1 Processor -- start 2023-05-15T16:44:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd856331640 1 -- start start 2023-05-15T16:44:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd856331640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd83c003980 0x7fd85013c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:44:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd856331640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd850140770 0x7fd850148ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:44:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd856331640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd850149530 0x7fd85006f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:44:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd856331640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8501e10d0 con 0x7fd83c003980 2023-05-15T16:44:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd856331640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd85013c8c0 con 0x7fd850149530 2023-05-15T16:44:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd856331640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8501e0620 con 0x7fd850140770 2023-05-15T16:44:37.237 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd84ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd83c003980 0x7fd85013c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:44:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd84ffff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd83c003980 0x7fd85013c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59746/0 (socket says 172.21.15.62:59746) 2023-05-15T16:44:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd84ffff640 1 -- 172.21.15.62:0/1681851773 learned_addr learned my addr 172.21.15.62:0/1681851773 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:44:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd84ffff640 1 -- 172.21.15.62:0/1681851773 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd850140770 msgr2=0x7fd850148ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:44:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd84f7fe640 1 --2- 172.21.15.62:0/1681851773 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd850140770 0x7fd850148ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:44:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd84ffff640 1 --2- 172.21.15.62:0/1681851773 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd850140770 0x7fd850148ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:44:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd84ffff640 1 -- 172.21.15.62:0/1681851773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd850149530 msgr2=0x7fd85006f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:44:37.238 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd84ffff640 1 --2- 172.21.15.62:0/1681851773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd850149530 0x7fd85006f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:44:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.217+0000 7fd84ffff640 1 -- 172.21.15.62:0/1681851773 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8500b11a0 con 0x7fd83c003980 2023-05-15T16:44:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.221+0000 7fd84ffff640 1 --2- 172.21.15.62:0/1681851773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd83c003980 0x7fd85013c380 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd84001ca90 tx=0x7fd840009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:44:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.221+0000 7fd84cff9640 1 -- 172.21.15.62:0/1681851773 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8400bd070 con 0x7fd83c003980 2023-05-15T16:44:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.221+0000 7fd84cff9640 1 -- 172.21.15.62:0/1681851773 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd84000f040 con 0x7fd83c003980 2023-05-15T16:44:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.221+0000 7fd856331640 1 -- 172.21.15.62:0/1681851773 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8500af7b0 con 0x7fd83c003980 2023-05-15T16:44:37.239 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.221+0000 7fd84cff9640 1 -- 172.21.15.62:0/1681851773 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd840003bc0 con 0x7fd83c003980 2023-05-15T16:44:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.221+0000 7fd856331640 1 -- 172.21.15.62:0/1681851773 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8500b1ec0 con 0x7fd83c003980 2023-05-15T16:44:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.221+0000 7fd856331640 1 -- 172.21.15.62:0/1681851773 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd850067960 con 0x7fd83c003980 2023-05-15T16:44:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.221+0000 7fd84cff9640 1 -- 172.21.15.62:0/1681851773 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7fd8400b4040 con 0x7fd83c003980 2023-05-15T16:44:37.240 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.221+0000 7fd84cff9640 1 --2- 172.21.15.62:0/1681851773 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd830065380 0x7fd830067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:44:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.221+0000 7fd84cff9640 1 -- 172.21.15.62:0/1681851773 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6091+0+0 (secure 0 0 0) 0x7fd84011cae0 con 0x7fd83c003980 2023-05-15T16:44:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.221+0000 7fd84f7fe640 1 --2- 172.21.15.62:0/1681851773 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd830065380 0x7fd830067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:44:37.241 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.221+0000 7fd84f7fe640 1 --2- 172.21.15.62:0/1681851773 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd830065380 0x7fd830067830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd85013d150 tx=0x7fd848009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:44:37.242 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.225+0000 7fd84cff9640 1 -- 172.21.15.62:0/1681851773 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7fd8400ea6f0 con 0x7fd83c003980 2023-05-15T16:44:37.441 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.437+0000 7fd856331640 1 -- 172.21.15.62:0/1681851773 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd8500ba230 con 0x7fd83c003980 2023-05-15T16:44:37.442 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.437+0000 7fd84cff9640 1 -- 172.21.15.62:0/1681851773 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7fd8400b2020 con 0x7fd83c003980 2023-05-15T16:44:37.442 INFO:teuthology.orchestra.run.smithi062.stdout: 2023-05-15T16:44:37.442 INFO:teuthology.orchestra.run.smithi062.stdout:{"epoch":1,"fsid":"fed834dd-24d2-40f4-8361-7c8c5a9484de","modified":"2023-05-15T16:38:57.083297Z","created":"2023-05-15T16:38:57.083297Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.62:3300","nonce":0},{"type":"v1","addr":"172.21.15.62:6789","nonce":0}]},"addr":"172.21.15.62:6789/0","public_addr":"172.21.15.62:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:3300","nonce":0},{"type":"v1","addr":"172.21.15.161:6789","nonce":0}]},"addr":"172.21.15.161:6789/0","public_addr":"172.21.15.161:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.161:3301","nonce":0},{"type":"v1","addr":"172.21.15.161:6790","nonce":0}]},"addr":"172.21.15.161:6790/0","public_addr":"172.21.15.161:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-05-15T16:44:37.442 INFO:teuthology.orchestra.run.smithi062.stderr:dumped monmap epoch 1 2023-05-15T16:44:37.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.441+0000 7fd856331640 1 -- 172.21.15.62:0/1681851773 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd830065380 msgr2=0x7fd830067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:44:37.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.441+0000 7fd856331640 1 --2- 172.21.15.62:0/1681851773 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd830065380 0x7fd830067830 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd85013d150 tx=0x7fd848009040 comp rx=0 tx=0).stop 2023-05-15T16:44:37.444 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.441+0000 7fd856331640 1 -- 172.21.15.62:0/1681851773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd83c003980 msgr2=0x7fd85013c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:44:37.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.441+0000 7fd856331640 1 --2- 172.21.15.62:0/1681851773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd83c003980 0x7fd85013c380 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fd84001ca90 tx=0x7fd840009750 comp rx=0 tx=0).stop 2023-05-15T16:44:37.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.441+0000 7fd856331640 1 -- 172.21.15.62:0/1681851773 shutdown_connections 2023-05-15T16:44:37.445 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.441+0000 7fd856331640 1 --2- 172.21.15.62:0/1681851773 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7fd850149530 0x7fd85006f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:44:37.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.441+0000 7fd856331640 1 --2- 172.21.15.62:0/1681851773 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7fd850140770 0x7fd850148ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:44:37.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.441+0000 7fd856331640 1 --2- 172.21.15.62:0/1681851773 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7fd830065380 0x7fd830067830 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:44:37.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.441+0000 7fd856331640 1 --2- 172.21.15.62:0/1681851773 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7fd83c003980 0x7fd85013c380 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:44:37.446 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.441+0000 7fd856331640 1 -- 172.21.15.62:0/1681851773 >> 172.21.15.62:0/1681851773 conn(0x7fd8500653f0 msgr2=0x7fd8500ba750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:44:37.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.441+0000 7fd856331640 1 -- 172.21.15.62:0/1681851773 shutdown_connections 2023-05-15T16:44:37.447 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.441+0000 7fd856331640 1 -- 172.21.15.62:0/1681851773 wait complete. 2023-05-15T16:44:37.461 DEBUG:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-05-15T16:44:37.592 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.589+0000 7f33b5a6c640 1 Processor -- start 2023-05-15T16:44:37.593 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.589+0000 7f33b5a6c640 1 -- start start 2023-05-15T16:44:37.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.589+0000 7f33b5a6c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33b0147af0 0x7f33b00ba030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:44:37.594 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.589+0000 7f33b5a6c640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f33b00b8950 0x7f33b00b8da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:44:37.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.589+0000 7f33b5a6c640 1 -- --> v1:172.21.15.161:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33b0148950 con 0x7f33b01450d0 2023-05-15T16:44:37.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.589+0000 7f33b5a6c640 1 -- --> v2:172.21.15.161:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33b00b5570 con 0x7f33b00b8950 2023-05-15T16:44:37.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.589+0000 7f33b5a6c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b0070cd0 con 0x7f33b0147af0 2023-05-15T16:44:37.595 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.589+0000 7f33aeffd640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33b0147af0 0x7f33b00ba030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:44:37.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.589+0000 7f33affff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f33b00b8950 0x7f33b00b8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:44:37.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.589+0000 7f33affff640 1 --2- >> v2:172.21.15.161:3300/0 conn(0x7f33b00b8950 0x7f33b00b8da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.161:3300/0 says I am v2:172.21.15.62:37606/0 (socket says 172.21.15.62:37606) 2023-05-15T16:44:37.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.589+0000 7f33affff640 1 -- 172.21.15.62:0/612721755 learned_addr learned my addr 172.21.15.62:0/612721755 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:44:37.596 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.589+0000 7f33af7fe640 1 --1- 172.21.15.62:0/612721755 >> v1:172.21.15.161:6789/0 conn(0x7f33b01450d0 0x7f33b00705c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.161:6789/0 says I am v1:172.21.15.62:46814/0 (socket says 172.21.15.62:46814) 2023-05-15T16:44:37.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.589+0000 7f33affff640 1 -- 172.21.15.62:0/612721755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33b0147af0 msgr2=0x7f33b00ba030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-05-15T16:44:37.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.589+0000 7f33affff640 1 --2- 172.21.15.62:0/612721755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33b0147af0 0x7f33b00ba030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:44:37.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.589+0000 7f33affff640 1 -- 172.21.15.62:0/612721755 >> v1:172.21.15.161:6789/0 conn(0x7f33b01450d0 legacy=0x7f33b00705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:44:37.597 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.589+0000 7f33affff640 1 -- 172.21.15.62:0/612721755 --> v2:172.21.15.161:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b00b92e0 con 0x7f33b00b8950 2023-05-15T16:44:37.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.593+0000 7f33affff640 1 --2- 172.21.15.62:0/612721755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33b00b8950 0x7f33b00b8da0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f33a8009870 tx=0x7f33a801c480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=98b593368ed3d970 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:44:37.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.593+0000 7f33ae7fc640 1 -- 172.21.15.62:0/612721755 <== mon.1 v2:172.21.15.161:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a80ab680 con 0x7f33b00b8950 2023-05-15T16:44:37.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.593+0000 7f33ae7fc640 1 -- 172.21.15.62:0/612721755 <== mon.1 v2:172.21.15.161:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a80ab7e0 con 0x7f33b00b8950 2023-05-15T16:44:37.601 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.593+0000 7f33ae7fc640 1 -- 172.21.15.62:0/612721755 <== mon.1 v2:172.21.15.161:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a80abb70 con 0x7f33b00b8950 2023-05-15T16:44:37.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.593+0000 7f33b5a6c640 1 -- 172.21.15.62:0/612721755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33b00b8950 msgr2=0x7f33b00b8da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:44:37.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.593+0000 7f33b5a6c640 1 --2- 172.21.15.62:0/612721755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33b00b8950 0x7f33b00b8da0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f33a8009870 tx=0x7f33a801c480 comp rx=0 tx=0).stop 2023-05-15T16:44:37.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.593+0000 7f33b5a6c640 1 -- 172.21.15.62:0/612721755 shutdown_connections 2023-05-15T16:44:37.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.593+0000 7f33b5a6c640 1 --2- 172.21.15.62:0/612721755 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33b00b8950 0x7f33b00b8da0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:44:37.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.593+0000 7f33b5a6c640 1 --2- 172.21.15.62:0/612721755 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33b0147af0 0x7f33b00ba030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:44:37.602 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.593+0000 7f33b5a6c640 1 -- 172.21.15.62:0/612721755 >> 172.21.15.62:0/612721755 conn(0x7f33b00bde20 msgr2=0x7f33b00be220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:44:37.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.593+0000 7f33b5a6c640 1 -- 172.21.15.62:0/612721755 shutdown_connections 2023-05-15T16:44:37.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.593+0000 7f33b5a6c640 1 -- 172.21.15.62:0/612721755 wait complete. 2023-05-15T16:44:37.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.593+0000 7f33b5a6c640 1 Processor -- start 2023-05-15T16:44:37.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.593+0000 7f33b5a6c640 1 -- start start 2023-05-15T16:44:37.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.593+0000 7f33b5a6c640 1 --2- >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33b00b8950 0x7f33b0141e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:44:37.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.593+0000 7f33b5a6c640 1 --2- >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33b01450d0 0x7f33b00b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:44:37.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.593+0000 7f33b5a6c640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33b0147af0 0x7f33b00b3f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:44:37.603 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.593+0000 7f33b5a6c640 1 -- --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b0142350 con 0x7f33b0147af0 2023-05-15T16:44:37.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.593+0000 7f33b5a6c640 1 -- --> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b013f3a0 con 0x7f33b01450d0 2023-05-15T16:44:37.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.593+0000 7f33b5a6c640 1 -- --> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33b00b1ce0 con 0x7f33b00b8950 2023-05-15T16:44:37.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33affff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33b0147af0 0x7f33b00b3f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:44:37.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33affff640 1 --2- >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33b0147af0 0x7f33b00b3f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.62:3300/0 says I am v2:172.21.15.62:59756/0 (socket says 172.21.15.62:59756) 2023-05-15T16:44:37.604 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33affff640 1 -- 172.21.15.62:0/745339798 learned_addr learned my addr 172.21.15.62:0/745339798 (peer_addr_for_me v2:172.21.15.62:0/0) 2023-05-15T16:44:37.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33aeffd640 1 --2- 172.21.15.62:0/745339798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33b01450d0 0x7f33b00b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:44:37.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33af7fe640 1 --2- 172.21.15.62:0/745339798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33b00b8950 0x7f33b0141e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:44:37.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33affff640 1 -- 172.21.15.62:0/745339798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33b00b8950 msgr2=0x7f33b0141e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:44:37.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33affff640 1 --2- 172.21.15.62:0/745339798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33b00b8950 0x7f33b0141e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:44:37.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33affff640 1 -- 172.21.15.62:0/745339798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33b01450d0 msgr2=0x7f33b00b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:44:37.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33affff640 1 --2- 172.21.15.62:0/745339798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33b01450d0 0x7f33b00b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:44:37.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33affff640 1 -- 172.21.15.62:0/745339798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a80094d0 con 0x7f33b0147af0 2023-05-15T16:44:37.605 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33aeffd640 1 --2- 172.21.15.62:0/745339798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33b01450d0 0x7f33b00b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-05-15T16:44:37.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33affff640 1 --2- 172.21.15.62:0/745339798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33b0147af0 0x7f33b00b3f40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f33a801cd20 tx=0x7f33a801acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:44:37.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33a7fff640 1 -- 172.21.15.62:0/745339798 <== mon.0 v2:172.21.15.62:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a80b4800 con 0x7f33b0147af0 2023-05-15T16:44:37.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33a7fff640 1 -- 172.21.15.62:0/745339798 <== mon.0 v2:172.21.15.62:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a80b4960 con 0x7f33b0147af0 2023-05-15T16:44:37.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33b5a6c640 1 -- 172.21.15.62:0/745339798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b006ce50 con 0x7f33b0147af0 2023-05-15T16:44:37.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33a7fff640 1 -- 172.21.15.62:0/745339798 <== mon.0 v2:172.21.15.62:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a80b4cf0 con 0x7f33b0147af0 2023-05-15T16:44:37.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33b5a6c640 1 -- 172.21.15.62:0/745339798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b01485e0 con 0x7f33b0147af0 2023-05-15T16:44:37.606 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33b5a6c640 1 -- 172.21.15.62:0/745339798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b01454a0 con 0x7f33b0147af0 2023-05-15T16:44:37.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33a7fff640 1 -- 172.21.15.62:0/745339798 <== mon.0 v2:172.21.15.62:3300/0 4 ==== mgrmap(e 5) v1 ==== 84230+0+0 (secure 0 0 0) 0x7f33a80c7440 con 0x7f33b0147af0 2023-05-15T16:44:37.607 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33a7fff640 1 --2- 172.21.15.62:0/745339798 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3390065380 0x7f3390067830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-05-15T16:44:37.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33a7fff640 1 -- 172.21.15.62:0/745339798 <== mon.0 v2:172.21.15.62:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6091+0+0 (secure 0 0 0) 0x7f33a811d7c0 con 0x7f33b0147af0 2023-05-15T16:44:37.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.597+0000 7f33af7fe640 1 --2- 172.21.15.62:0/745339798 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3390065380 0x7f3390067830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-05-15T16:44:37.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.601+0000 7f33af7fe640 1 --2- 172.21.15.62:0/745339798 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3390065380 0x7f3390067830 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f33a0000f70 tx=0x7f33a0007cd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-05-15T16:44:37.608 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.601+0000 7f33a7fff640 1 -- 172.21.15.62:0/745339798 <== mon.0 v2:172.21.15.62:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+169485 (secure 0 0 0) 0x7f33a80eb450 con 0x7f33b0147af0 2023-05-15T16:44:37.812 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.809+0000 7f33b5a6c640 1 -- 172.21.15.62:0/745339798 --> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7f33b004dbe0 con 0x7f33b0147af0 2023-05-15T16:44:37.813 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.809+0000 7f33a7fff640 1 -- 172.21.15.62:0/745339798 <== mon.0 v2:172.21.15.62:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v13) v1 ==== 92+0+63 (secure 0 0 0) 0x7f33a80eea70 con 0x7f33b0147af0 2023-05-15T16:44:37.813 INFO:teuthology.orchestra.run.smithi062.stdout:[client.admin] 2023-05-15T16:44:37.813 INFO:teuthology.orchestra.run.smithi062.stdout: key = AQAhYGJk1aNnFBAAZ/I0oN2lXWsDFvNv3rKzbQ== 2023-05-15T16:44:37.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.809+0000 7f33b5a6c640 1 -- 172.21.15.62:0/745339798 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3390065380 msgr2=0x7f3390067830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:44:37.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.809+0000 7f33b5a6c640 1 --2- 172.21.15.62:0/745339798 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3390065380 0x7f3390067830 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f33a0000f70 tx=0x7f33a0007cd0 comp rx=0 tx=0).stop 2023-05-15T16:44:37.815 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.809+0000 7f33b5a6c640 1 -- 172.21.15.62:0/745339798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33b0147af0 msgr2=0x7f33b00b3f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-05-15T16:44:37.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.809+0000 7f33b5a6c640 1 --2- 172.21.15.62:0/745339798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33b0147af0 0x7f33b00b3f40 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f33a801cd20 tx=0x7f33a801acc0 comp rx=0 tx=0).stop 2023-05-15T16:44:37.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.809+0000 7f33b5a6c640 1 -- 172.21.15.62:0/745339798 shutdown_connections 2023-05-15T16:44:37.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.809+0000 7f33b5a6c640 1 --2- 172.21.15.62:0/745339798 >> [v2:172.21.15.161:6832/37541,v1:172.21.15.161:6833/37541] conn(0x7f3390065380 0x7f3390067830 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:44:37.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.809+0000 7f33b5a6c640 1 --2- 172.21.15.62:0/745339798 >> [v2:172.21.15.62:3300/0,v1:172.21.15.62:6789/0] conn(0x7f33b0147af0 0x7f33b00b3f40 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:44:37.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.809+0000 7f33b5a6c640 1 --2- 172.21.15.62:0/745339798 >> [v2:172.21.15.161:3300/0,v1:172.21.15.161:6789/0] conn(0x7f33b01450d0 0x7f33b00b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:44:37.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.809+0000 7f33b5a6c640 1 --2- 172.21.15.62:0/745339798 >> [v2:172.21.15.161:3301/0,v1:172.21.15.161:6790/0] conn(0x7f33b00b8950 0x7f33b0141e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-05-15T16:44:37.816 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.809+0000 7f33b5a6c640 1 -- 172.21.15.62:0/745339798 >> 172.21.15.62:0/745339798 conn(0x7f33b00bde20 msgr2=0x7f33b006d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-05-15T16:44:37.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.813+0000 7f33b5a6c640 1 -- 172.21.15.62:0/745339798 shutdown_connections 2023-05-15T16:44:37.817 INFO:teuthology.orchestra.run.smithi062.stderr:2023-05-15T16:44:37.813+0000 7f33b5a6c640 1 -- 172.21.15.62:0/745339798 wait complete. 2023-05-15T16:44:37.833 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2023-05-15T16:44:37.833 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/tmp/tmp.KbTuA66fZfxfstests-dev/local.config 2023-05-15T16:44:37.853 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.62:6789:/test export TEST_DIR=/tmp/tmp.PREJpBJ9rrtest export SCRATCH_DEV=172.21.15.62:6789:/scratch export SCRATCH_MNT=/tmp/tmp.GAK2y7SAKoscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQAhYGJk1aNnFBAAZ/I0oN2lXWsDFvNv3rKzbQ==,test_dummy_encryption" 2023-05-15T16:44:37.854 INFO:teuthology.orchestra.run:Running command with timeout 10800 2023-05-15T16:44:37.855 DEBUG:teuthology.orchestra.run.smithi171:running tests for dummy_encryption from xfstests-dev> (cd /tmp/tmp.KbTuA66fZfxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check -g quick -E ./ceph.exclude) 2023-05-15T16:44:39.459 INFO:teuthology.orchestra.run.smithi171.stdout:FSTYP -- ceph 2023-05-15T16:44:39.468 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM -- Linux/x86_64 smithi171 6.3.0-g7312ab6f53ec #1 SMP PREEMPT_DYNAMIC Mon May 15 02:27:28 UTC 2023 2023-05-15T16:44:39.469 INFO:teuthology.orchestra.run.smithi171.stdout:MKFS_OPTIONS -- 172.21.15.62:6789:/scratch 2023-05-15T16:44:39.472 INFO:teuthology.orchestra.run.smithi171.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAhYGJk1aNnFBAAZ/I0oN2lXWsDFvNv3rKzbQ==,test_dummy_encryption 172.21.15.62:6789:/scratch /tmp/tmp.GAK2y7SAKoscratch 2023-05-15T16:44:39.472 INFO:teuthology.orchestra.run.smithi171.stdout: 2023-05-15T16:44:39.734 INFO:teuthology.orchestra.run.smithi171.stdout:ceph/001 [expunged] 2023-05-15T16:44:40.066 INFO:teuthology.orchestra.run.smithi171.stdout:ceph/002 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-05-15T16:44:40.414 INFO:teuthology.orchestra.run.smithi171.stdout:ceph/003 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-05-15T16:44:40.881 INFO:teuthology.orchestra.run.smithi171.stdout:ceph/004 0s 2023-05-15T16:44:41.199 INFO:teuthology.orchestra.run.smithi171.stdout:ceph/005 [not run] mount option "test_dummy_encryption" not allowed in this test 2023-05-15T16:44:51.004 INFO:teuthology.orchestra.run.smithi171.stdout:generic/001 9s 2023-05-15T16:44:51.653 INFO:teuthology.orchestra.run.smithi171.stdout:generic/002 0s 2023-05-15T16:44:51.671 INFO:teuthology.orchestra.run.smithi171.stdout:generic/003 [expunged] 2023-05-15T16:44:51.993 INFO:teuthology.orchestra.run.smithi171.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-05-15T16:44:52.740 INFO:teuthology.orchestra.run.smithi171.stdout:generic/005 0s 2023-05-15T16:44:56.361 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:44:56.363 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:44:56.366 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:45:26.822 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:45:26.824 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:45:26.827 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:45:34.015 INFO:teuthology.orchestra.run.smithi171.stdout:generic/006 42s 2023-05-15T16:45:57.064 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:45:57.067 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:45:57.069 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:46:27.194 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:46:27.196 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:46:27.199 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:46:55.102 INFO:teuthology.orchestra.run.smithi171.stdout:generic/007 81s 2023-05-15T16:46:57.482 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:46:57.485 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:46:57.487 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:46:58.555 INFO:teuthology.orchestra.run.smithi171.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-15T16:47:00.934 INFO:teuthology.orchestra.run.smithi171.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-15T16:47:27.818 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:47:27.820 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:47:27.823 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:47:58.034 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:47:58.038 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:47:58.040 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:47:58.215 INFO:teuthology.orchestra.run.smithi171.stdout:generic/011 58s 2023-05-15T16:48:00.828 INFO:teuthology.orchestra.run.smithi171.stdout:generic/012 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-05-15T16:48:28.164 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:48:28.166 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:48:28.169 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:48:55.789 INFO:teuthology.orchestra.run.smithi171.stdout:generic/013 55s 2023-05-15T16:48:58.562 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:48:58.565 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:48:58.567 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:49:28.641 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:49:28.644 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:49:28.646 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:49:28.665 INFO:tasks.ceph.mds.a.smithi062.stderr:2023-05-15T16:49:28.661+0000 7f3ade027640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46723) UID: 0 2023-05-15T16:49:28.666 INFO:tasks.ceph.mds.c.smithi062.stderr:2023-05-15T16:49:28.661+0000 7f1482090640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 46723) UID: 0 2023-05-15T16:51:20.160 INFO:teuthology.orchestra.run.smithi171.stdout:generic/014 145s 2023-05-15T16:51:20.420 INFO:teuthology.orchestra.run.smithi171.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-05-15T16:51:25.572 INFO:teuthology.orchestra.run.smithi171.stdout:generic/016 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-05-15T16:51:26.019 INFO:teuthology.orchestra.run.smithi171.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-05-15T16:51:26.074 INFO:teuthology.orchestra.run.smithi171.stdout:generic/020 [expunged] 2023-05-15T16:51:30.641 INFO:teuthology.orchestra.run.smithi171.stdout:generic/021 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-05-15T16:51:35.989 INFO:teuthology.orchestra.run.smithi171.stdout:generic/022 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-05-15T16:52:23.464 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:52:23.467 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:52:23.470 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:52:31.112 INFO:teuthology.orchestra.run.smithi171.stdout:generic/023 55s 2023-05-15T16:52:31.456 INFO:teuthology.orchestra.run.smithi171.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-05-15T16:52:31.821 INFO:teuthology.orchestra.run.smithi171.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-05-15T16:52:32.203 INFO:teuthology.orchestra.run.smithi171.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-05-15T16:52:37.521 INFO:teuthology.orchestra.run.smithi171.stdout:generic/028 5s 2023-05-15T16:52:38.974 INFO:teuthology.orchestra.run.smithi171.stdout:generic/029 1s 2023-05-15T16:52:50.275 INFO:teuthology.orchestra.run.smithi171.stdout:generic/030 11s 2023-05-15T16:52:53.758 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:52:53.760 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:52:53.762 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:52:56.167 INFO:teuthology.orchestra.run.smithi171.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-05-15T16:52:56.465 INFO:teuthology.orchestra.run.smithi171.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-05-15T16:53:01.666 INFO:teuthology.orchestra.run.smithi171.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-15T16:53:01.959 INFO:teuthology.orchestra.run.smithi171.stdout:generic/034 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-05-15T16:53:02.347 INFO:teuthology.orchestra.run.smithi171.stdout:generic/035 1s 2023-05-15T16:53:08.962 INFO:teuthology.orchestra.run.smithi171.stdout:generic/037 6s 2023-05-15T16:53:09.364 INFO:teuthology.orchestra.run.smithi171.stdout:generic/039 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-05-15T16:53:09.748 INFO:teuthology.orchestra.run.smithi171.stdout:generic/040 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-05-15T16:53:10.096 INFO:teuthology.orchestra.run.smithi171.stdout:generic/041 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-05-15T16:53:10.560 INFO:teuthology.orchestra.run.smithi171.stdout:generic/042 [not run] ceph does not support shutdown 2023-05-15T16:53:11.046 INFO:teuthology.orchestra.run.smithi171.stdout:generic/050 [not run] ceph does not support shutdown 2023-05-15T16:53:11.616 INFO:teuthology.orchestra.run.smithi171.stdout:generic/052 [not run] ceph does not support shutdown 2023-05-15T16:53:12.786 INFO:teuthology.orchestra.run.smithi171.stdout:generic/053 1s 2023-05-15T16:53:13.154 INFO:teuthology.orchestra.run.smithi171.stdout:generic/056 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-05-15T16:53:13.497 INFO:teuthology.orchestra.run.smithi171.stdout:generic/057 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-05-15T16:53:18.902 INFO:teuthology.orchestra.run.smithi171.stdout:generic/058 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-05-15T16:53:19.211 INFO:teuthology.orchestra.run.smithi171.stdout:generic/059 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-05-15T16:53:23.831 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:53:23.834 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:53:23.836 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:53:24.277 INFO:teuthology.orchestra.run.smithi171.stdout:generic/060 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-05-15T16:53:29.458 INFO:teuthology.orchestra.run.smithi171.stdout:generic/061 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-05-15T16:53:32.167 INFO:teuthology.orchestra.run.smithi171.stdout:generic/062 3s 2023-05-15T16:53:37.470 INFO:teuthology.orchestra.run.smithi171.stdout:generic/063 [not run] xfs_io fpunch failed (old kernel/wrong fs?) 2023-05-15T16:53:37.841 INFO:teuthology.orchestra.run.smithi171.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-15T16:53:38.178 INFO:teuthology.orchestra.run.smithi171.stdout:generic/065 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-05-15T16:53:38.473 INFO:teuthology.orchestra.run.smithi171.stdout:generic/066 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-05-15T16:53:38.812 INFO:teuthology.orchestra.run.smithi171.stdout:generic/067 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-05-15T16:53:54.166 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:53:54.169 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:53:54.171 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:54:03.534 INFO:teuthology.orchestra.run.smithi171.stdout:generic/069 25s 2023-05-15T16:54:24.346 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:54:24.349 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:54:24.351 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:54:28.865 INFO:teuthology.orchestra.run.smithi171.stdout:generic/070 25s 2023-05-15T16:54:29.193 INFO:teuthology.orchestra.run.smithi171.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-05-15T16:54:29.559 INFO:teuthology.orchestra.run.smithi171.stdout:generic/073 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-05-15T16:54:29.580 INFO:teuthology.orchestra.run.smithi171.stdout:generic/075 [expunged] 2023-05-15T16:54:29.860 INFO:teuthology.orchestra.run.smithi171.stdout:generic/076 [not run] require 172.21.15.62:6789:/scratch to be local device 2023-05-15T16:54:30.189 INFO:teuthology.orchestra.run.smithi171.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-05-15T16:54:30.558 INFO:teuthology.orchestra.run.smithi171.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-05-15T16:54:32.944 INFO:teuthology.orchestra.run.smithi171.stdout:generic/080 2s 2023-05-15T16:54:33.398 INFO:teuthology.orchestra.run.smithi171.stdout:generic/081 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-05-15T16:54:33.680 INFO:teuthology.orchestra.run.smithi171.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-05-15T16:54:39.562 INFO:teuthology.orchestra.run.smithi171.stdout:generic/084 6s 2023-05-15T16:54:39.944 INFO:teuthology.orchestra.run.smithi171.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-05-15T16:54:40.354 INFO:teuthology.orchestra.run.smithi171.stdout:generic/087 1s 2023-05-15T16:54:40.667 INFO:teuthology.orchestra.run.smithi171.stdout:generic/088 0s 2023-05-15T16:54:40.978 INFO:teuthology.orchestra.run.smithi171.stdout:generic/090 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-05-15T16:54:54.411 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:54:54.414 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:54:54.416 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:55:24.906 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:55:24.910 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:55:24.912 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:55:55.035 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:55:55.038 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:55:55.041 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:56:25.259 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:56:25.262 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:56:25.265 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:56:55.389 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:56:55.391 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:56:55.394 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:57:25.469 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:57:25.472 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:57:25.474 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:57:25.765 INFO:teuthology.orchestra.run.smithi171.stdout:generic/091 164s 2023-05-15T16:57:26.068 INFO:teuthology.orchestra.run.smithi171.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-05-15T16:57:26.443 INFO:teuthology.orchestra.run.smithi171.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-05-15T16:57:32.537 INFO:teuthology.orchestra.run.smithi171.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-05-15T16:57:33.264 INFO:teuthology.orchestra.run.smithi171.stdout:generic/097 1s 2023-05-15T16:57:34.522 INFO:teuthology.orchestra.run.smithi171.stdout:generic/098 1s 2023-05-15T16:57:36.398 INFO:teuthology.orchestra.run.smithi171.stdout:generic/099 2s 2023-05-15T16:57:36.714 INFO:teuthology.orchestra.run.smithi171.stdout:generic/101 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-05-15T16:57:37.027 INFO:teuthology.orchestra.run.smithi171.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-05-15T16:57:37.382 INFO:teuthology.orchestra.run.smithi171.stdout:generic/104 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-05-15T16:57:38.254 INFO:teuthology.orchestra.run.smithi171.stdout:generic/105 1s 2023-05-15T16:57:38.642 INFO:teuthology.orchestra.run.smithi171.stdout:generic/106 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-05-15T16:57:39.002 INFO:teuthology.orchestra.run.smithi171.stdout:generic/107 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-05-15T16:57:39.536 INFO:teuthology.orchestra.run.smithi171.stdout:generic/108 [not run] require 172.21.15.62:6789:/scratch to be valid block disk 2023-05-15T16:57:39.911 INFO:teuthology.orchestra.run.smithi171.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-05-15T16:57:40.254 INFO:teuthology.orchestra.run.smithi171.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-05-15T16:57:55.592 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:57:55.595 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:57:55.597 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:58:25.720 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:58:25.723 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:58:25.726 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:58:30.718 INFO:teuthology.orchestra.run.smithi171.stdout:generic/112 50s 2023-05-15T16:58:55.779 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:58:55.782 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:58:55.783 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:59:25.898 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:59:25.901 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:59:25.903 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:59:56.048 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:59:56.052 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T16:59:56.054 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T17:00:26.132 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T17:00:26.134 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T17:00:26.137 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T17:00:56.231 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T17:00:56.233 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T17:00:56.236 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T17:01:26.379 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T17:01:26.381 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T17:01:26.384 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T17:01:26.400 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-05-15T17:01:26.397+0000 7f41f1d09640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46794) UID: 0 2023-05-15T17:01:26.400 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-05-15T17:01:26.397+0000 7fa1fdc6f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46794) UID: 0 2023-05-15T17:01:26.401 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-05-15T17:01:26.397+0000 7fef0cfca640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46794) UID: 0 2023-05-15T17:01:26.401 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-05-15T17:01:26.397+0000 7f9f05209640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46794) UID: 0 2023-05-15T17:04:10.943 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T17:04:10.946 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T17:04:10.948 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T17:04:11.195 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-05-15T17:04:11.190+0000 7f41f1d09640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46803) UID: 0 2023-05-15T17:04:11.196 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-05-15T17:04:11.190+0000 7fa1fdc6f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46803) UID: 0 2023-05-15T17:04:11.196 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-05-15T17:04:11.190+0000 7fef0cfca640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46803) UID: 0 2023-05-15T17:04:11.196 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-05-15T17:04:11.190+0000 7f9f05209640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46803) UID: 0 2023-05-15T17:09:58.502 DEBUG:teuthology.orchestra.run.smithi062:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T17:09:58.504 DEBUG:teuthology.orchestra.run.smithi161:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T17:09:58.507 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-05-15T17:10:02.140 INFO:tasks.ceph.osd.2.smithi062.stderr:2023-05-15T17:10:02.137+0000 7fa1fdc6f640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46819) UID: 0 2023-05-15T17:10:02.141 INFO:tasks.ceph.osd.3.smithi062.stderr:2023-05-15T17:10:02.137+0000 7f9f05209640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46819) UID: 0 2023-05-15T17:10:02.142 INFO:tasks.ceph.osd.0.smithi062.stderr:2023-05-15T17:10:02.137+0000 7fef0cfca640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46819) UID: 0 2023-05-15T17:10:02.142 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-05-15T17:10:02.137+0000 7f41f1d09640 -1 Fail to open '/proc/46819/cmdline' error = (2) No such file or directory 2023-05-15T17:10:02.142 INFO:tasks.ceph.osd.1.smithi062.stderr:2023-05-15T17:10:02.137+0000 7f41f1d09640 -1 received signal: Hangup from (PID: 46819) UID: 0 2023-05-15T19:28:53.569 INFO:tasks.ceph.mon.a.smithi062.stderr:problem writing to /var/log/ceph/ceph-mon.a.log: (28) No space left on device 2023-05-15T19:28:53.584 INFO:tasks.ceph.mds.c.smithi062.stderr:problem writing to /var/log/ceph/ceph-mds.c.log: (28) No space left on device 2023-05-15T19:28:53.586 INFO:tasks.ceph.osd.0.smithi062.stderr:problem writing to /var/log/ceph/ceph-osd.0.log: (28) No space left on device 2023-05-15T19:28:53.586 INFO:tasks.ceph.osd.3.smithi062.stderr:problem writing to /var/log/ceph/ceph-osd.3.log: (28) No space left on device 2023-05-15T19:28:53.587 INFO:tasks.ceph.osd.1.smithi062.stderr:problem writing to /var/log/ceph/ceph-osd.1.log: (28) No space left on device 2023-05-15T19:28:53.587 INFO:tasks.ceph.osd.2.smithi062.stderr:problem writing to /var/log/ceph/ceph-osd.2.log: (28) No space left on device 2023-05-15T19:28:53.903 INFO:teuthology.orchestra.run.smithi062.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.0.log.1: 2023-05-15T19:28:53.903 INFO:teuthology.orchestra.run.smithi062.stderr: 2023-05-15T19:28:53.904 INFO:teuthology.orchestra.run.smithi062.stderr:gzip: stdout: No space left on device 2023-05-15T19:28:54.985 INFO:teuthology.orchestra.run.smithi062.stderr:error: failed to compress log /var/log/ceph/ceph-osd.0.log.1 2023-05-15T19:28:55.764 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-05-15T19:28:55.770 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/github.com_ceph_ceph-c_ef2746e02c24971e8f0b792fa43f63ba4ae04ec2/qa/tasks/ceph.py", line 188, in invoke_logrotate run.wait(procs) File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi062 with status 1: 'sudo logrotate /etc/logrotate.d/ceph-test.conf' 2023-05-15T19:29:11.861 INFO:tasks.ceph.osd.0.smithi062.stderr:problem writing to /var/log/ceph/ceph-osd.0.log: (28) No space left on device 2023-05-15T19:29:11.891 INFO:tasks.ceph.mon.a.smithi062.stderr:problem writing to /var/log/ceph/ceph-mon.a.log: (28) No space left on device 2023-05-15T19:29:12.141 INFO:tasks.ceph.osd.2.smithi062.stderr:problem writing to /var/log/ceph/ceph-osd.2.log: (28) No space left on device 2023-05-15T19:29:12.221 INFO:tasks.ceph.mds.c.smithi062.stderr:problem writing to /var/log/ceph/ceph-mds.c.log: (28) No space left on device 2023-05-15T19:29:12.250 INFO:tasks.ceph.osd.3.smithi062.stderr:problem writing to /var/log/ceph/ceph-osd.3.log: (28) No space left on device 2023-05-15T19:29:12.251 INFO:tasks.ceph.osd.1.smithi062.stderr:problem writing to /var/log/ceph/ceph-osd.1.log: (28) No space left on device 2023-05-15T19:29:12.711 INFO:tasks.ceph.mgr.y.smithi062.stderr:problem writing to /var/log/ceph/ceph-mgr.y.log: (28) No space left on device 2023-05-15T19:29:20.099 INFO:tasks.ceph.mds.a.smithi062.stderr:problem writing to /var/log/ceph/ceph-mds.a.log: (28) No space left on device 2023-05-15T19:44:37.905 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 747, in recv_stderr out = self.in_stderr_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() socket.timeout 2023-05-15T19:58:30.742 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 699, in recv out = self.in_buffer.read(nbytes, self.timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/buffered_pipe.py", line 164, in read raise PipeTimeout() paramiko.buffered_pipe.PipeTimeout During handling of the above exception, another exception occurred: Traceback (most recent call last): File "src/gevent/greenlet.py", line 906, in gevent._gevent_cgreenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/orchestra/run.py", line 323, in copy_file_to copy_to_log(src, logger, capture=stream, quiet=quiet) File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/teuthology/orchestra/run.py", line 276, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 125, in __next__ line = self.readline() File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_teuthology_69caab8ec6f44c61c991ae693e8e7b8cd859a896/virtualenv/lib/python3.8/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() socket.timeout 2023-05-16T00:00:03.295 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-16T00:00:03.289+0000 7fb4e6c88640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 44658) UID: 0 2023-05-16T00:00:03.320 INFO:tasks.ceph.mon.b.smithi161.stderr:2023-05-16T00:00:03.289+0000 7f12ecb9d640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 44658) UID: 0 2023-05-16T00:00:03.320 INFO:tasks.ceph.mon.c.smithi161.stderr:2023-05-16T00:00:03.289+0000 7fc56ba96640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 44658) UID: 0 2023-05-16T00:00:03.321 INFO:tasks.ceph.mon.c.smithi161.stderr:2023-05-16T00:00:03.289+0000 7fc56ba96640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2023-05-16T00:00:03.324 INFO:tasks.ceph.mon.b.smithi161.stderr:2023-05-16T00:00:03.289+0000 7f12ecb9d640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2023-05-16T00:00:03.325 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-05-16T00:00:03.289+0000 7fc5dad3f640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 44658) UID: 0 2023-05-16T00:00:03.325 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-05-16T00:00:03.289+0000 7f5f2fdcf640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 44658) UID: 0 2023-05-16T00:00:03.326 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-05-16T00:00:03.289+0000 7f5019ade640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 44658) UID: 0 2023-05-16T00:00:03.326 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-05-16T00:00:03.289+0000 7f9cbd1b0640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 44658) UID: 0 2023-05-16T00:00:03.327 INFO:tasks.ceph.mds.b.smithi161.stderr:2023-05-16T00:00:03.289+0000 7fc01fec2640 -1 received signal: Hangup from killall -q -1 ceph-mon ceph-mgr ceph-mds ceph-osd ceph-fuse radosgw rbd-mirror cephfs-mirror (PID: 44658) UID: 0 2023-05-16T00:00:03.327 INFO:tasks.ceph.osd.4.smithi161.stderr:2023-05-16T00:00:03.301+0000 7fc5dad3f640 -1 received signal: Hangup from (PID: 44659) UID: 0 2023-05-16T00:00:03.327 INFO:tasks.ceph.mgr.x.smithi161.stderr:2023-05-16T00:00:03.301+0000 7fb4e6c88640 -1 received signal: Hangup from (PID: 44659) UID: 0 2023-05-16T00:00:03.328 INFO:tasks.ceph.osd.5.smithi161.stderr:2023-05-16T00:00:03.301+0000 7f5f2fdcf640 -1 received signal: Hangup from (PID: 44659) UID: 0 2023-05-16T00:00:03.328 INFO:tasks.ceph.osd.6.smithi161.stderr:2023-05-16T00:00:03.301+0000 7f5019ade640 -1 received signal: Hangup from (PID: 44659) UID: 0 2023-05-16T00:00:03.328 INFO:tasks.ceph.mds.b.smithi161.stderr:2023-05-16T00:00:03.301+0000 7fc01fec2640 -1 received signal: Hangup from (PID: 44659) UID: 0 2023-05-16T00:00:03.329 INFO:tasks.ceph.mon.b.smithi161.stderr:2023-05-16T00:00:03.301+0000 7f12ecb9d640 -1 received signal: Hangup from (PID: 44659) UID: 0 2023-05-16T00:00:03.329 INFO:tasks.ceph.mon.b.smithi161.stderr:2023-05-16T00:00:03.301+0000 7f12ecb9d640 -1 mon.b@1(peon) e1 *** Got Signal Hangup *** 2023-05-16T00:00:03.330 INFO:tasks.ceph.mon.c.smithi161.stderr:2023-05-16T00:00:03.301+0000 7fc56ba96640 -1 received signal: Hangup from (PID: 44659) UID: 0 2023-05-16T00:00:03.330 INFO:tasks.ceph.mon.c.smithi161.stderr:2023-05-16T00:00:03.301+0000 7fc56ba96640 -1 mon.c@2(peon) e1 *** Got Signal Hangup *** 2023-05-16T00:00:03.330 INFO:tasks.ceph.osd.7.smithi161.stderr:2023-05-16T00:00:03.301+0000 7f9cbd1b0640 -1 received signal: Hangup from (PID: 44659) UID: 0 2023-05-16T00:00:09.646 INFO:tasks.ceph.mon.a.smithi062.stderr:problem writing to /var/log/ceph/ceph-mon.a.log: (28) No space left on device 2023-05-16T00:00:09.647 INFO:tasks.ceph.osd.0.smithi062.stderr:problem writing to /var/log/ceph/ceph-osd.0.log: (28) No space left on device 2023-05-16T00:00:09.997 INFO:tasks.ceph.osd.0.smithi062.stderr:problem writing to /var/log/ceph/ceph-osd.0.log: (28) No space left on device 2023-05-16T04:18:43.413 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-05-16T04:18:43.436 DEBUG:teuthology.task.console_log:Killing console logger for smithi062 2023-05-16T04:18:43.437 DEBUG:teuthology.task.console_log:Killing console logger for smithi161 2023-05-16T04:18:43.438 DEBUG:teuthology.task.console_log:Killing console logger for smithi171 2023-05-16T04:18:43.438 DEBUG:teuthology.exit:Finished running handlers